Nucleotide Transformer (InstaDeep)
DNA language models trained on thousands of genomes for variant and regulatory prediction.
Nature Methods 2024: models up to 2.5B parameters trained on 3,200 human genomes and 850 species.
How it works
Nucleotide Transformer uses masked language modelling over 6-mer tokens.
- Open weights
- Short context
Latest papers
topQuery for this technology: (TITLE:"Nucleotide Transformer" OR ABSTRACT:"Nucleotide Transformer" OR TITLE:"InstaDeep" OR ABSTRACT:"InstaDeep") AND (cancer OR tumor OR tumour OR oncology OR carcinoma OR lymphoma OR leukemia OR leukaemia OR myeloma OR sarcoma OR melanoma OR glioma). Results are unfiltered search hits about Nucleotide Transformer (InstaDeep), not a curated reading list.
Pages like this
not linked directly; found by shared links- TechnologyAlphaGenome
Shares the tags foundation-model, genome.
- TechnologyAlphaMissense
Shares the tags foundation-model, genome.
- TechnologyEnformer and Borzoi (DeepMind, Calico)
Shares the tags foundation-model, genome.
- TechnologyEvo 2 (Arc Institute, NVIDIA)
Shares the tags foundation-model, genome.