RNAErnie RNA language model family: PaddlePaddle original (RNAErnie) and PyTorch retrain (RNAErnie2)
Taykhoom Dalal
Taykhoom
·
AI & ML interests
None yet
Recent Activity
updated a collection 28 minutes ago
RNAErnie updated a model 28 minutes ago
Taykhoom/RNAErnie published a model 28 minutes ago
Taykhoom/RNAErnieOrganizations
SpliceBERT
SpliceBERT RNA language model: 3 variants (1024nt vertebrate, 510nt vertebrate, 510nt human)
UTRBERT
UTRBERT: BERT-base models pre-trained on 3-prime UTR sequences, 3- through 6-mer tokenization.
RNABERT
RNABERT: RNA language model for clustering and structural alignment.
UTR-LM
Minimal HuggingFace ports of UTR-LM RNA language model, with four checkpoints covering different auxiliary objectives (MLM, MFE, secondary structure).
ERNIE-RNA
HF port of ERNIE-RNA: RNA language model with 2D structural pairing bias
DNABERT
DNABERT family: k-mer variants (3/4/5/6), DNABERT-2 (BPE+ALiBi), and DNABERT-S (species-aware). All with Flash Attention 2 and SDPA.
RNA-MSM
MSA-based RNA language model trained on homologous RNA sequence alignments.
RiNALMo
Minimal HuggingFace ports of RiNALMo RNA language model (micro, mega, giga).
RNAErnie
RNAErnie RNA language model family: PaddlePaddle original (RNAErnie) and PyTorch retrain (RNAErnie2)
ERNIE-RNA
HF port of ERNIE-RNA: RNA language model with 2D structural pairing bias
SpliceBERT
SpliceBERT RNA language model: 3 variants (1024nt vertebrate, 510nt vertebrate, 510nt human)
DNABERT
DNABERT family: k-mer variants (3/4/5/6), DNABERT-2 (BPE+ALiBi), and DNABERT-S (species-aware). All with Flash Attention 2 and SDPA.
UTRBERT
UTRBERT: BERT-base models pre-trained on 3-prime UTR sequences, 3- through 6-mer tokenization.
RNA-MSM
MSA-based RNA language model trained on homologous RNA sequence alignments.
RNABERT
RNABERT: RNA language model for clustering and structural alignment.
RiNALMo
Minimal HuggingFace ports of RiNALMo RNA language model (micro, mega, giga).
UTR-LM
Minimal HuggingFace ports of UTR-LM RNA language model, with four checkpoints covering different auxiliary objectives (MLM, MFE, secondary structure).