RNAErnie RNA language model family: PaddlePaddle original (RNAErnie) and PyTorch retrain (RNAErnie2)
Taykhoom Dalal
Taykhoom
·
AI & ML interests
None yet
Recent Activity
updated a collection 28 minutes ago
RNAErnie updated a model 28 minutes ago
Taykhoom/RNAErnie published a model 28 minutes ago
Taykhoom/RNAErnieOrganizations
SpliceBERT RNA language model: 3 variants (1024nt vertebrate, 510nt vertebrate, 510nt human)
UTRBERT: BERT-base models pre-trained on 3-prime UTR sequences, 3- through 6-mer tokenization.
RNABERT: RNA language model for clustering and structural alignment.
Minimal HuggingFace ports of UTR-LM RNA language model, with four checkpoints covering different auxiliary objectives (MLM, MFE, secondary structure).
HF port of ERNIE-RNA: RNA language model with 2D structural pairing bias
DNABERT family: k-mer variants (3/4/5/6), DNABERT-2 (BPE+ALiBi), and DNABERT-S (species-aware). All with Flash Attention 2 and SDPA.
MSA-based RNA language model trained on homologous RNA sequence alignments.
Minimal HuggingFace ports of RiNALMo RNA language model (micro, mega, giga).
RNAErnie RNA language model family: PaddlePaddle original (RNAErnie) and PyTorch retrain (RNAErnie2)
HF port of ERNIE-RNA: RNA language model with 2D structural pairing bias
SpliceBERT RNA language model: 3 variants (1024nt vertebrate, 510nt vertebrate, 510nt human)
DNABERT family: k-mer variants (3/4/5/6), DNABERT-2 (BPE+ALiBi), and DNABERT-S (species-aware). All with Flash Attention 2 and SDPA.
UTRBERT: BERT-base models pre-trained on 3-prime UTR sequences, 3- through 6-mer tokenization.
MSA-based RNA language model trained on homologous RNA sequence alignments.
RNABERT: RNA language model for clustering and structural alignment.
Minimal HuggingFace ports of RiNALMo RNA language model (micro, mega, giga).
Minimal HuggingFace ports of UTR-LM RNA language model, with four checkpoints covering different auxiliary objectives (MLM, MFE, secondary structure).