Rigel https://open-lm-engine.github.io/blog/rigel/ open-lm-engine/rigel-base Text Generation • 2B • Updated 10 days ago • 551 • 4 open-lm-engine/rigel-base-long Text Generation • 2B • Updated 10 days ago • 749 • 3 open-lm-engine/rigel-mid Text Generation • 2B • Updated 10 days ago • 175 • 2
M2RNN Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models open-lm-engine/gdn-7b 7B • Updated Mar 12 • 7 • 1 open-lm-engine/m2rnn-7b 7B • Updated Mar 12 • 13 • 2 open-lm-engine/transformer-7b 7B • Updated Mar 12 • 12 • 1 open-lm-engine/hybrid-gdn-7b 7B • Updated Mar 12 • 11 • 1
Rigel https://open-lm-engine.github.io/blog/rigel/ open-lm-engine/rigel-base Text Generation • 2B • Updated 10 days ago • 551 • 4 open-lm-engine/rigel-base-long Text Generation • 2B • Updated 10 days ago • 749 • 3 open-lm-engine/rigel-mid Text Generation • 2B • Updated 10 days ago • 175 • 2
M2RNN Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models open-lm-engine/gdn-7b 7B • Updated Mar 12 • 7 • 1 open-lm-engine/m2rnn-7b 7B • Updated Mar 12 • 13 • 2 open-lm-engine/transformer-7b 7B • Updated Mar 12 • 12 • 1 open-lm-engine/hybrid-gdn-7b 7B • Updated Mar 12 • 11 • 1