Datasets processed from MOSS for Fine-Tuning
Matthew Khoriaty
AMindToThink
AI & ML interests
None yet
Recent Activity
published a dataset 9 days ago
AMindToThink/olmo-2-1124-7b-four-stage-samples-rlhf-diversity updated a dataset 9 days ago
AMindToThink/olmo-2-1124-7b-four-stage-samples-rlhf-diversity liked a model 2 months ago
codefuse-ai/F2LLM-4BOrganizations
None yet
RMU: bio forget corpora. cyber: cyber forget. both wikitext retain
https://arxiv.org/abs/2410.19278.
The code https://github.com/AMindToThink/wmdp.
-
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer3
Text Generation • 3B • Updated • 5 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer3
Text Generation • 3B • Updated • 3 -
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer3
Text Generation • 3B • Updated • 2 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer3
Text Generation • 3B • Updated • 4 •
Datasets processed from MOSS for Fine-Tuning
RMU: bio forget corpora. cyber: cyber forget. both wikitext retain
https://arxiv.org/abs/2410.19278.
The code https://github.com/AMindToThink/wmdp.
-
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer3
Text Generation • 3B • Updated • 5 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer3
Text Generation • 3B • Updated • 3 -
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer3
Text Generation • 3B • Updated • 2 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer3
Text Generation • 3B • Updated • 4 •