AI & ML interests
Pioneering the Next Era of AI with Vector Intelligence
Recent Activity
Papers
N-Gram Memories at Two Bits: Quantizing Lookup Tables in Large Language Models
Making Qwen3 Think in Korean with Reinforcement Learning
DNA 3.0 preserves Qwen 3.5/3.6 strengths while removing censorship on China-related topics.
Patched versions of Qwen3 with identical weights, featuring a separated chat_template.jinja and {% generation %} tags for seamless trl assistant_only.
High-performance LLM developed by Dnotitia Inc., incorporating cutting-edge techniques for superior reasoning tasks.
8B Korean SoTA model, which is instruction-tuned by Dnotitia Inc.
For more details, please visit https://github.com/dnotitia/smoothie-qwen
-
Smoothie-Qwen: Post-Hoc Smoothing to Reduce Language Bias in Multilingual LLMs
Paper • 2507.05686 • Published • 1 -
dnotitia/Smoothie-Qwen2.5-0.5B-Instruct
Text Generation • 0.5B • Updated • 29 -
dnotitia/Smoothie-Qwen2.5-1.5B-Instruct
Text Generation • 2B • Updated • 30 • 1 -
dnotitia/Smoothie-Qwen2.5-3B-Instruct
Text Generation • 3B • Updated • 27 • 2
Systematic SFT, GRPO for Qwen3-4B. We explore diverse dataset compositions and training recipes to benchmark and improve performance across tasks.
Making Qwen3 Think in Korean with Reinforcement Learning https://arxiv.org/abs/2508.10355
Reasoning model distilled from DeepSeek-R1, enhanced with GRPO using supplementary reasoning datasets.
For more details, please visit https://github.com/dnotitia/smoothie-qwen
-
Smoothie-Qwen: Post-Hoc Smoothing to Reduce Language Bias in Multilingual LLMs
Paper • 2507.05686 • Published • 1 -
dnotitia/Smoothie-Qwen3-0.6B
Text Generation • 0.6B • Updated • 60 • 1 -
dnotitia/Smoothie-Qwen3-1.7B
Text Generation • 2B • Updated • 35 • 2 -
dnotitia/Smoothie-Qwen3-4B
Text Generation • 4B • Updated • 42 • 4
DNA 3.0 preserves Qwen 3.5/3.6 strengths while removing censorship on China-related topics.
Systematic SFT, GRPO for Qwen3-4B. We explore diverse dataset compositions and training recipes to benchmark and improve performance across tasks.
Patched versions of Qwen3 with identical weights, featuring a separated chat_template.jinja and {% generation %} tags for seamless trl assistant_only.
Making Qwen3 Think in Korean with Reinforcement Learning https://arxiv.org/abs/2508.10355
High-performance LLM developed by Dnotitia Inc., incorporating cutting-edge techniques for superior reasoning tasks.
Reasoning model distilled from DeepSeek-R1, enhanced with GRPO using supplementary reasoning datasets.
8B Korean SoTA model, which is instruction-tuned by Dnotitia Inc.
For more details, please visit https://github.com/dnotitia/smoothie-qwen
-
Smoothie-Qwen: Post-Hoc Smoothing to Reduce Language Bias in Multilingual LLMs
Paper • 2507.05686 • Published • 1 -
dnotitia/Smoothie-Qwen3-0.6B
Text Generation • 0.6B • Updated • 60 • 1 -
dnotitia/Smoothie-Qwen3-1.7B
Text Generation • 2B • Updated • 35 • 2 -
dnotitia/Smoothie-Qwen3-4B
Text Generation • 4B • Updated • 42 • 4
For more details, please visit https://github.com/dnotitia/smoothie-qwen
-
Smoothie-Qwen: Post-Hoc Smoothing to Reduce Language Bias in Multilingual LLMs
Paper • 2507.05686 • Published • 1 -
dnotitia/Smoothie-Qwen2.5-0.5B-Instruct
Text Generation • 0.5B • Updated • 29 -
dnotitia/Smoothie-Qwen2.5-1.5B-Instruct
Text Generation • 2B • Updated • 30 • 1 -
dnotitia/Smoothie-Qwen2.5-3B-Instruct
Text Generation • 3B • Updated • 27 • 2