MiniCPM-SALA: Hybridizing Sparse and Linear Attention for Efficient Long-Context Modeling Paper • 2602.11761 • Published Feb 12 • 8
Student-in-the-Loop Chain-of-Thought Distillation via Generation-Time Selection Paper • 2604.02819 • Published Apr 3 • 1
DECO: Sparse Mixture-of-Experts with Dense-Comparable Performance on End-Side Devices Paper • 2605.10933 • Published May 11 • 4
Attention Amnesia in Hybrid LLMs: When CoT Fine-Tuning Breaks Long-Range Recall, and How to Fix It Paper • 2606.11052 • Published Jun 9 • 17
Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts Paper • 2601.22156 • Published Jan 29 • 15
Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts Paper • 2601.22156 • Published Jan 29 • 15
StateX: Enhancing RNN Recall via Post-training State Expansion Paper • 2509.22630 • Published Sep 26, 2025 • 4
BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity Paper • 2507.08771 • Published Jul 11, 2025 • 10
Cost-Optimal Grouped-Query Attention for Long-Context LLMs Paper • 2503.09579 • Published Mar 12, 2025 • 5
Sparsing Law: Towards Large Language Models with Greater Activation Sparsity Paper • 2411.02335 • Published Nov 4, 2024 • 11
Stuffed Mamba: State Collapse and State Capacity of RNN-Based Long-Context Modeling Paper • 2410.07145 • Published Oct 9, 2024 • 2
CFDBench: A Large-Scale Benchmark for Machine Learning Methods in Fluid Dynamics Paper • 2310.05963 • Published Sep 13, 2023 • 1
Robust and Scalable Model Editing for Large Language Models Paper • 2403.17431 • Published Mar 26, 2024
$\infty$Bench: Extending Long Context Evaluation Beyond 100K Tokens Paper • 2402.13718 • Published Feb 21, 2024 • 1
Sub-Character Tokenization for Chinese Pretrained Language Models Paper • 2106.00400 • Published Jun 1, 2021
Beyond the Turn-Based Game: Enabling Real-Time Conversations with Duplex Models Paper • 2406.15718 • Published Jun 22, 2024 • 14