Article
1
Pere Martra
oopere
AI & ML interests
AI Research Engineer | Structured Pruning & LLM Efficiency | Fairness-Aware Optimization | Author “Rearchitecting LLMs” @Manning | 2K GitHub ⭐
Recent Activity
updated a collection 21 days ago
Rearchitecting LLMs liked a model 21 days ago
oopere/SmolLM2-1.7B-ClinicalNER updated a model 21 days ago
oopere/SmolLM2-1.7B-ClinicalNEROrganizations
Articles 2
Article
20
Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach
Companion models for Rearchitecting LLMs (Manning). Pruning, Distillation, Fine-Tuning, Attention Optimization & Activation Analysis for efficient SLM
FinLLMOpt is a comprehensive collection of optimized Financial Large Language Models (FinLLMs) designed to address various tasks in the financial doma
models 20
oopere/SmolLM2-1.7B-ClinicalNER
2B • Updated • 283 • 1
oopere/llama-3.2-3b-attn-drop-6
3B • Updated • 16 • 1
oopere/gemma-3-270m-14L-distilled
0.2B • Updated • 105 • 3
oopere/llama-3.2-3b-attn-drop-3
3B • Updated • 3 • 1
oopere/Qwen3.5-0.65B-Base-Rearchitected
0.7B • Updated • 7 • 7
oopere/pruned10-llama-3.2-3B
Text Generation • 3B • Updated • 6
oopere/pruned20-llama-3.2-3b
Text Generation • 3B • Updated • 5
oopere/pruned60-llama-3.2-3b
Text Generation • 2B • Updated • 6
oopere/pruned60-llama-3.2-1B
Text Generation • 0.8B • Updated • 13 • 1
oopere/Llama-3.2-1B-pruned-40pct
Text Generation • 0.9B • Updated • 17 • 2
datasets 5
oopere/clinical-ner-qdora
Viewer • Updated • 400 • 260 • 1
oopere/fairness-pruning-pairs-en
Viewer • Updated • 75 • 89 • 1
oopere/fairness-pruning-pairs-es
Viewer • Updated • 100 • 83 • 1
oopere/RetailBanking-Conversations
Viewer • Updated • 1.42k • 34 • 2
oopere/knowledge_transfer_1500_base
Viewer • Updated • 1.27k • 16 • 2