Austin McCaffrey

AustinAligned's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in teex-pt/AMALIA-9B-0626-DPO-LoRA-legal-v2 3 days ago

Question about your legal DPO work on AMALIA

3

#1 opened 3 days ago by

AustinAligned

New activity in nbeerbower/Gemma4-Gutenberg-12B-lora 3 days ago

Question about your Gutenberg preference tuning process

2

#1 opened 3 days ago by

AustinAligned

New activity in auditing-agents/qwen_14b_synth_docs_only_then_redteam_kto_increasing_pep 3 days ago

Question about your KTO-implanted behaviors

#1 opened 3 days ago by

AustinAligned

New activity in dementor-research/dpo_gsm8k_olmo-3-7b_as_qwen3.6-35b-a3b_seed42 3 days ago

Question about your DPO experiment series

#1 opened 3 days ago by

AustinAligned

New activity in iknow-lab/JudgeBias-DPO-RefFree-LOSO-action 3 days ago

Question about the JudgeBias DPO datasets

#2 opened 3 days ago by

AustinAligned

New activity in CEIA-RL/rlaif-energy-scratch-b03 3 days ago

Question about your energy-sector preference training

#1 opened 3 days ago by

AustinAligned

New activity in juanjucm/Qwen2.5-0.5B-dpo-capybara 3 days ago

Question about your capybara DPO runs

#1 opened 3 days ago by

AustinAligned

New activity in cstr/Spaetzle-v8-7b-orpo2-GGUF 3 days ago

Question about your Spaetzle ORPO training

#1 opened 3 days ago by

AustinAligned

New activity in allura-forge/g4-orpo-merged-ckpt10 3 days ago

Question about your g4 ORPO training

#1 opened 3 days ago by

AustinAligned

New activity in Gueule-d-ange/aup-fullft-kto-nolam-seed6 3 days ago

Question about your KTO sweep

#1 opened 3 days ago by

AustinAligned

New activity in Steve-KJ/Minerva-DPO-v0.1 3 days ago

Question about your Minerva DPO training

#1 opened 3 days ago by

AustinAligned

New activity in banhchungtuongot/qwen25-1p5b-massive-orpo-boundary 3 days ago

Question about your ORPO boundary training

#1 opened 3 days ago by

AustinAligned

New activity in khoilamalphaai/chess-coach-32b-v6-dpo2 3 days ago

Question about your chess coach DPO iterations

#1 opened 3 days ago by

AustinAligned

New activity in HermitQ/NPCAlign-DPO 3 days ago

Question about your NPC alignment DPO process

#1 opened 3 days ago by

AustinAligned

New activity in tohio/slm-synthetic-dpo-short-factual-stop-behavior 3 days ago

Question about your behavior-specific DPO datasets

#1 opened 3 days ago by

AustinAligned

New activity in Pankayaraj/DA-GRPO-MODEL-gemma-3-1b-it-DATASET-STAR-41K-DA-Filtered-DeepSeek-R1-Distill-Llama-8B 3 days ago

Question about your preference training work

#1 opened 3 days ago by

AustinAligned

New activity in erenfazlioglu/turkish-instruct-reasoning-dpo-3.4m 3 days ago

Question about building this DPO suite

#2 opened 3 days ago by

AustinAligned

New activity in iSshobhit/bnpl-triage-qwen3-4b-dpo 3 days ago

Question about your BNPL triage DPO training

#1 opened 3 days ago by

AustinAligned

New activity in ThakrePranjal/pharma-preference-dataset-unsloth 3 days ago

Question about your pharma preference dataset

#1 opened 3 days ago by

AustinAligned

New activity in Makaco/lmps-challenge-qwen3.5-9b-dpo 3 days ago

Question about your DPO training and ablations

#1 opened 3 days ago by

AustinAligned