Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
ComparisonPO
/
Mistral-Instruct-7B-DPO
like
0
Follow
ComPO
4
Safetensors
trl-lib/ultrafeedback_binarized
mistral
License:
mit
Model card
Files
Files and versions
xet
Community
README.md exists but content is empty.
Downloads last month
4
Safetensors
Model size
7B params
Tensor type
BF16
·
Chat template
Files info
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for
ComparisonPO/Mistral-Instruct-7B-DPO
Base model
mistralai/Mistral-7B-v0.1
Finetuned
alignment-handbook/zephyr-7b-sft-full
Finetuned
(
393
)
this model
Dataset used to train
ComparisonPO/Mistral-Instruct-7B-DPO
trl-lib/ultrafeedback_binarized
Viewer
•
Updated
Sep 12, 2024
•
63.1k
•
4.21k
•
24