Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

Data Selection

community

https://github.com/microsoft/LMOps/tree/main/data_selection

AI & ML interests

Data Selection for Language Models

Data-Selection 's collections 2

Baseline Models

Models Trained on Redpajama-CC

Data-Selection/BSL-160M

Text Generation • Updated Oct 28, 2024 • 25
Data-Selection/BSL-470M

Text Generation • Updated Oct 28, 2024 • 20
Data-Selection/BSL-1.7B

Text Generation • Updated Mar 25, 2025 • 22
Data-Selection/BSL-1B

Text Generation • Updated Oct 28, 2024 • 11

Models trained on PDS-Selected Data

Data-Selection/PDS-160M

Text Generation • 0.2B • Updated Mar 25, 2025 • 30
Data-Selection/PDS-470M

Text Generation • 0.5B • Updated Mar 25, 2025 • 14
Data-Selection/PDS-1B

Text Generation • Updated Mar 25, 2025 • 19
Data-Selection/PDS-1.7B

Text Generation • Updated Mar 25, 2025 • 219

Baseline Models

Models Trained on Redpajama-CC

Data-Selection/BSL-160M

Text Generation • Updated Oct 28, 2024 • 25
Data-Selection/BSL-470M

Text Generation • Updated Oct 28, 2024 • 20
Data-Selection/BSL-1.7B

Text Generation • Updated Mar 25, 2025 • 22
Data-Selection/BSL-1B

Text Generation • Updated Oct 28, 2024 • 11

Models trained on PDS-Selected Data

Data-Selection/PDS-160M

Text Generation • 0.2B • Updated Mar 25, 2025 • 30
Data-Selection/PDS-470M

Text Generation • 0.5B • Updated Mar 25, 2025 • 14
Data-Selection/PDS-1B

Text Generation • Updated Mar 25, 2025 • 19
Data-Selection/PDS-1.7B

Text Generation • Updated Mar 25, 2025 • 219

Company

TOS Privacy About Careers

Website

Models Datasets Spaces Pricing Docs