Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
trl-lib
's Collections
Preference datasets
Stepwise supervision datasets
Prompt-completion datasets
Prompt-only datasets
Unpaired preference datasets
Comparing DPO with IPO and KTO
Online-DPO
Prompt-only datasets
updated
Nov 13, 2025
Upvote
-
trl-lib/ultrafeedback-prompt
Viewer
•
Updated
Jan 8, 2025
•
39.8k
•
318
•
9
trl-lib/DeepMath-103K
Viewer
•
Updated
Nov 14, 2025
•
103k
•
3.7k
•
11
Upvote
-
Share collection
View history
Collection guide
Browse collections
