AI & ML interests
None defined yet.
Recent Activity
Organization Card
This is the organization grouping all the models and datasets used in the TRL library.
spaces 9
Running
Chat Template Inspector
📚
Inspect and test chat templates for Hugging Face models
Running
Trl Pypi
⚡
View side‑by‑side code differences online
Running
Trl Pypi
⚡
Show weekly PyPI download trends in an interactive chart
Running
4
Trackio
🚀
Track and visualize data streams in real-time
Running
4
Recommend vLLM Memory
😻
Estimate GPU memory usage for model training
Paused
6
Dataset Length Profiler
👁
Estimate optimal max_length for SFT training
models 84
trl-lib/rloo_tldr
Text Generation • 1B • Updated • 1
trl-lib/ppo_tldr
Text Generation • 1B • Updated • 4
trl-lib/Qwen3-4B-LoRA
Updated • 1
trl-lib/Qwen2-0.5B-Reward-Math-Sheperd
Token Classification • 0.5B • Updated • 10 • 1
trl-lib/Qwen2-0.5B-XPO
Text Generation • 0.5B • Updated • 3 •
trl-lib/Qwen2-0.5B-OnlineDPO
Text Generation • 0.5B • Updated • 10 • • 1
trl-lib/Qwen2-0.5B-KTO
Text Generation • 0.5B • Updated • 3
trl-lib/Qwen2-0.5B-ORPO
Text Generation • 0.5B • Updated • 181 • 2
trl-lib/Qwen2-0.5B-DPO
Text Generation • 0.5B • Updated • 196 • 4
trl-lib/Qwen2-0.5B-Reward
Text Classification • 0.5B • Updated • 165 • 1
datasets 23
trl-lib/trackio-dataset
Viewer • Updated • 3.83k • 20.7k • 5
trl-lib/documentation-images
Viewer • Updated • 11 • 92.1k
trl-lib/DeepMath-103K
Viewer • Updated • 103k • 4.62k • 9
trl-lib/llava-instruct-mix
Viewer • Updated • 228k • 2.94k • 3
trl-lib/OpenMathReasoning
Viewer • Updated • 3.2M • 598
trl-lib/chatbot_arena_completions
Viewer • Updated • 33k • 229 • 1
trl-lib/rlaif-v
Viewer • Updated • 83.1k • 448 • 3
trl-lib/ultrafeedback-gpt-3.5-turbo-helpfulness
Viewer • Updated • 16.6k • 38 • 4
trl-lib/ultrafeedback-prompt
Viewer • Updated • 39.8k • 524 • 9
trl-lib/tldr-preference
Viewer • Updated • 179k • 143 • 3