fine-tuning-with-trl

Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning

12.1k 0TeXResearch
PlatformUniversal

Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.

All Skills