grpo-rl-training

Expert-level guidance for implementing Group Relative Policy Optimization (GRPO) using the Transformer Reinforcement Learning (TRL) library. This skill provides battle-tested patterns, critical insights, and production-ready workflows for fine-tuning language models with custom reward functions.

| Correctness | Verifiable tasks (math, code) | 2.0 (highest) | | Format | Strict structure enforcement | 0.5-1.0 | | Length | Encourage verbosity/conciseness | 0.1-0.5 | | Style | Penalize unwanted patterns | -0.5 to 0.5 |

Critical Insight: Combine 3-5 reward functions for robust training. Order matters less than diversity of signals.

Экспертное руководство по точной настройке GRPO/RL с помощью TRL для рассуждений и обучения модели для конкретных задач. Источник: orchestra-research/ai-research-skills.