grpo-rl-training

SKILL.md

Expert-level guidance for implementing Group Relative Policy Optimization (GRPO) using the Transformer Reinforcement Learning (TRL) library. This skill provides battle-tested patterns, critical insights, and production-ready workflows for fine-tuning language models with custom reward functions.

| Correctness | Verifiable tasks (math, code) | 2.0 (highest) | | Format | Strict structure enforcement | 0.5-1.0 | | Length | Encourage verbosity/conciseness | 0.1-0.5 | | Style | Penalize unwanted patterns | -0.5 to 0.5 |

Critical Insight: Combine 3-5 reward functions for robust training. Order matters less than diversity of signals.

使用 TRL 進行 GRPO/RL 微調的專家指導，以進行推理和特定於任務的模型訓練 來源：orchestra-research/ai-research-skills。

查看原文