advanced-evaluation

This skill covers production-grade techniques for evaluating LLM outputs using LLMs as judges. It synthesizes research from academic papers, industry practices, and practical implementation experience into actionable patterns for building reliable evaluation systems.

Key insight: LLM-as-a-Judge is not a single technique but a family of approaches, each suited to different evaluation contexts. Choosing the right approach and mitigating known biases is the core competency this skill develops.

Evaluation approaches fall into two primary categories with distinct reliability profiles:

當使用者要求「實施LLM作為法官」、「比較模型輸出」、「創建評估標準」、「減輕評估偏差」或提到直接評分、成對比較、位置偏差、評估流程或自動品質評估時，應使用此技能。 來源：chakshugautam/games。