advanced-evaluation

This skill covers production-grade techniques for evaluating LLM outputs using LLMs as judges. It synthesizes research from academic papers, industry practices, and practical implementation experience into actionable patterns for building reliable evaluation systems.

Key insight: LLM-as-a-Judge is not a single technique but a family of approaches, each suited to different evaluation contexts. Choosing the right approach and mitigating known biases is the core competency this skill develops.

Evaluation approaches fall into two primary categories with distinct reliability profiles:

이 기술은 사용자가 "판사로서 LLM 구현", "모델 출력 비교", "평가 루브릭 생성", "평가 편향 완화"를 요청하거나 직접 채점, 쌍별 비교, 위치 편향, 평가 파이프라인 또는 자동화된 품질 평가를 언급할 때 사용해야 합니다. 출처: chakshugautam/games.