advanced-evaluation

SKILL.md

LLM-as-a-Judge techniques for evaluating AI outputs. Not a single technique but a family of approaches - choosing the right one and mitigating biases is the core competency.

Direct Scoring: Single LLM rates one response on a defined scale.

Pairwise Comparison: LLM compares two responses and selects better one.

掌握法学硕士法官评估技术，包括直接评分、成对比较、评分细则生成和偏差缓解。在构建评估系统、比较模型输出或为人工智能生成的内容建立质量标准时使用。 来源：shipshitdev/library。

查看原文