ai-evals

SKILL.md

Help the user create systematic evaluations for AI products using insights from AI practitioners.

Evals are the new PRD Brendan Foody: "If the model is the product, then the eval is the product requirement document." Evals define what success looks like in AI products—they're not optional quality checks, they're core specifications.

Evals are a core product skill Hamel Husain & Shreya Shankar: "Both the chief product officers of Anthropic and OpenAI shared that evals are becoming the most important new skill for product builders." This isn't just for ML engineers—product people need to master this.

ユーザーによる AI 評価の作成と実行を支援します。 LLM 製品の評価を構築したり、モデルの品質を測定したり、テスト ケースを作成したり、ルーブリックを設計したり、AI の出力品質を体系的に測定しようとしているときに使用します。 ソース: refoundai/lenny-skills。

原文を見る