ai-evals

SKILL.md

Help the user create systematic evaluations for AI products using insights from AI practitioners.

Evals are the new PRD Brendan Foody: "If the model is the product, then the eval is the product requirement document." Evals define what success looks like in AI products—they're not optional quality checks, they're core specifications.

Evals are a core product skill Hamel Husain & Shreya Shankar: "Both the chief product officers of Anthropic and OpenAI shared that evals are becoming the most important new skill for product builders." This isn't just for ML engineers—product people need to master this.

사용자가 AI 평가를 생성하고 실행하도록 돕습니다. 누군가가 LLM 제품에 대한 평가를 구축하고, 모델 품질을 측정하고, 테스트 사례를 만들고, 기준표를 디자인하거나, AI 출력 품질을 체계적으로 측정하려고 할 때 사용하세요. 출처: refoundai/lenny-skills.

원본 보기