azure-ai-evaluation-py
✓Azure AI Evaluation SDK for Python. Use for evaluating generative AI applications with quality, safety, and custom evaluators. Triggers: "azure-ai-evaluation", "evaluators", "GroundednessEvaluator", "evaluate", "AI quality metrics".
Installation
SKILL.md
Assess generative AI application performance with built-in and custom evaluators.
| GroundednessEvaluator | AI | groundedness (1-5) | | RelevanceEvaluator | AI | relevance (1-5) | | CoherenceEvaluator | AI | coherence (1-5) | | FluencyEvaluator | AI | fluency (1-5) | | SimilarityEvaluator | AI | similarity (1-5) | | RetrievalEvaluator | AI | retrieval (1-5) | | F1ScoreEvaluator | NLP | f1score (0-1) |
| RougeScoreEvaluator | NLP | rouge scores | | ViolenceEvaluator | Safety | violence (0-7) | | SexualEvaluator | Safety | sexual (0-7) | | SelfHarmEvaluator | Safety | selfharm (0-7) | | HateUnfairnessEvaluator | Safety | hateunfairness (0-7) | | QAEvaluator | Composite | All quality metrics | | ContentSafetyEvaluator | Composite | All safety metrics |
Facts (cite-ready)
Stable fields and commands for AI/search citations.
- Install command
npx skills add https://github.com/microsoft/agent-skills --skill azure-ai-evaluation-py- Source
- microsoft/agent-skills
- Category
- </>Dev Tools
- Verified
- ✓
- First Seen
- 2026-02-01
- Updated
- 2026-02-18
Quick answers
What is azure-ai-evaluation-py?
Azure AI Evaluation SDK for Python. Use for evaluating generative AI applications with quality, safety, and custom evaluators. Triggers: "azure-ai-evaluation", "evaluators", "GroundednessEvaluator", "evaluate", "AI quality metrics". Source: microsoft/agent-skills.
How do I install azure-ai-evaluation-py?
Open your terminal or command line tool (Terminal, iTerm, Windows Terminal, etc.) Copy and run this command: npx skills add https://github.com/microsoft/agent-skills --skill azure-ai-evaluation-py Once installed, the skill will be automatically configured in your AI coding environment and ready to use in Claude Code or Cursor
Where is the source repository?
https://github.com/microsoft/agent-skills
Details
- Category
- </>Dev Tools
- Source
- skills.sh
- First Seen
- 2026-02-01