dspy-evaluation-suite
✓This skill should be used when the user asks to "evaluate a DSPy program", "test my DSPy module", "measure performance", "create evaluation metrics", "use answer_exact_match or SemanticF1", mentions "Evaluate class", "comparing programs", "establishing baselines", or needs to systematically test and measure DSPy program quality with custom or built-in metrics.
Installation
SKILL.md
Systematically evaluate DSPy programs using built-in and custom metrics with parallel execution.
| program | dspy.Module | Program to evaluate | | devset | list[dspy.Example] | Evaluation examples | | metric | callable | Scoring function | | numthreads | int | Parallel threads |
| score | float | Average metric score | | results | list | Per-example results |
This skill should be used when the user asks to "evaluate a DSPy program", "test my DSPy module", "measure performance", "create evaluation metrics", "use answer_exact_match or SemanticF1", mentions "Evaluate class", "comparing programs", "establishing baselines", or needs to systematically test and measure DSPy program quality with custom or built-in metrics. Source: omidzamani/dspy-skills.
Facts (cite-ready)
Stable fields and commands for AI/search citations.
- Install command
npx skills add https://github.com/omidzamani/dspy-skills --skill dspy-evaluation-suite- Source
- omidzamani/dspy-skills
- Category
- </>Dev Tools
- Verified
- ✓
- First Seen
- 2026-02-01
- Updated
- 2026-02-18
Quick answers
What is dspy-evaluation-suite?
This skill should be used when the user asks to "evaluate a DSPy program", "test my DSPy module", "measure performance", "create evaluation metrics", "use answer_exact_match or SemanticF1", mentions "Evaluate class", "comparing programs", "establishing baselines", or needs to systematically test and measure DSPy program quality with custom or built-in metrics. Source: omidzamani/dspy-skills.
How do I install dspy-evaluation-suite?
Open your terminal or command line tool (Terminal, iTerm, Windows Terminal, etc.) Copy and run this command: npx skills add https://github.com/omidzamani/dspy-skills --skill dspy-evaluation-suite Once installed, the skill will be automatically configured in your AI coding environment and ready to use in Claude Code or Cursor
Where is the source repository?
https://github.com/omidzamani/dspy-skills
Details
- Category
- </>Dev Tools
- Source
- skills.sh
- First Seen
- 2026-02-01