silent-failure-detection
✓Detect quiet failures in LLM agents - tool skipping, gibberish outputs, infinite loops, and degraded quality. Use when agents appear to work but produce incorrect results.
Installation
SKILL.md
Detect when LLM agents fail silently - appearing to work while producing incorrect results.
| Detection priority | Tool skipping > Gibberish > Loops > Anomalies | | Quality check | LLM-as-judge with heuristic pre-filter | | Loop threshold | 10 iterations or 3x baseline tokens | | Anomaly threshold | Z-score > 3.0 (99.7% confidence) | | Alert strategy | Alert on silent failure, not just errors |
| Tool Skipping | Expected vs actual tool calls | Critical | | Gibberish Output | LLM-as-judge + heuristics | High | | Infinite Loop | Iteration count + token spike | Critical | | Quality Degradation | Score < baseline | Medium | | Latency Spike | p99 > threshold | Medium |
Facts (cite-ready)
Stable fields and commands for AI/search citations.
- Install command
npx skills add https://github.com/yonatangross/orchestkit --skill silent-failure-detection- Source
- yonatangross/orchestkit
- Category
- </>Dev Tools
- Verified
- ✓
- First Seen
- 2026-02-03
- Updated
- 2026-02-18
Quick answers
What is silent-failure-detection?
Detect quiet failures in LLM agents - tool skipping, gibberish outputs, infinite loops, and degraded quality. Use when agents appear to work but produce incorrect results. Source: yonatangross/orchestkit.
How do I install silent-failure-detection?
Open your terminal or command line tool (Terminal, iTerm, Windows Terminal, etc.) Copy and run this command: npx skills add https://github.com/yonatangross/orchestkit --skill silent-failure-detection Once installed, the skill will be automatically configured in your AI coding environment and ready to use in Claude Code or Cursor
Where is the source repository?
https://github.com/yonatangross/orchestkit
Details
- Category
- </>Dev Tools
- Source
- skills.sh
- First Seen
- 2026-02-03