Langfuse is the open-source LLM observability platform that OrchestKit uses for tracing, monitoring, evaluation, and prompt management. Unlike LangSmith (deprecated), Langfuse is self-hosted, free, and designed for production LLM applications.
| Distributed Tracing | Track LLM calls with parent-child spans | references/tracing-setup.md | | Cost Tracking | Automatic token & cost calculation | references/cost-tracking.md | | Prompt Management | Version control for prompts | references/prompt-management.md | | LLM Evaluation | Custom scoring with G-Eval | references/evaluation-scores.md |
| Session Tracking | Group related traces | references/session-tracking.md | | Experiments API | A/B testing & benchmarks | references/experiments-api.md | | Multi-Judge Eval | Ensemble LLM evaluation | references/multi-judge-evaluation.md |
Piattaforma di osservabilità LLM per tracciabilità, valutazione, gestione tempestiva e monitoraggio dei costi. Da utilizzare durante la configurazione di Langfuse, il monitoraggio dei costi LLM, il monitoraggio dell'utilizzo dei token o l'implementazione del controllo delle versioni tempestivo. Fonte: yonatangross/skillforge-claude-plugin.