·langsmith-code-eval
</>

langsmith-code-eval

Creates code-based evaluators for LangSmith-traced agents. Use when building custom evaluation logic, testing tool usage patterns, or scoring agent outputs programmatically. Triggers on requests to evaluate agents, create evaluators, or run experiments against LangSmith datasets.

14Installs·0Trend·@langchain-ai

Installation

$npx skills add https://github.com/langchain-ai/lca-skills --skill langsmith-code-eval

How to Install langsmith-code-eval

Quickly install langsmith-code-eval AI skill to your development environment via command line

  1. Open Terminal: Open your terminal or command line tool (Terminal, iTerm, Windows Terminal, etc.)
  2. Run Installation Command: Copy and run this command: npx skills add https://github.com/langchain-ai/lca-skills --skill langsmith-code-eval
  3. Verify Installation: Once installed, the skill will be automatically configured in your AI coding environment and ready to use in Claude Code, Cursor, or OpenClaw

Source: langchain-ai/lca-skills.

SKILL.md

View raw

Creates evaluators for LangSmith experiments through structured inspection and implementation.

IMPORTANT: Do NOT search or explore the codebase. Ask the user all of these questions upfront using AskUserQuestion before doing anything else.

Ask the user the following in a single AskUserQuestion call:

Creates code-based evaluators for LangSmith-traced agents. Use when building custom evaluation logic, testing tool usage patterns, or scoring agent outputs programmatically. Triggers on requests to evaluate agents, create evaluators, or run experiments against LangSmith datasets. Source: langchain-ai/lca-skills.

Facts (cite-ready)

Stable fields and commands for AI/search citations.

Install command
npx skills add https://github.com/langchain-ai/lca-skills --skill langsmith-code-eval
Category
</>Dev Tools
Verified
First Seen
2026-02-19
Updated
2026-03-11

Browse more skills from langchain-ai/lca-skills

Quick answers

What is langsmith-code-eval?

Creates code-based evaluators for LangSmith-traced agents. Use when building custom evaluation logic, testing tool usage patterns, or scoring agent outputs programmatically. Triggers on requests to evaluate agents, create evaluators, or run experiments against LangSmith datasets. Source: langchain-ai/lca-skills.

How do I install langsmith-code-eval?

Open your terminal or command line tool (Terminal, iTerm, Windows Terminal, etc.) Copy and run this command: npx skills add https://github.com/langchain-ai/lca-skills --skill langsmith-code-eval Once installed, the skill will be automatically configured in your AI coding environment and ready to use in Claude Code, Cursor, or OpenClaw

Where is the source repository?

https://github.com/langchain-ai/lca-skills

Details

Category
</>Dev Tools
Source
skills.sh
First Seen
2026-02-19