tensorrt-llm

SKILL.md

NVIDIA's open-source library for optimizing LLM inference with state-of-the-art performance on NVIDIA GPUs.

Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling. Source: orchestra-research/ai-research-skills.

Open your terminal or command line tool (Terminal, iTerm, Windows Terminal, etc.) Copy and run this command: npx skills add https://github.com/orchestra-research/ai-research-skills --skill tensorrt-llm Once installed, the skill will be automatically configured in your AI coding environment and ready to use in Claude Code or Cursor

Security certified for safe and reliable code One-click installation with simplified configuration Compatible with Claude Code, Cursor, and more

View raw