crawl
✓Crawl any website and save pages as local markdown files. Use when you need to download documentation, knowledge bases, or web content for offline access or analysis. No code required - just provide a URL.
Installation
SKILL.md
Crawl websites to extract content from multiple pages. Ideal for documentation, knowledge bases, and site-wide content extraction.
Tavily API Key Required - Get your key at https://tavily.com
When outputdir is provided, each crawled page is saved as a separate markdown file.
Crawl any website and save pages as local markdown files. Use when you need to download documentation, knowledge bases, or web content for offline access or analysis. No code required - just provide a URL. Source: tavily-ai/tavily-plugins.
Facts (cite-ready)
Stable fields and commands for AI/search citations.
- Install command
npx skills add https://github.com/tavily-ai/tavily-plugins --skill crawl- Source
- tavily-ai/tavily-plugins
- Category
- {}Data Analysis
- Verified
- ✓
- First Seen
- 2026-02-01
- Updated
- 2026-02-18
Quick answers
What is crawl?
Crawl any website and save pages as local markdown files. Use when you need to download documentation, knowledge bases, or web content for offline access or analysis. No code required - just provide a URL. Source: tavily-ai/tavily-plugins.
How do I install crawl?
Open your terminal or command line tool (Terminal, iTerm, Windows Terminal, etc.) Copy and run this command: npx skills add https://github.com/tavily-ai/tavily-plugins --skill crawl Once installed, the skill will be automatically configured in your AI coding environment and ready to use in Claude Code or Cursor
Where is the source repository?
https://github.com/tavily-ai/tavily-plugins
Details
- Category
- {}Data Analysis
- Source
- skills.sh
- First Seen
- 2026-02-01