crawl4ai
✓This skill should be used when users need to scrape websites, extract structured data, handle JavaScript-heavy pages, crawl multiple URLs, or build automated web data pipelines. Includes optimized extraction patterns with schema generation for efficient, LLM-free extraction.
Installation
SKILL.md
Crawl4AI provides comprehensive web crawling and data extraction capabilities. This skill supports both CLI (recommended for quick tasks) and Python SDK (for programmatic control).
For SDK configuration details: SDK Guide - Configuration (lines 61-150)
| Browser settings | -B browser.yml or -b "param=value" | BrowserConfig(...) | | Crawl settings | -C crawler.yml or -c "param=value" | CrawlerRunConfig(...) | | Extraction | -e extract.yml -s schema.json | extractionstrategy=... | | Content filter | -f filter.yml | markdowngenerator=... |
This skill should be used when users need to scrape websites, extract structured data, handle JavaScript-heavy pages, crawl multiple URLs, or build automated web data pipelines. Includes optimized extraction patterns with schema generation for efficient, LLM-free extraction. Source: brettdavies/crawl4ai-skill.
Facts (cite-ready)
Stable fields and commands for AI/search citations.
- Install command
npx skills add https://github.com/brettdavies/crawl4ai-skill --skill crawl4ai- Category
- {}Data Analysis
- Verified
- ✓
- First Seen
- 2026-02-11
- Updated
- 2026-02-18
Quick answers
What is crawl4ai?
This skill should be used when users need to scrape websites, extract structured data, handle JavaScript-heavy pages, crawl multiple URLs, or build automated web data pipelines. Includes optimized extraction patterns with schema generation for efficient, LLM-free extraction. Source: brettdavies/crawl4ai-skill.
How do I install crawl4ai?
Open your terminal or command line tool (Terminal, iTerm, Windows Terminal, etc.) Copy and run this command: npx skills add https://github.com/brettdavies/crawl4ai-skill --skill crawl4ai Once installed, the skill will be automatically configured in your AI coding environment and ready to use in Claude Code or Cursor
Where is the source repository?
https://github.com/brettdavies/crawl4ai-skill
Details
- Category
- {}Data Analysis
- Source
- skills.sh
- First Seen
- 2026-02-11