Crawl4AI MCP Server
Open-source web crawling and extraction as MCP tools for agents.
Open-source web crawling and extraction as MCP tools for agents.
npx skills add agentskillexchange/skills --skill crawl4ai-mcp-server
Crawl4AI MCP Server wraps the Crawl4AI open-source web crawling library behind a Model Context Protocol interface. It exposes tools for single-page scraping, multi-page crawling with configurable depth, and sitemap-based crawling. Results come back as clean, LLM-ready markdown.
Best for
- Research pipelines and RAG ingestion
- Documentation extraction and competitive monitoring
- Any workflow needing structured web content without a paid crawling service
How it differs from Firecrawl
Entirely self-hosted and free. No API keys for the crawling layer, no rate limits from a third party, no usage-based charges. Runs locally or in Docker.
Install notes
Clone the repository and install with pip, or pull the Docker image (docker pull uysalsadi/crawl4ai-mcp-server:latest). Configure the server in your MCP client config. Requires Python 3.10+ or Docker. No API key needed.