apify-mcp-server
by apify · TypeScript
Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡
Search & WebMaintainedRemote11k
Best Web Scraping & Crawling MCP servers
Turn any web page into clean Markdown or structured data. Compare hosted APIs (Firecrawl, Apify, Bright Data) with self-hosted crawlers. We compared 18 Web Scraping & Crawling MCP servers — 15 updated in the last 90 days, 9 with one-click install — ranked by relevance and GitHub stars.
Official: apify-mcp-server by apify, firecrawl-mcp-server by firecrawl, brightdata-mcp by brightdata
Quick comparison
Top 12 by relevance. Status: maintained = commit in the last 90 days.
| Server | Stars | Status | Updated | Install | API key |
|---|---|---|---|---|---|
| apify-mcp-serverapify | ★ 11k | Maintained | today | One-click | Likely |
| firecrawl-mcp-serverfirecrawl | ★ 7.6k | Maintained | today | Command | Likely |
| markdownify-mcpzcaceres | ★ 3k | Maintained | 18 days ago | One-click | Not mentioned |
| brightdata-mcpbrightdata | ★ 2.7k | Maintained | 2 days ago | Command | Likely |
| Douyin_TikTok_Download_APIEvil0ctal | ★ 20.6k | Maintained | 11 days ago | One-click | Likely |
| mobile-mcpmobile-next | ★ 9.1k | Maintained | yesterday | Command | Not mentioned |
| wigoloKnockOutEZ | ★ 5.5k | Maintained | today | One-click | Likely |
| exa-mcp-serverexa-labs | ★ 5.1k | Maintained | 6 days ago | See README | Likely |
| invisible_playwright_mcpfeder-cr | ★ 2.8k | Maintained | yesterday | One-click | Likely |
| tavily-mcptavily-ai | ★ 2.4k | Maintained | 8 days ago | Command | Likely |
| webclaw0xMassi | ★ 2.4k | Maintained | today | One-click | Likely |
| DevDocscyberagiinc | ★ 2.1k | Aging | 8 months ago | See README | Likely |
All 18 Web Scraping & Crawling MCP servers
Showing all 18 servers
firecrawl-mcp-server
by firecrawl · JavaScript
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
Search & WebMaintainedRemote7.6k
markdownify-mcp
by zcaceres · TypeScript
A Model Context Protocol server for converting almost anything to Markdown
Memory & KnowledgeMaintained3k
brightdata-mcp
by brightdata · JavaScript
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
Search & WebMaintainedRemote2.7k
Douyin_TikTok_Download_API
by Evil0ctal · Python
🚀 抖音、TikTok 数据采集与无水印视频下载 API，自托管，支持 MCP 调用与 Docker 一键部署。| Self-hosted TikTok & Douyin scraper and no-watermark video downloader — async REST API, MCP server, CLI and web console for posts, profiles, comments and playlists. Self-healing identity pool, PostgreSQL archive, one docker compose up.
Media & DesignMaintainedRemote20.6k
mobile-mcp
by mobile-next · TypeScript
Model Context Protocol Server for Mobile Automation and Scraping (iOS, Android, Emulators, Simulators and Real Devices)
Developer ToolsMaintainedRemote9.1k
wigolo
by KnockOutEZ · TypeScript
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
Search & WebMaintainedRemote5.5k
exa-mcp-server
by exa-labs · TypeScript
Connect AI agents to Exa for web search, content fetching, and multi-step research.
Search & WebMaintainedRemote5.1k
invisible_playwright_mcp
by feder-cr · Python
Playwright MCP server undetected by anti-bots and captchas: AI agent browses the web on anti-detect stealth Firefox, Python, undetected browser automation, scraping, computer use.
Browser AutomationMaintained2.8k
tavily-mcp
by tavily-ai · TypeScript
Production ready MCP server with real-time search, extract, map & crawl.
Search & WebMaintainedRemote2.4k
webclaw
by 0xMassi · Rust
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
Search & WebMaintainedRemote2.4k
DevDocs
by cyberagiinc · TypeScript
Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App
Developer ToolsAging2.1k
crw
by fastcrw · Rust
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Search & WebMaintained1.1k
google-search
by web-agent-master · TypeScript
A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.
Search & WebStaleRemote622
XActions
by nirholas · HTML
⚡ The Complete X/Twitter Automation Toolkit — Scrapers, MCP server for AI agents (Claude/GPT), CLI, browser scripts. No API fees. Open source. Unfollow people who don't follow back. Monitor real-time analytics. Auto follow, like, comment, scrape, without API. Follow Bot. Like bot. Grow your account automatically.
Marketing & CommerceMaintainedRemote590
seo
by iannuttall · TypeScript
The only SEO skill your agent needs. 70+ SEO audit tools through a local CLI and MCP server, using your own crawl, Search Console, and GA4 data.
Marketing & CommerceMaintainedRemote572
doctor
by sisig-ai · Python
Doctor is a tool for discovering, crawl, and indexing web sites to be exposed as an MCP server for LLM agents.
Search & WebStaleRemote458
mcp-omnisearch
by spences10 · TypeScript
🔍 A Model Context Protocol (MCP) server providing unified access to multiple search engines (Tavily, Brave, Kagi, Exa), AI tools (Kagi FastGPT, Exa, Linkup), and content extraction services (Firecrawl, Tavily, Kagi). Includes GitHub search. All through a single interface.
Search & WebMaintainedRemote356
No servers match
Try a broader search term or clear the filters.
Web Scraping & Crawling MCP server FAQ
What is the best Web Scraping & Crawling MCP server?
Based on GitHub stars and recent activity, apify-mcp-server by apify (★ 11k, updated today) is the most popular actively maintained option on HookMCP, followed by firecrawl-mcp-server and markdownify-mcp. The right choice depends on whether you need write access, a hosted (remote) endpoint, or a server that runs locally without an API key.
Is there an official Web Scraping & Crawling MCP server?
Yes — apify-mcp-server by apify, firecrawl-mcp-server by firecrawl, brightdata-mcp by brightdata are published by the vendor or the MCP project. Official servers are usually the safest first install.
How do I install a Web Scraping & Crawling MCP server in Claude, Cursor or VS Code?
Open the server's page on HookMCP, choose your client tab (Claude Desktop, Cursor, VS Code or Claude Code) and copy the config — 9 of the 18 servers here have one-click install links for Cursor and VS Code. Restart your AI app and the new tools appear automatically.
Do Web Scraping & Crawling MCP servers need an API key?
16 of 18 servers here mention API keys or tokens in their README; 2 don't mention any. Check each listing's Details panel, and pass keys as environment variables rather than pasting them into chat.
Related integrations
RAG & Documents 55Docker 35iOS & Android 29Codebase Search & Context 27Web Search 24GitHub 22Documentation & Docs 22Puppeteer & Chrome 20Social Media 16Playwright 11
Or browse by category: Developer Tools, Media & Design, Memory & Knowledge, Search & Web.