Web Scraping & Data Collection
1,084 MCP servers in this category, most used first.
- Scrapling MCP ServerWeb scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.
- Robin: AI-Powered Dark Web OSINTDark web OSINT over Tor: search onion engines, scrape pages, report with your own model.
- Apify Mcp ServerExtract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡
- WebclawFast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
- Anysearch Mcp ServerUnified real-time search MCP server supporting general web search, vertical domain search, parallel batch search, and full-page URL content
- Open WebsearchMulti-engine MCP server, CLI, and local daemon for agent web search and content retrieval - skill-guided workflows, no API keys.
- Duckduckgo Mcp ServerA Model Context Protocol (MCP) server that provides web search capabilities through DuckDuckGo, with additional features for content fetchin
- Web Search McpA simple, locally hosted Web Search MCP server for use with Local LLMs
- CrwFast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-c
- CRW Web ScraperOpen-source web scraper for AI agents with scrape, crawl, and map tools
- fastCRWScrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
- Fetch McpA flexible HTTP fetching Model Context Protocol server.
- KagimcpThe Official Model Context Protocol (MCP) server for Kagi Search & other tools.
- XActionsX/Twitter automation MCP: scrape, post, schedule, analyze, engage. No API key required.
- Groksearch RsRust MCP server for Grok web search and Tavily-backed source retrieval
- Google Scholar Mcp ServerA MCP Server for Google Scholar: 🔍 Enable AI assistants to search and access Google Scholar papers through a simple MCP interface.
- SpotifyscraperPublic Spotify metadata, lyrics and podcasts for LLM agents. No API key, read-only.
- Mcp Server GscA Model Context Protocol (MCP) server providing access to Google Search Console
- Semrush Ai ToolSemrush SEO AI-powered analysis tool MCP server & CLI for keyword research, domain analytics, backlink analysis
- Amazon Scraper V2Agent-ready Amazon Scraper API: real-time product details (batch ASIN), offers & stock, reviews, search, best sellers, deals and seller data
- Mcp ScholarlyA MCP server to search for accurate academic articles.
- Agent Control🚀 High-performance AI Agent Control Plane, Task Orchestration & Model Context Protocol (MCP) Platform
- Scrapeless Mcp ServerWeb search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
- Mcp Server SerperSerper MCP Server supporting search and webpage scraping
- CrawlbergScrape, crawl, and map websites to Markdown or JSON via local CLI.
- KreuzcrawlScrape, crawl, and map websites to Markdown or JSON via local CLI.
- Mcp Read Website FastQuickly reads webpages and converts to markdown for fast, token efficient web scraping
- Sci Hub Mcp Server🔍 Enable AI assistants to search, access, and analyze academic papers through Sci-Hub using a simple MCP interface.
- WebReaperAI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
- Suganthans Gsc McpAn MCP server for Google Search Console. Ask Claude questions about your search data and get real answers. 20 tools: quick wins, cannibalisa
- Pubmed Mcp Server🔍 Enable AI assistants to search, access, and analyze PubMed articles through a simple MCP interface.
- AnansiA self-healing scraper for hostile sites: broken selectors repair themselves, browser rendering kicks in when needed, and a coherent identit
- Oxylabs Oxylabs McpFetch and process content from specified URLs using the Oxylabs Web Scraper API.
- Oxylabs McpFetch and process content from specified URLs & sources using the Oxylabs Web Scraper API.
- doc-scraperCrawl documentation sites into local corpora agents can search, read, and diff fully offline.
- Scrapegraph McpAI-powered web scraping and data extraction capabilities through ScrapeGraph API
- Scrapegraphai Scrapegraph McpEnable language models to perform advanced AI-powered web scraping with enterprise-grade reliabili…
- Pulse FetchMCP server for fetching web resources with content extraction and anti-bot bypass.
- Agent SkillsYou.com skills and plugins for web search, content extraction, research, finance, and integration discovery, helping AI agents build with up
- ShadowCrawlRust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot.
- ČSFDMovies, TV series, creators and user ratings from ČSFD.cz, the Czech-Slovak film database
- Tripadvisor McpA Model Context Protocol (MCP) server for Tripadvisor Content API. This provides access to Tripadvisor location data, reviews, and photos t
- McpOfficial Supadata MCP Server - Adds powerful video & web scraping to Cursor, Claude and any other LLM clients.
- Puremd McpUnblock, scrape, and search tools for MCP clients
- Crawlbase McpCrawlbase MCP Server connects AI agents and LLMs with real-time web data. It powers Claude, Cursor, and Windsurf integrations with battle-te
- LilbeeThe whole local AI stack in one executable: it runs and manages local AI models across every GPU, and it's a search engine you can talk to,
- Agent SkillsAgent skills that give AI agents live web data — search, scrape, and extract structured data with Extraction Templates and Web Search Agents
- Tomtom Maps McpA Model Context Protocol (MCP) server providing TomTom's location services, search, routing, and traffic data to AI agents.
- Ai Browser McpAI浏览器 MCP Server — Windows 本地浏览器自动化 MCP 服务端 · 334 个工具全量真机核验(0 失败/0 闪退) · Cursor/Claude Code/Claude Desktop/Trae 原生 stdio 直连 · Web Scraping ·
- Awesome Seo McpA curated list of MCP servers for SEO. Search Console, keywords, backlinks, crawling, SERPs and AI search visibility, verified with install
- proxy-scraperFree proxies that actually work: verified HTTP/SOCKS proxies, and pages fetched through them
- Mcp Google Custom Search ServerAn mcp server for searching against google custom search api
- Mcp Server WebcrawlMCP server tailored to connecting web crawler data and archives
- Jina Mcp ToolsA Model Context Protocol (MCP) server that integrates with Jina AI Search Foundation APIs.
- WebScraping.AIWeb scraping tools with Chromium JS rendering, rotating proxies, and AI question answering.
- Hn ServerHacker news MCP server
- Mcp Server SearxngAn MCP server implementation that integrates with SearXNG, providing privacy-focused meta search capabilities.
- Mcp ServerEnable your AI agents to scrape and parse web content dynamically, including geo-restricted sites
- Webfetch McpLive Web Access for Your Local AI — Tunable Search & Clean Content Extraction
- Mcp Sefaria ServerFetch and read Jewish texts through the API of Sefaria.org
- Subio McpMCP server that scrapes public posts from X, LinkedIn and Hacker News in a local browser that is never signed in
- Google ResearcherMCP server providing Google Search, web scraping, and multi-source research tools for AI assistants
- CN Scraper MCPMCP server for AI agents to search major Chinese internet platforms with local-first login support.
- Telegram Mcp ServerPowerfull Telegram MCP for Claude Desktop to scrape and analyze Telegram content.
- FirecrawlScrape, crawl, and extract structured data from websites at scale
- ScrapingantScrape webpages, handle JavaScript and CAPTCHA, extract structured data
- Google SearchScrape Google search results with SERP data, ads, and knowledge panels
- ApifyBuild, deploy, and run web scraping and automation actors in the cloud
- Websearch DeepseekAn MCP server that provides web search capabilities powered by DeepSeek API, designed for AI assistants and agents.
- Google Search Console Mcp ServerModel Context Protocol server for Google Search Console API - integrate with Claude Code and Claude Desktop
- Baidu Mcp ServerBaidu Search MCP Server I A Model Context Protocol (MCP) server that provides web search capabilities through Baidu, with additional feature
- Google Browser ScraperGoogle search scraper with a real browser and your own proxy. Self-hosted SerpApi alternative with an HTTP API and an MCP server.
- Mapify Mcp ServerTransform text, YouTube videos, and web content into beautiful mind maps using AI 🧠✨
- Qt Web ExtractorMultimodal web content extraction engine backed by Qt WebEngine.
- RagstackSearch, chat, upload, and scrape a serverless RAGStack knowledge base on AWS.
- You.com Web Access & AIWeb search, AI agent, and content extraction via You.com APIs
- Html To Markdown McpMCP server for converting HTML to Markdown using Turndown.js. Fetch web pages and convert them to clean, formatted Markdown.
- Biorxiv Mcp Server🔍 Enable AI assistants to search and access bioRxiv papers through a simple MCP interface.
- Searxng McpPrivate web search MCP: SearXNG metasearch → ML reranking → 4-tier fetch cascade (Firecrawl / Crawl4AI / raw / Wayback) with per-domain lear
- Fetch BrowserA powerful headless browser MCP server that enables AI agents to fetch web content and perform Google searches without requiring any API key
- Overseerr McpModel Context Protocol (MCP) server for Overseerr and Seerr (the unified successor) - enables AI assistants to search, request, and manage m
- Olostep Mcp ServerMCP server for Olostep — the web scraping, crawling, and search infrastructure used by top AI companies. Gives any MCP-compatible AI agent t
- Nearby Search McpAn MCP server for nearby place searches with IP-based location detection.
- Hn McpHacker News MCP Server
- Scrapi McpMCP server for using ScrAPI to scrape web pages.
- Wet McpOpen-source MCP server for AI agents: web search, content extraction, and library docs.
- Clinicaltrials Mcp Server🔍 Enable AI assistants to search and access ClinicalTrials.gov data through a simple MCP interface.
- Seo Crawler McpCrawl and analyse websites for SEO errors using Crawlee with SQLite storage
- Cnkicrawlermcp基于GO爬虫的知网MCP工具-知网MCP-CNKI-MCP
- Deep Research Mcp ServerYour AI-Powered Research Assistant. Conduct iterative, deep research using Google Gemini 2.5 Flash with Google Search Grounding and URL cont
- PyreCrawlWeb scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.
- Mult Fetch Mcp ServerA versatile MCP-compliant web content fetching tool that supports multiple modes (browser/node), formats (HTML/JSON/Markdown/Text), and inte
- Websearch Mcp ServerMCP server for agent web search
- Nodebench260 MCP tools across 49 domains. AI Flywheel, quality gates, research, web scraping.
- McpScrape any website, extract structured data, and collect web content at scale with AI agents
- Mcp KibelaMCP server implementation that enables AI assistants to search and reference Kibela content
- Mcp Google Images SearchMCP server for searching images with Google
- Mcp Crawl4Ai TsTypeScript implementation of an MCP server for Crawl4AI. Provides tools for web crawling, content extraction, and browser automation.
- Open Museum McpOne MCP search across open-access museum collections (The Met, Rijksmuseum, Smithsonian, Cleveland, AIC, SMK, Walters, Wellcome, Wikimedia C
- Mcp Server WebscanA Model Context Protocol (MCP) server for web content scanning and analysis. This server provides tools for fetching, analyzing, and extract
Other MCP server categories
- Developer Tools
- API Development
- Data Science & ML
- Productivity & Workflow
- Analytics & Monitoring
- Security & Testing
- Deployment & DevOps
- Other
- Learning & Documentation
- Database Management
- Content Management
- Collaboration Tools
- Cloud Infrastructure
- Marketing Automation
- Design Tools
- Browser Automation
- E-commerce Solutions
- Social Media Management
- Game Development