Web search MCP servers

polite-crawler: a polite web crawler for research and AI agents. Fetch once, keep it, read it many times. robots.txt, one request per site, full-text search, MCP server.

Scores a site 0-100 and generates GEO/AEO files for owners who want AI citations.

URL to clean Markdown for AI agents. 2 tools: scrape_url (one page) and crawl_website (whole site). Blocked or paywalled pages are reported honestly, never invented. Hosted endpoint at scrape.mcp.goaimoat.com/mcp, free 3 calls per email, no card. A cheaper Firecrawl alternative; also runs locally vi

MCP server that searches inside several archives at once, browses their catalogues and reads records. No API key.

An open-source, local-first Model Context Protocol (MCP) server for **AI Search Crawler Governance, Brand Safety Guardrails, Canonical Integrity, and IndexNow Notifications

Hosted MCP server: let Claude, Cursor or Cline browse the web from a real Singapore mobile IP (Singtel/M1). Free 24h trial.

Open-source deep research MCP. Qwen3-30B-A3B-Thinking via OpenRouter, cited web synthesis for Claude Code, Codex, Cursor, Hermes and any MCP-compatible agent.

Compare web scraping, crawling and SERP API pricing and limits against your workload and budget

MCP server for web extraction and rendering via Ace Data Cloud.

Anti-detect agentic stealth browser: undetected browsing, browser automation, Python AI web browsing agent, computer use, scraping, lead generation. No captchas.

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

Convert Claude Code or Codex into the most intelligent Deep Research Agent. Collect, search, and synthesize web research into a persistent, searchable wiki that builds on itself. Hosted API + MCP: hyperresearch.ai

⚠️ DEPRECATED — Use https://github.com/zoharbabin/web-researcher-mcp instead

Self-hosted URL- and file-to-Markdown service for humans and AI agents - web pages, documents, images, audio, YouTube. PWA + REST + MCP + Claude Code skill, Reddit-aware, refreshable share links.

Memory database for LLM agents — persistent keyword + optional semantic memory, project namespacing, served over HTTP REST and MCP from a single ASGI process. SQLite-backed, packaged as a Docker container. Runs on your hardware.

Personal knowledge system — MCP server with PostgreSQL semantic search and temporal knowledge graph

A Model Context Protocol (MCP) server providing TomTom's location services, search, routing, and traffic data to AI agents.

Claude plugin: check what AI assistants tell buyers about your company against your own pricing pages. No API key.

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

Comprehensive HTTP fetch MCP server with SSRF protection, HTML-to-markdown, and robots.txt awareness

Research methods, workflow tools, and independent review for AI agents, packaged as a Skill, plugin, and local MCP server.

Zotero MCP: Connects your Zotero research library with Claude and other AI assistants via the Model Context Protocol to discuss papers, get summaries, analyze citations, and more.

Redis integration for Google Agent Development Kit (ADK) - Memory, Sessions, Search Tools, MCP