Crawl4AI RAGSAFE
Web Crawling and RAG Capabilities for AI Agents and AI Coding Assistants
Overview
From the repository's own README, as read at the audited commit. Badges and raw HTML are left out.
Crawl4AI RAG MCP Server
Web Crawling and RAG Capabilities for AI Agents and AI Coding Assistants
A powerful implementation of the Model Context Protocol (MCP) integrated with Crawl4AI and Supabase for providing AI agents and AI coding assistants with advanced web crawling and RAG capabilities.
With this MCP server, you can scrape anything and then use that knowledge anywhere for RAG.
The primary goal is to bring this MCP server into Archon as I evolve it to be more of a knowledge engine for AI coding assistants to build AI agents. This first version of the Crawl4AI/RAG MCP server will be improved upon greatly soon, especially making it more configurable so you can use different embedding models and run everything locally with Ollama.
Consider this GitHub repository a testbed, hence why I haven't been super actively address issues and pull requests yet. I certainly will though as I bring this into Archon V2!
Overview
This MCP server provides tools that enable AI agents to crawl websites, store content in a vector database (Supabase), and perform RAG over the crawled content. It follows the best practices for building MCP servers based on the Mem0 MCP server template I provided on my channel previously.
The server includes several advanced RAG strategies that can be enabled to enhance retrieval quality:
- Contextual Embeddings for enriched semantic understanding
- Hybrid Search combining vector and keyword search
- Agentic RAG for specialized code example extraction
- Reranking for improved result relevance using cross-encoder models
- Knowledge Graph for AI hallucination detection and repository code analysis
See the Configuration section below for details on how to enable and configure
89eda2b2bac1OBSERVED · 2026-09-23Connect
Built from this server's own package name, version and transport as found in its source — not copied from anyone's documentation, so it cannot drift against a page we do not control. Replace the environment placeholders with a token scoped to the least it needs.
claude mcp add crawl4ai-mcp --env NEO4J_PASSWORD=${NEO4J_PASSWORD} --env OPENAI_API_KEY=${OPENAI_API_KEY} --env SUPABASE_SERVICE_KEY=${SUPABASE_SERVICE_KEY} -- uvx crawl4ai-mcp{
"mcpServers": {
"crawl4ai-mcp": {
"command": "uvx",
"args": [
"crawl4ai-mcp"
],
"env": {
"NEO4J_PASSWORD": "${NEO4J_PASSWORD}",
"OPENAI_API_KEY": "${OPENAI_API_KEY}",
"SUPABASE_SERVICE_KEY": "${SUPABASE_SERVICE_KEY}"
}
}
}
}Exposed tools (8)
8 read · 0 write · 0 destructive.
| Tool | Risk | Description |
|---|---|---|
check_ai_script_hallucinations | read | |
crawl_single_page | read | |
get_available_sources | read | |
parse_github_repository | read | |
perform_rag_query | read | |
query_knowledge_graph | read | |
search_code_examples | read | |
smart_crawl_url | read |
Trust audit
SAFEgrade B · trust 89/100 Nothing in the source contradicts what it says it does. Grade A is reserved for packages that have also passed the behavioural sandbox.
| Layer | What it checks | Result |
|---|---|---|
| L0 | Provenance & inventory | PASS |
| L1 | Static analysis of the code | PASS |
| L2 | Instruction surface (what it tells the agent) | PASS |
| L3 | Class-specific surface | PASS |
| L4 | Behavioural (sandbox) | SKIPPED |
What the source does
- Filesystem
- declared (2 observation(s))
- Network
- declared (1 observation(s))
- Shell
- none-observed
- Dependencies
- pinned
- Secrets in source
- none-found
Findings (0)
No findings outside the package's declared scope.
Gates applied: no_behavioural_pass.
89eda2b2bac1full audit observations/trust-audit/mcp-server/coleam00__crawl4ai-rag.json · Report an issue / request a re-scanAudit history
Every audit this server has had. A grade with a past is a grade somebody is still checking.
| Date | Source | Verdict | Grade | Score | Change |
|---|---|---|---|---|---|
| 2026-09-23 | 89eda2b2bac1 | SAFE | B | 89 | source changed, verdict held |
Questions
What is the Crawl4AI RAG MCP server?
Web Crawling and RAG Capabilities for AI Agents and AI Coding Assistants
What tools does Crawl4AI RAG expose?
8 in total: 8 read-only, 0 that write, and 0 that can delete or overwrite. Every one is listed on this page with its risk.
Is Crawl4AI RAG safe to connect to an agent?
The audit found nothing in the source that contradicts what it says it does, and graded it B (89/100). Grade A is held back for packages that have also passed a sandboxed behavioural run, which is why a clean server reads B.
What credentials does Crawl4AI RAG need?
It reads NEO4J_PASSWORD, OPENAI_API_KEY and SUPABASE_SERVICE_KEY from the environment. Give it a token scoped to the least it needs — an agent that can be talked into calling a tool can be talked into calling it with your credentials.
How current is this page?
The grade is for one exact copy of the source (89eda2b2bac1), read on 2026-09-23. The repository is watched and re-audited when it changes.