About Webcrawl
Webcrawl (mcp-server-webcrawl) is an MCP (Model Context Protocol) server that enables AI agents such as Claude Desktop to access and utilize web crawl data from a variety of popular crawlers, including ArchiveBox, HTTrack, InterroBot, Katana, SiteOne, WARC, and wget. Designed for AI developers and technical users, it acts as a bridge between web scraping tools and AI platforms by exposing local or archived web content through a standardized protocol.
Resources
Product Website
Visit Webcrawl's official website for product details and getting started.
Documentation
Comprehensive API reference and integration guidelines for Webcrawl.
Blog
Insights and use cases for implementing Webcrawl with various AI agents.
Community Forum
A platform for users to discuss features, share tips, and seek help related to Webcrawl.