Webcrawl

About Webcrawl

mcp-server-webcrawl is a Model Context Protocol (MCP) server designed to integrate web crawler data (from popular tools like ArchiveBox, HTTrack, InterroBot, Katana, SiteOne, WARC, and wget) with AI clients such as Claude Desktop. It provides a full-text and Boolean search interface for efficiently filtering and analyzing web-crawled content, allowing AI systems or users to conduct advanced retrieval operations across website archives. Ideal for technical professionals, researchers, and AI developers managing or searching large web archive datasets.