Robotstxt Ai is an open-source tool and MCP server designed to help website owners and SEO professionals manage which AI crawlers and search bots can access their website, all through an intuitive visual interface. It allows users to enable or block over 20 different AI bots—including GPTBot, ClaudeBot, and more—by generating or analyzing robots.txt files without manual editing. It also features MCP server compatibility for integration with tools like Claude Desktop and Cursor, making it ideal for those focused on AI management and website privacy.
Visit Robotstxt Ai's official website for product details and getting started.
Comprehensive guides and API references for using Robotstxt Ai effectively.
Insights and tips on managing AI bot access and optimizing robots.txt files.
Join discussions and ask questions about Robotstxt Ai on its GitHub Issues page.