Webshift

Webshift

Noise-free web content extraction for LLM pipelines and agents.

Visit Webshift

About Webshift

WebShift is an open-source Rust library and Model Context Protocol (MCP) server that transforms noisy, cluttered web pages into clean, right-sized text for LLM (Large Language Model) consumption. It strips out irrelevant HTML elements (ads, scripts, navigation, etc.), enforces strict output size budgets, and provides both a fast HTML-to-text pipeline and an MCP server for seamless integration into AI agent workflows. WebShift is ideal for developers building AI agents that need robust, configurable, and resource-efficient tools for web content extraction and search.

Resources

Product Website

Visit Webshift's official website for product details and getting started.

Visit website →

Documentation

Comprehensive guide and API reference for using WebShift effectively.

View docs →

GitHub Discussions

Community forum for discussing features, issues, and use cases of WebShift.

Join the discussion →