Mcp Eval Runner

Mcp Eval Runner is a standardized testing harness designed for MCP (Model Context Protocol) servers and agent workflows. It allows developers and teams to define test cases as YAML or JSON fixtures, enabling regression testing of agent toolchains with live or simulated MCP servers. With features like composable assertions, flexible execution modes, CI integration, and regression reporting, it streamlines the process of verifying the correctness and reliability of MCP-connected tools and agent workflows. Ideal for MCP integrators, agent developers, and teams building robust model-based systems.