LLM Council is an open-source tool for locally comparing and synthesizing responses from multiple large language models (LLMs) via a simple web interface. It facilitates side-by-side evaluation and collaborative review, allowing each LLM to not only answer prompts but also review and rank responses from other models before a 'Chairman' model produces a final answer. This platform is ideal for developers, AI researchers, and anyone interested in rigorous multi-model evaluation, consensus generation, or prompt engineering experiments.
Visit LLM Council's official website for product details and getting started.
Community discussions, bug reports, and feature requests for LLM Council.