Openlit

Openlit is an open-source tool designed to provide comprehensive observability, tracing, and evaluation for LLM (Large Language Model) and AI applications. Tailored for developers and engineering teams, Openlit enables real-time monitoring, distributed tracing, prompt management, model evaluation, and multi-deployment management with seamless integration—no code changes required. Its privacy-first and self-hosted approach ensures data never leaves your infrastructure, making it ideal for production workloads at scale.