Opik

Opik is an open-source, end-to-end AI observability and evaluation platform built by Comet, designed to help developers debug, evaluate, and monitor LLM applications, RAG pipelines, and agentic workflows. It provides comprehensive tracing of every LLM call, tool invocation, and agent step, along with automated evaluation metrics for hallucination detection, context recall, relevance, and more. Opik supports prompt management with version control, automated prompt optimization, built-in guardrails, and CI/CD integration via PyTest. It can be self-hosted via Docker or Kubernetes, or used as a managed cloud service on comet.com.