Comet
Comet is an AI developer platform built around Opik, its open-source observability and evaluation stack for LLM applications and agents. Teams use it to trace every step an agent takes, from context retrieval and tool calls to final responses, then score outputs, annotate failures, and push fixes back into code. The platform also includes MLOps experiment tracking for traditional machine learning workflows.
Opik connects logging to action. Test Suites let you write plain-text pass/fail assertions without building custom eval pipelines. Ollie, the built-in coding agent, reads traces, proposes fixes, and can write them directly to your repository through Opik Connect. Agent Playground runs full agents locally while streaming complete execution graphs into the UI. Cost Intelligence tracks Claude Code and Codex spend across engineering teams.
Comet targets ML engineers, AI platform teams, and data scientists shipping chatbots, RAG pipelines, and autonomous agents. Customers include Netflix, Uber, Autodesk, and Stability AI. The company reports 150,000+ users, 10,000+ teams, and 19,000+ GitHub stars on its open-source project.
Trace agent steps from retrieval and tool calls through final responses
30+ LLM-as-a-judge metrics plus Test Suites with plain-text assertions
Ollie writes trace-driven fixes straight into your codebase via Opik Connect
Integrates with 40+ frameworks including LangChain, CrewAI, and OpenAI
ML experiment tracking with model registry, versioning, and custom charts
Open-source Opik you can self-host or run on Comet's free cloud tier
Cost Intelligence tracks Claude Code and Codex spend across engineering teams
Open-source Opik can be self-hosted with the full observability and eval feature set.
Free Cloud tier includes 25,000 spans per month with no credit card required.
Ollie can analyze traces and write fixes directly into your agent codebase.
Integrates with 40+ AI frameworks plus OpenTelemetry for Ruby and Java.
Trusted by Netflix, Uber, and Autodesk with 150,000+ reported users.
Free Cloud data retention is limited to 60 days.
Ollie coding harness and Opik Connect require paid tokens after the free trial.
Enterprise compliance features like SSO and HIPAA are not on lower tiers.
Does Comet have a free plan?
Yes. Comet offers multiple free options for Opik. You can download and self-host the open-source version at no cost, or use the Free Cloud plan at $0 with up to 10 team members, 25,000 spans per month, and 60-day data retention. No credit card is required to sign up.
How much does Comet Opik Pro cost?
Comet Opik Pro Cloud costs $19 per month. It supports up to 50 team members, 100,000 spans per month, and 60-day data retention. Additional spans cost $5 per 100,000 spans, and extended retention costs $29 per 100,000 spans.
What is the difference between Comet, Opik, and MLOps?
Comet is the company name. Opik is its GenAI observability and evaluation platform for LLM applications and agents. MLOps is Comet's separate product family for machine learning experiment tracking, dataset management, and model production monitoring. Both run on the same underlying platform.
Can I self-host Opik?
Yes. Opik is open source. Comet publishes the code on GitHub and you can download, install, and run it locally or on your own infrastructure. The self-hosted version includes the full AI observability and agent testing feature set.
What AI frameworks does Opik integrate with?
Opik integrates with more than 40 AI frameworks, model providers, and gateways, including LangChain, OpenAI, Google ADK, LangGraph, and CrewAI. It also provides native OpenTelemetry support for tracing applications in Ruby, Java, and other languages.
Is Comet SOC 2 compliant?
Yes. Comet Enterprise plans include SOC 2, ISO 27001, ISO 9001, HIPAA, and GDPR compliance. Enterprise customers also get flexible deployments, single sign-on, dedicated support with SLAs, and service accounts. Security reports are available through Comet's trust center.
Does Comet offer a free plan for academics?
Yes. Comet offers a free Pro plan for academic users including researchers, students, and educators. After signing up, you can verify academic status through Comet's Academics page to unlock full Pro features at no cost.

