LLM Observability & Evaluation AI Tools

Open-source workspace where domain experts and engineers build test sets for AI agents together.

Testing and monitoring platform for AI agents, catching hallucinations before and after they ship.

A control plane that lets engineering teams deploy, monitor, and govern AI agents in production across any model or framework.

Simulates user scenarios against LLM agents, scores the answers and traces every step in production

Runs simulations across thousands of agent configurations to tune prompts, tools, and policies against a custom reward metric.

Tracing, analytics and prompt versioning for LLM apps, with a self-hostable community edition.

Simulation-driven testing, evaluation, and guardrails platform for AI agents before and after production.

Simulation, monitoring and human review platform for testing and evaluating voice and chat AI agents before and after launch.

Enterprise control plane for AI: guardrails, observability and governance for LLM agents and ML models

Open-source platform from Comet for tracing, testing and monitoring LLM applications and agents, self-hosted or in the cloud.

Open-source Python toolkit that scores RAG and agent apps with LLM-based metrics and generates synthetic test sets.

Open-source tracing and eval layer that turns production agent failures into signals your coding agent can fix and verify.