Snorkel AI
Paid
Programmatic data labeling and expert data development for specializing AI models.
evaluation AI tools
AI tools tagged evaluation, newest first.
10 tools
Scale AI
Paid
Data labeling, evaluation and training data services for AI labs and enterprises.
Comet
Freemium
Experiment tracking and the open-source Opik platform for evaluating LLM apps.
Braintrust
Freemium
An evaluation and observability platform for teams shipping AI products.
Vellum
Paid
A platform to build, evaluate and deploy AI workflows and agents with a visual builder.
Agenta
Freemium
An open-source LLMOps platform for prompt playgrounds, evaluation and observability.
Promptfoo
Freemium
An open-source tool for testing prompts and red-teaming AI apps from the command line.
LangSmith
Freemium
LangChain's platform for debugging, testing and monitoring LLM apps and agents.
Langfuse
Freemium
Open-source observability, prompt management and evaluation for LLM applications.
PromptLayer
Freemium
A prompt management platform where teams version, test and monitor prompts without redeploying code.
