Langfuse
Freemium
Open-source observability, prompt management and evaluation for LLM applications.
LangSmith
Freemium
LangChain's platform for debugging, testing and monitoring LLM apps and agents.
Helicone
Freemium
An open-source gateway and dashboard that logs, caches and analyzes your LLM requests.
PromptHub
Freemium
A Git-style hub to version, share and test prompts across teams and models.
Promptfoo
Freemium
An open-source tool for testing prompts and red-teaming AI apps from the command line.
Agenta
Freemium
An open-source LLMOps platform for prompt playgrounds, evaluation and observability.
Vellum
Paid
A platform to build, evaluate and deploy AI workflows and agents with a visual builder.
Hugging Face
Freemium
The main hub for open models, datasets and demos, plus tools to train and deploy them.
Weights and Biases
Freemium
Tools for tracking experiments, managing models and evaluating LLM apps.
MLflow
Free
The open-source standard for managing the machine learning lifecycle, now with GenAI tracing.
Modal
Freemium
Serverless cloud for running AI workloads, with GPUs available in seconds.
Comet
Freemium
Experiment tracking and the open-source Opik platform for evaluating LLM apps.
Help grow our directory
Found an amazing AI tool that's not listed? Add it and share your discoveries with the community.
