Skip to content
AI Directory AI Directory
All tools
Promptfoo logo

Promptfoo

An open-source tool for testing prompts and red-teaming AI apps from the command line.

About Promptfoo

Promptfoo lets you test prompts the way you would test code. You write a config with example inputs and expected qualities, run it across different models, and get a table showing which prompt performs best. It also includes red-teaming tools that probe your app for jailbreaks, data leaks and other risky behavior. It runs locally or in CI, so tests can block a bad change before release. Promptfoo is open source and free to use, with an enterprise offering for larger teams. It suits developers who want repeatable evaluations instead of guesswork.

Standout features

  • Prompt test suites
  • Model comparison
  • Red teaming
  • CI integration
  • Local execution
  • Open source

Tags

More in Prompt Engineering

View all →

Listed & featured on

  • Submit AI Tools
  • Featured on Altern
  • Monitor your Domain Rating with FrogDR
  • AI Directory - Featured on Startup Fame
  • Submit AI Tools
  • Featured on Altern
  • Monitor your Domain Rating with FrogDR
  • AI Directory - Featured on Startup Fame