Promptfoo
Proactively identify and fix vulnerabilities in your AI applications
Promptfoo is an open-source AI security platform. It helps developers identify and fix vulnerabilities in their applications.
| Best for | AI developers and security teams |
| Website | promptfoo.dev |
Company facts
| Social profiles |
Facilities and features
- Published pricing
- API
- Integrations
What stands out
The AI tool provides automated red teaming for agents and RAGs.
“Comprehensive security testing and monitoring for AI models MCP Proxy”Promptfoo, own website
The AI tool integrates seamlessly into CI/CD pipelines.
“Secure proxy for Model Context Protocol communications Code Scanning”Promptfoo, own website
Strengths and trade-offs
- The AI tool provides automated red teaming for agents and RAGs.
- The AI tool integrates seamlessly into CI/CD pipelines.
Appears in
How Promptfoo ranks
#4 in Best LLM evaluation tools
How the score is made up: Evidence on its own site 20; How complete its published information is 16; Fit to this ranking's criteria 40; Buying information on its own site 12.
“Evaluations Test and evaluate your prompts, models, and RAG pipelines”Promptfoo, own website
Alternatives to Promptfoo
 GiskardContinuous red teaming for secure LLM agents | #1 in Best LLM evaluation tools | 96.0 |
 Arize AIML observability and fairness monitoring platform | #2 in Best LLM evaluation tools | 88.0 |
 Fiddler AIModel monitoring and explainability platform for compliance | #3 in Best LLM evaluation tools | 88.0 |
 AthinaShip AI to prod 10x faster | #5 in Best LLM evaluation tools | 86.0 |
 Kiln AIThe AI workbench for teams | #6 in Best LLM evaluation tools | 82.0 |
 MLflow AI PlatformDeliver high-quality AI, fast | #7 in Best LLM evaluation tools | 82.0 |
Questions about Promptfoo
Who is Promptfoo best for?
Promptfoo is best for AI developers and security teams.
Where does Promptfoo rank?
Promptfoo is ranked #4 in Best LLM evaluation tools (Lister Score 88.0).
What are the best alternatives to Promptfoo?
The closest alternatives on Lister are Giskard (#1 in Best LLM evaluation tools), Arize AI (#2 in Best LLM evaluation tools) and Fiddler AI (#3 in Best LLM evaluation tools).
Is this your company?
Claim Promptfoo to suggest corrections to its listing (pricing, features, details) or ask about an enhanced profile. We review every claim before anything changes.