Promptfoo
Proactively identify and fix vulnerabilities in your AI applications
Ranked #4 in Best LLM evaluation tools.
Promptfoo is an open-source AI security platform. It helps developers identify and fix vulnerabilities in their applications.
At a glance
| Best for | AI developers and security teams |
From Promptfoo's own website.
Company facts
| Social profiles |
Facilities and features
Its website also mentions:
- Published pricing
- API
- Integrations
What stands out
The AI tool provides automated red teaming for agents and RAGs.
“Comprehensive security testing and monitoring for AI models MCP Proxy”Promptfoo, own website
The AI tool integrates seamlessly into CI/CD pipelines.
“Secure proxy for Model Context Protocol communications Code Scanning”Promptfoo, own website
How it ranks
Promptfoo is ranked 4th of 10 in Best LLM evaluation tools (Lister Score 88.0).
#4 in Best LLM evaluation tools · Lister Score 88.0
Built for AI developers and security teams.
How the score is made up: fit to this ranking's criteria 40; evidence on its own site 20; how complete its published information is 16; buying information on its own site 12.
“Evaluations Test and evaluate your prompts, models, and RAG pipelines”Promptfoo, own website
| Rank | Best LLM evaluation tools | Score |
|---|---|---|
| 1 | Giskard | 96.0 |
| 2 | Arize AI | 88.0 |
| 3 | Fiddler AI | 88.0 |
| 4 | Promptfoo | 88.0 |
| 5 | Athina | 86.0 |
| 6 | Kiln AI | 82.0 |
| 7 | MLflow AI Platform | 82.0 |
| 8 | PromptLayer | 82.0 |
| 9 | Babelscape | 80.0 |
| 10 | TruLens | 78.0 |
Frequently asked questions
How does Promptfoo rank on Lister?
Promptfoo is ranked 4th of 10 in Best LLM evaluation tools (Lister Score 88.0).