AI Orchestration and MLOps · Founded by Ian W.

Promptfoo

Open-source CLI and security platform for testing, evaluating, and red-teaming LLM prompts, RAG pipelines, and AI agents.

Cost

Free Trial

Rating

★ People love it

Time to value

Quick Setup (< 1 hour)

You can use Promptfoo to test AI applications and catch security vulnerabilities during development. It runs automated red team attacks against your AI apps, agents, and workflows to find prompt injections, jailbreaks, data leaks, and other security issues. The tool integrates with CI/CD pipelines and provides remediation guidance directly in pull requests to help developers fix problems before they reach production.

What Promptfoo does

Generate thousands of context-aware security attacksScan AI applications for prompt injection vulnerabilitiesTest agent tool use for security violationsMonitor RAG systems for data leakageIntegrate security testing into CI/CD workflowsCreate custom attack scenarios for specific applicationsTrack security fixes across development teamsGenerate security reports for compliance requirementsAutomated red team attacks for AI applicationsCustom attack generation for specific targetsReal-time threat intelligence from 300k+ usersCI/CD pipeline integration for continuous testingRemediation guidance directly in pull requestsTests 50+ vulnerability types including prompt injectionContext-aware attacks tailored to business logicAgent and RAG workflow testing capabilities