P
Promptfoo
www.promptfoo.dev
Promptfoo is an AI security and testing platform for evaluating LLM applications, agents, models, and workflows. It helps developers and security teams find vulnerabilities, validate guardrails, map findings to security frameworks, and track remediation through development and deployment.
M
MCPJam is a testing and evaluation platform for MCP servers. It helps developers inspect servers locally, run user and model-based tests, and add behavior checks to CI/CD workflows.
Q
QAgent is an AI agent testing and quality assurance platform for developers and agile teams. It connects to an agent through a webhook or endpoint, runs automated test cases, and evaluates responses for groundedness, policy adherence, prompt compliance, and related quality dimensions.
D
DeepEval is an open-source LLM evaluation framework for testing and benchmarking AI applications. It helps developers run pytest-native evaluations, score outputs and agent traces, and iterate on systems across text, image, audio, and voice workflows.
T
Record application flows, add checks and run end-to-end tests. Testim combines AI-assisted element locators with visual test editing and team workflows for web, mobile and Salesforce testing.
R
Replay QA is an agentic web application testing platform with an automated Security Scan for penetration testing. It explores live apps, tests authenticated journeys, captures runtime evidence, and produces reports that teams can use to remediate security and other software defects.