P
Promptfoo
www.promptfoo.dev
Promptfoo is an AI security and testing platform for evaluating LLM applications, agents, models, and workflows. It helps developers and security teams find vulnerabilities, validate guardrails, map findings to security frameworks, and track remediation through development and deployment.
M
MCPJam is a testing and evaluation platform for MCP servers. It helps developers inspect servers locally, run user and model-based tests, and add behavior checks to CI/CD workflows.
F
FetchSandbox
fetchsandbox.com
FetchSandbox is a developer tool for testing API integrations, webhooks, and stateful workflows inside AI coding environments. It helps developers and agent workflows validate integrations without real API keys or using up production quota.
T
Text2Test is an AI-native software testing platform that generates structured test cases from designs, code, tickets, and specs, then runs them as plans in web test automation workflows.
Q
QAgent is an AI agent testing and quality assurance platform for developers and agile teams. It connects to an agent through a webhook or endpoint, runs automated test cases, and evaluates responses for groundedness, policy adherence, prompt compliance, and related quality dimensions.
D
DeepEval is an open-source LLM evaluation framework for testing and benchmarking AI applications. It helps developers run pytest-native evaluations, score outputs and agent traces, and iterate on systems across text, image, audio, and voice workflows.