P
Promptfoo
www.promptfoo.dev
Promptfoo is an AI security and testing platform for evaluating LLM applications, agents, models, and workflows. It helps developers and security teams find vulnerabilities, validate guardrails, map findings to security frameworks, and track remediation through development and deployment.
M
MCPJam is a testing and evaluation platform for MCP servers. It helps developers inspect servers locally, run user and model-based tests, and add behavior checks to CI/CD workflows.
F
FetchSandbox
fetchsandbox.com
FetchSandboxは、AIコーディング環境内でAPI連携、webhook、状態を保持するワークフローをテストできる開発者向けツールです。実際のAPIキーや本番環境の利用枠を使わずに、開発者やエージェントのワークフローで連携を検証できます。
T
Text2Testは、デザイン、コード、チケット、仕様書から構造化されたテストケースを生成し、Webテスト自動化ワークフローでテスト計画として実行できるAIネイティブなソフトウェアテストプラットフォームです。
Q
QAgent is an AI agent testing and quality assurance platform for developers and agile teams. It connects to an agent through a webhook or endpoint, runs automated test cases, and evaluates responses for groundedness, policy adherence, prompt compliance, and related quality dimensions.
D
DeepEval is an open-source LLM evaluation framework for testing and benchmarking AI applications. It helps developers run pytest-native evaluations, score outputs and agent traces, and iterate on systems across text, image, audio, and voice workflows.