AI Observability

W

Weights & Biases

LLM Evaluation

Machine learning and AI platform for experiment tracking, artifacts, GenAI tracing, and evaluations.

I

Ito

AI Observability

Ito is an automated QA product that audits pull requests with code-aware agents, helping fast-moving engineering teams catch regressions and usability issues without maintaining manual test scripts.

W

Waydev

AI Observability

Engineering intelligence to measure AI adoption, impact, and ROI

J

Jungle AI

AI Observability

AI platform for machine monitoring and predictive maintenance, with Canopy for wind and solar assets.

P

Privent

AI Code Assistant

Privent is a runtime security layer for agentic AI, especially n8n workflows. It masks sensitive data before external models see it, logs risk decisions, and monitors organization-wide use of ChatGPT, Claude, and Gemini.

A

AgentQuartz

AI Observability

AgentQuartz is a macOS menu bar companion for monitoring Claude and Cursor usage. It keeps usage status on your machine and offers a free tier plus a one-time Pro license for tray customization.

N

New Relic

AI Observability

AI-powered observability across apps, infrastructure, logs, digital experiences, and AI systems.

L

LangChain

AI Code Assistant

LangSmith is LangChain’s platform for observing, evaluating, and deploying AI agents.

D

Dynatrace

AI Observability

AI-powered observability for applications, infrastructure, security, and digital experiences

P

Pydantic

AI Observability

An AI engineering stack for type-safe apps, observability, evaluation, and model routing

K

Kong AI Gateway

AI Observability

Kong AI Gateway centralizes governance for LLM, MCP, and agent-to-agent traffic, helping platform and AI teams secure, observe, route, and control costs for production AI workloads.

L

Langfuse

AI Observability

Langfuse is an open-source AI platform for tracing, evaluating, and improving LLM applications and agents with observability, prompts, experiments, and human review.

B

Braintrust

AI Developer Tools

Braintrust is an AI observability platform for tracing production AI behavior, running evaluations, and catching regressions before they reach users. It supports teams building and operating AI products with traces, datasets, scoring, and workflow tools.

L

LogicMonitor

AI DevOps Assistant

AI-first observability for hybrid infrastructure, cloud, logs, and service health

R

Rootly

AI DevOps Assistant

AI-native incident management for engineering teams

P

Portkey

AI Gateway And Routing

Production AI platform with gateway, observability, guardrails, and prompt management for Gen AI teams.

H

Helicone

AI Developer Tools

AI gateway and LLM observability platform for routing, debugging, analysis, and management

S

Salt Security

AI Code Assistant

Agentic AI and API security for discovering, managing, and protecting AI agents, MCP servers, and APIs

M

Middleware

AI Observability

Full-stack observability for logs, metrics, traces, apps, infrastructure, and user experience, with OpsAI for AI-powered issue detection and remediation.

L

Luciq

AI Marketing Analytics

Agentic AI for mobile observability and app experience management