LLM and agent tracing
Capture hierarchical traces for LLM calls, tool invocations, retrieval steps, and other application logic. Filter and inspect traces by user, session, cost, latency, or custom metadata.
Langfuse
Freemium
Langfuse is an open-source AI platform for tracing, evaluating, and improving LLM applications and agents with observability, prompts, experiments, and human review.
What is Langfuse?
Langfuse is an open-source AI platform for tracing, evaluating, and improving LLM applications and agents with observability, prompts, experiments, and human review.
The platform is built around OpenTelemetry-compatible tracing, native SDKs, and broad integrations, which lets teams capture LLM and non-LLM activity without locking into a single framework. Langfuse also supports cloud deployment and self-hosting, with the product and core features available under an MIT license.
What can Langfuse do?
Sessions, users, and agent graphs
Track multi-turn conversations as sessions and add user tracking for production debugging and usage analysis. Agents can also be represented as graphs for more complex workflows.
Prompt management workflow
Manage prompts separately from application code with versioning, deployments by label, rollbacks, prompt caching, and playground testing. Prompt history and change tracking help teams review how prompts evolve.
Evaluation and human review
Run evaluations with LLM-as-a-judge, heuristic functions, or human review on production data or experiments. Support for datasets, experiments, evaluation scores, and human annotation helps compare changes over time.
Operational metrics and alerts
Monitor quality, cost, and latency through dashboards, alerts, and trace-linked metrics. This makes it easier to understand the impact of prompt or model changes on production behavior.
Open integrations and deployment options
Connect through native SDKs, OpenTelemetry, proxy-based logging, APIs, exports, and more than 100 integrations. The platform also supports self-hosting and data portability.
Use Cases
“Production observability”
Instrument production LLM applications to inspect traces, sessions, and user-level behavior when debugging latency, cost spikes, or unexpected outputs.
“Prompt iteration”
Manage prompts as versioned assets, deploy them by label, roll back changes, and compare prompt variants in the playground before shipping updates.
“Evaluation workflows”
Run offline or online evaluations on datasets, then compare experiments with LLM-as-a-judge, heuristics, or human review to assess quality changes.
“Human-in-the-loop review”
Create human annotation queues and review traces to build golden datasets or validate model behavior with collaborators.
“End-to-end LLM development”
Use the same platform across prototypes and production systems to connect instrumentation, experimentation, and iteration in one workflow.
Frequently Asked Questions
What problem does Langfuse solve?
Langfuse is built for teams that want to trace LLM and agent workflows, manage prompts, and evaluate outputs in one system. It supports tracing, prompt management, evaluation, experiments, and human annotation.
How do teams integrate Langfuse?
The source highlights native SDKs for Python and JavaScript, OpenTelemetry support, 100+ integrations, and options to capture traces through an LLM gateway such as LiteLLM. The product is designed to work with existing stacks rather than require a single framework.
What can teams do after data is collected?
Langfuse supports traces, sessions, user tracking, prompt versioning, prompt deployments, playground testing, experiments, evaluation scores, datasets, and human review workflows. The docs describe it as a connected workflow from prototype to production.
Does Langfuse offer both cloud and self-hosted deployment?
The pricing page shows a free Hobby plan, paid Cloud plans, and a self-hosted option. It also lists managed-cloud plans with longer retention, higher limits, and enterprise features such as SSO, SCIM, audit logs, and support options.
Who is Langfuse best suited for?
The product is designed for LLM applications and agents. The documentation emphasizes tracing LLM and non-LLM calls, production debugging, prompt iteration, evaluation, and quality, cost, and latency monitoring.
Quick Facts
- Category
- AI engineering platform
- Primary use
- LLM observability, prompt management, and evaluation
- Deployment
- Cloud or self-hosted
- License
- MIT for core product features
- Integrations
- 100+ integrations plus OpenTelemetry support
- Pricing
- Free Hobby plan plus paid cloud plans and self-hosted option
Langfuse Traffic Analysis
Traffic data is for reference only.
- Domain Rating
- 80
Langfuse Alternatives
Evidently AI
evidentlyai.com
Open-source framework for evaluating and monitoring LLM applications, AI agents, and ML models.
Adaline
adaline.ai
Observability and evaluation tools for teams improving AI agents from production data.
OpenSearch
opensearch.org
OpenSearch is a community-driven, Apache 2.0-licensed open source search and analytics suite for ingesting, searching, visualizing, and analyzing data. It supports application search, observability, security analytics, and machine learning workflows.
Agnost AI
agnost.ai
Agnost AI monitors AI agents in production by analyzing conversations, traces, user corrections, and frustration. It helps teams identify recurring failures, review suggested prompt fixes, and apply approved changes with replay-based regression coverage.
New Relic
newrelic.com
New Relic is an AI-powered observability platform that connects telemetry across applications, infrastructure, logs, digital experiences, and AI systems to help teams find root causes, understand business impact, and get started with a free tier or usage-based plans.
Raindrop
raindrop.ai
AI agent observability for tracing runs, detecting recurring failures, and testing changes before release.