01
LangFuse
Open source agent evals and observability platform
Langfuse is an open-source AI engineering platform for observability and evaluation. It enables teams to trace, evaluate, and improve AI agents with one integrated system.
92.0
Self-hosted LLM observability tools
10 ranked, with a plain verdict on every entry.
LangFuse ranks first here for AI engineering teams building production-grade LLM applications. Morph is built for Teams building production coding agents, and serves top models at high speeds tailored for agent workflows. Manifest serves AI builders, and autofixes bad requests on the fly to ensure zero downtime.
RANKENTRYSCORETRENDFROM
1
LangFuseThe AI tool captures hierarchical traces of every LLM call and supports multiple evaluation methods92.0NEW–
10
PromptLayerThe AI tool allows non-technical domain experts to edit prompts directly without code82.0NEW–
CURATED · UPDATED REGULARLY
The ranking, in detail
02
Morph
Inference built for agents with specialised coding tools.
Morph provides inference infrastructure built specifically for AI agents.
92.0
03
Manifest
The open source LLM gateway for AI agents with autofix
Manifest is an open source LLM Gateway that helps builders and teams create reliable agents and workflows. It enables users to manage their inference consumption effectively.
90.0
04
Shakudo
Sovereign AI for critical business operations
Shakudo provides a sovereign AI operating system for critical enterprise infrastructure.
90.0
05
Entelligence AI
Optimise AI engineering for quality and measurable outcomes
Entelligence AI is a cost and quality optimisation engine for engineering agents. It provides unified memory and model routing to improve efficiency.
88.0
06
Fiddler AI
Model monitoring and explainability platform for compliance
Fiddler AI provides a control plane for enterprise agents. It ensures trust through observability and governance.
88.0
07
axem
Sovereign AI platform
Axem is an open-source sovereign AI platform. It allows users to run LLMs and agents entirely in-house on controlled infrastructure.
84.0
08
Iterate.ai
Private by design, scalable AI for the enterprise
Iterate.ai is an enterprise AI application platform designed for private, secure deployment. It enables organisations to build and govern agentic systems without vendor lock-in.
84.0
09
MLflow AI Platform
Deliver high-quality AI, fast
MLflow AI Platform is the leading open source AI engineering platform. It enables teams to debug, evaluate, and monitor LLM applications and models.
82.0
10
PromptLayer
The collaboration layer for AI engineering teams
PromptLayer is an AI engineering platform combining a prompt registry with evaluations and observability. It enables teams to version, test, deploy, and monitor prompts effectively.
82.0
Not on this ranking?
Positions 1, 2 and 3 are available to buy for twelve months.
Frequently asked questions
What do the top four say they are built for?
LangFuse says it is built for AI engineering teams building production-grade LLM applications, and Morph for Teams building production coding agents. Manifest says it is built for AI builders, and Shakudo for enterprises requiring strict data sovereignty and security.