LangSmith is LangChain's LLM observability platform with tree-shaped tracing, datasets and evaluators plus prompt versioning, integrating natively with LangChain and LangGraph from 1 environment variable across managed and self-hosted shapes; ecosystem coupling and free-tier trace limits are the gaps.
TAG COLLECTION
LLM Observability collection
Explore providers, articles, and companies related to LLM Observability for practical research and comparison.
Providers
Langfuse delivers open source LLM observability self-hosted with 1 Docker Compose stack that keeps data in-house, modelling telemetry in 3 layers of trace, session and score with prompt versioning and OpenTelemetry compatibility across 5 or more frameworks; self-hosting upkeep and thin Chinese material are the gaps.
PromptLayer offers visual prompt editing with versioning where 1 save creates traceable history, logs prompt, response and latency per request and supports 2-version A/B comparison through SDK or proxy integration; the gaps are platform scale and observability depth.