TAG COLLECTION

LLM Evaluation collection

Explore providers, articles, and companies related to LLM Evaluation for practical research and comparison.

5 Providers 0 Articles 0 Companies

Providers

5 results

Braintrust

United States

Braintrust provides evaluation datasets and scoring functions for 1 automated regression check per prompt change, side-by-side experiments, production log feedback loops and SDK wiring in a few lines; free-tier caps, DIY scoring design and scarce Chinese practice are the gaps.

Arize

United States

Arize covers ML and LLM observability in 1 platform for drift monitoring and generation quality, shipping open source Phoenix for local embedding and retrieval analysis with RAG evaluation across 2 metric dimensions and traffic replay root cause tracing; the learning curve and paid advanced tiers are the gaps.

Comet

Israel

Comet records parameters, metrics and artefacts for comparison in 1 dashboard, auto-logging frameworks with 2 lines of code, with model registry, version tracing and visual diffs across 2 deployment forms of cloud and private; free-tier caps, log capacity and limited Chinese support are the gaps.

Opik

Israel

Opik traces LLM call chains so every tool and model call in 1 conversation is visible, running prompt regression evaluations over datasets with several automated metrics across 2 forms of self-hosting and cloud; spot checks, storage planning and maturing Chinese metrics are the gaps.

Humanloop

United Kingdom

Humanloop centralises prompt management with versioning and gradual rollout in 1 place, adding human evaluation queues and A/B tests across 2 live versions, production call logging plus compliance auditing; high pricing, limited Chinese support and DIY metrics are the gaps.

Related tags