Worth a look for ML engineers who want open-source evals and drift checks; the hosted platform's price isn't published.

Kenning's take

What it does

Evidently is an open-source Python framework that evaluates and monitors AI systems, from chatbots and RAG apps to agents and classic machine learning models. It checks for problems such as hallucinations, data leaks, jailbreaks and data drift, generates synthetic test inputs, and produces shareable reports. The company also offers a hosted platform for continuous monitoring.

  • LLM and agent evaluations
  • Synthetic and adversarial test data
  • Continuous monitoring
  • Data drift detection for ML models
  • Open source under Apache 2.0

Who it suits. AI and machine learning engineers who need to test and monitor model quality.

Key facts

Made by
Evidently AI
How to get it
Install the open-source library from GitHub or PyPI; hosted platform via sign-up or sales
Works on
Python, web (hosted platform)
Free plan
open-source library, Apache 2.0

FAQ

Is Evidently AI free?

The core framework is free and open source under Apache 2.0. Hosted platform prices are not published.

What does Evidently AI test?

LLM apps, RAG systems, AI agents and ML models, for issues like hallucinations, data leaks, jailbreaks and data drift.

Facts from the maker's own pages and the sources listed. Checked 2026-10-11.