Worth a look for ML engineers who want open-source evals and drift checks; the hosted platform's price isn't published.
Kenning's take
What it does
Evidently is an open-source Python framework that evaluates and monitors AI systems, from chatbots and RAG apps to agents and classic machine learning models. It checks for problems such as hallucinations, data leaks, jailbreaks and data drift, generates synthetic test inputs, and produces shareable reports. The company also offers a hosted platform for continuous monitoring.
- LLM and agent evaluations
- Synthetic and adversarial test data
- Continuous monitoring
- Data drift detection for ML models
- Open source under Apache 2.0
Who it suits. AI and machine learning engineers who need to test and monitor model quality.
Key facts
- Category
- Developer tools
- Made by
- Evidently AI
- How to get it
- Install the open-source library from GitHub or PyPI; hosted platform via sign-up or sales
- Works on
- Python, web (hosted platform)
- Free plan
- open-source library, Apache 2.0
FAQ
Is Evidently AI free?
The core framework is free and open source under Apache 2.0. Hosted platform prices are not published.
What does Evidently AI test?
LLM apps, RAG systems, AI agents and ML models, for issues like hallucinations, data leaks, jailbreaks and data drift.
Facts from the maker's own pages and the sources listed. Checked 2026-10-11.
Similar tools

Claude Keychain
A free Mac menu bar app that keeps API keys in the macOS Keychain so Claude Code can use them without seeing them.
OpenAI Agent Builder
OpenAI's visual canvas for building multi-agent workflows, being withdrawn on 30 November 2026.
ElevenLabs Agent Workflows
Visual editor in ElevenLabs' agent platform for designing branching conversation flows for voice and chat agents.

AgentOps
Monitoring and debugging platform that records what AI agents do, what they cost and where they fail.