• Documentation
    • About ​ValidMind
    • Get Started
    • Guides
    • Support
    • Releases

    • ValidMind Library
    • Python API
    • Public REST API

    • Training Courses
  • Log In
  1. Add support for the DeepEval dataset in LLM tests
  • All releases

  • Current releases
  • Feature highlights
  • ValidMind Platform releases
  • ValidMind Library releases
  • Documentation updates

  • Breaking changes and deprecations

  • Older releases
  • April 24, 2025
  • March 7, 2025
  • January 31, 2025
  • 2024 Releases
    • December 24, 2024
    • December 6, 2024
    • October 22, 2024
    • September 25, 2024
    • September 9, 2024
    • August 13, 2024
    • July 22, 2024
    • June 10, 2024
    • May 22, 2024
    • March 27, 2024
    • February 14, 2024
    • January 26, 2024
    • January 18, 2024
  • 2023 Releases
    • December 13, 2023
    • November 9, 2023
    • October 25, 2023
    • September 27, 2023
    • August 15, 2023
    • July 24, 2023
    • June 22, 2023
    • May 30, 2023

Add support for the DeepEval dataset in LLM tests

validmind-library
2.9.5
documentation
enhancement
highlight
Published

October 7, 2025

This update enhances the integration between DeepEval and the ValidMind library by adding support for a new dataset type specific to large language models (LLMs). You can now use various LLM tests from the DeepEval library. We have introduced new row-level metrics that return arrays.

These metrics can be used in the assign_scores interface and stored in memory by the virtual machine (VM) dataset object. This enables you to use them in generalized plots and statistical functions, aiding in the documentation and interpretation of test results.

DeepEval Integration with ValidMind

Intro to Assign Scores

  • ValidMind Logo
    ©
    Copyright 2026 ValidMind Inc.
    All Rights Reserved.
    Cookie preferences
    Legal
  • Get started
    • Model development
    • Model validation
    • Setup & admin
  • Guides
    • Access
    • Configuration
    • Model inventory
    • Model documentation
    • Model validation
    • Workflows
    • Reporting
    • Monitoring
    • Attestation
  • Library
    • For developers
    • For validators
    • Code samples
    • Python API
    • Public REST API
  • Training
    • Learning paths
    • Courses
    • Videos
  • Support
    • Troubleshooting
    • FAQ
    • Get help
  • Community
    • GitHub
    • LinkedIn
    • Events
    • Blog
  • Edit this page
  • Report an issue