ValidMind Library releases

Latest: v2.12.1

Published

March 2, 2026

Optional document parameter in init()

validmind-library

2.12.1

enhancement

init() now supports an optional document parameter to specify which document you want to connect the library to. The document slug is the value in your URL path after /docume…

Library version sent in request headers

validmind-library

2.12.1

enhancement

The library now sends its version in the X-LIBRARY-VERSION header when connecting to the ValidMind Platform. This enables better version tracking and compatibility checks.

Scorers now visible in list_tests

validmind-library

2.11.3

enhancement

Scorer metrics are now included in the list_tests function output. You can view all available scorers alongside other tests for better visibility when exploring available…

New notebook for documenting agentic AI systems

validmind-library

2.11.3

documentation

enhancement

A new notebook shows you how to build and document an agentic AI system with the ValidMind Library. You construct a LangGraph-based banking agent that selects and invokes…

Fixed plotly figure rendering

validmind-library

2.11.3

bug

support

Plotly figures generated by plotly 6.x now render correctly in the UI. The library now requires plotly>=6.0.0 to ensure compatibility with the updated frontend.

Add agentic metrics from DeepEval as scorers

validmind-library

2.11.1

enhancement

Four new agentic evaluation metrics from DeepEval are now available to assess your LLM agents:

Expose `log_test_result` function in API client

validmind-library

2.11.1

enhancement

You can now use the log_test_result function within the API client to log test result dictionaries directly and synchronously to the API.

GEval evaluation metrics support

validmind-library

2.11.0

enhancement

ValidMind now supports GEval LLM evaluation metrics from DeepEval, allowing you to define custom criteria for evaluations that are logged directly in your documentation via…

Upgrade to HTML-based widgets for improved rendering

validmind-library

2.11.0

enhancement

We've upgraded ValidMind's rendering engine to a new HTML-based system, ensuring interactive components are preserved when notebooks are saved.

Add new `deepeval` tests in library

validmind-library

2.10.0

enhancement

This update enhances the integration between ValidMind and DeepEval by introducing primary scorers within a dedicated deepeval namespace. You can now evaluate large language…

Add support for the DeepEval dataset in LLM tests

validmind-library

2.9.5

documentation

enhancement

highlight

This update enhances the integration between DeepEval and the ValidMind library by adding support for a new dataset type specific to large language models (LLMs). You can…

Removed legacy notebooks

validmind-library

2.9.5

documentation

enhancement

This update removes multiple legacy agent demo notebooks and associated code samples that were previously used to demonstrate the integration of LangChain, LangGraph, and…

Enable custom test description output structure

validmind-library

2.9.5

enhancement

deprecation

This update offers enhanced customization for LLM-generated test descriptions in the ValidMind Library. You can now manage test descriptions using a new context parameter in …

Support Python 3.12 and optimize dependencies in ValidMind Library

validmind-library

2.9.3

enhancement

This update introduces support for Python 3.12 in the ValidMind Library. We've optimized dependency management to make the core library lighter and ensure easy installation…

Enable PII detection in tests with new notebook

validmind-library

2.9.3

documentation

enhancement

deprecation

Learn how to enable and configure Personally Identifiable Information (PII) detection when running tests with the ValidMind Library using the new enable_pii_detection.ipynb n…

Enhance `list_tests()` to show artifact types in output

validmind-library

2.8.29

enhancement

We have enhanced the list_tests() function to include additional columns in its output. These columns now display the types of artifacts each test in the ValidMind Library…

Enhance `predict_fn` in `init_model` to support multiple output columns

validmind-library

2.8.29

documentation

This update enhances the predict_fn callable function parameter in init_model to support multiple output columns. You can now return either a single value or a dictionary…

Add section to inject custom context via docstring

validmind-library

2.8.26

documentation

enhancement

This update enhances the Jupyter notebook add_context_to_llm_descriptions.ipynb by introducing a new section. This section guides you on embedding explicit instructions…

Interfaces to support code explainer feature in ValidMind

validmind-library

2.8.26

documentation

enhancement

highlight

This update introduces an experimental feature for text generation tasks within the ValidMind project. It includes interfaces to utilize the code_explainer LLM feature…

Support qualitative text generation in `run_task` function

validmind-library

2.8.26

enhancement

This update enhances the run_task function in the validmind/experimental/agents.py file to support a new task type. You can now generate qualitative text for a specific…

Update quickstart for model documentation in Jupyter notebooks

validmind-library

2.8.26

enhancement

We've improved our Jupyter notebooks to make the model documentation quickstart guide more user-friendly and informative for beginners. A new "quickstart" directory has been…

Add demo notebook for code explainer

validmind-library

2.8.26

enhancement

highlight

This update introduces a comprehensive script and Jupyter notebook for documenting and explaining a customer churn prediction model using the ValidMind library.

Add status flags to ongoing monitoring tests in ValidMind Library

validmind-library

2.8.26

enhancement

This update enhances the log_metric and alog_metric functions in the ValidMind Library by adding visual status indicators for monitoring metrics. You can now use the passed p…

Quickstart guide for model validation with ValidMind Library

validmind-library

2.8.26

highlight

Get started with model validation using the ValidMind Library with our new quickstart guide:

Update registration and login info in docs site and notebooks

validmind-library

2.8.26

This update standardizes the alert messages displayed across various notebooks by updating the text and some CSS styling details in the HTML blocks.

Support customizable judge LLM and embeddings in ValidMind tests

validmind-library

2.8.26

enhancement

This update enhances your experience by allowing you to use your own LLM. All existing tests that use an LLM now support a user-defined LLM or Embedding model, provided it…

Fix pandas DataFrame dtype preservation in VMDataset initialization

validmind-library

2.8.22

bug

enhancement

You can now reduce memory usage when initializing VMDataset objects with vm.init_dataset(). We've introduced a copy_data option that lets you avoid copying the input…

Add RAG benchmarking demo notebook

validmind-library

2.8.20

documentation

enhancement

We have introduced a comprehensive notebook, rag_benchmarking_demo.ipynb, to help you benchmark Retrieval-Augmented Generation (RAG) models using the ValidMind library. This…

New notebook series for model validation with ValidMind

validmind-library

2.8.20

documentation

highlight

Explore our new series of introductory notebooks designed for model validation with ValidMind. These notebooks guide you through the entire process, tailored to common…

Add text support for custom test descriptions

validmind-library

2.8.20

documentation

enhancement

highlight

We have enhanced the custom test framework, allowing you to define custom descriptions for your tests. If a test returns a string, it will be used as the test description…

New Jupyter notebook for validating an application scorecard model

validmind-library

2.8.17

documentation

enhancement

Discover how to independently assess an application scorecard model with our new Jupyter notebook, Validate an application scorecard model. You can use ValidMind to evaluate…

Expose log text interface for qualitative text sections

validmind-library

2.8.17

documentation

enhancement

highlight

You can now log free-form text content in the ValidMind Library to enhance your model documentation. This update introduces the log_text function, allowing you to easily…