Review model documentation

Use the ValidMind Platform to review the model documentation provided by a model developer as part of the formal validation process.

Prerequisites

• You are logged in to ValidMind.
• A model developer has submitted model documentation for review.¹
• You are a Validator or assigned another role with sufficient permissions to perform the tasks in this guide.²

¹ Submit for approval

² Manage permissions

Key concepts

review

Entails a comprehensive evaluation process covering four key aspects of model documentation to ensure thoroughness, compliance, and reliability:

• Conceptual soundness — Examines the foundational elements of the model, including its overview, intended business use, regulatory requirements, and limitations. Ensures that the model’s purpose, scope, and constraints are well-defined and understood by stakeholders.

• Data preparation — Assesses the quality and preparation of the data used for model training. Includes a detailed look at dataset summaries, data quality tests, descriptive statistics, correlations, interactions, and feature engineering. The aim is to verify that the model is built on a robust and relevant dataset.

• Model development — Focuses on the model’s development process, including training, evaluation, explainability, interpretability, and diagnosis. Highlights the model’s performance, identifies strengths and weaknesses, and ensures that any potential issues such as overfitting are addressed. Evaluates the assumptions made and examines the qualitative information and judgments to ensure they are conducted appropriately and systematically.

• Monitoring and governance — Evaluates the ongoing strategies for monitoring the model’s performance and ensuring compliance with regulatory and ethical standards. Involves checking the implementation of the monitoring plan and governance strategies to maintain the model’s efficacy over time. Covers reporting outputs to ensure transparency and accuracy in the model’s documented results.

These elements collectively ensure that the model documentation is thorough, transparent, and meets all necessary standards and regulatory requirements.

Document Overview

The Document Overview shows a section-by-section outline of your model’s documentation, as well as summaries of:

• Any unresolved conversations³
• The number of model findings⁴
• The completion status for your model’s documentation⁵
• Recent activity on your model⁶

³ Collaborate with others

⁴ Working with model findings

⁵ Assign section statuses

⁶ View model activity

To locate your document overview for a model:

1. In the left sidebar, click Model Inventory.

2. Select a model or find your model by applying a filter or searching for it.⁷

3. In the left sidebar that appears for your model, click Documentation.

⁷ Working with the model inventory

Unresolved conversations

Hover over # Unresolved conversations to see a preview of the unresolved conversation associated with the documentation section.

Resolve conversations directly from this popup, or click to expand the conversation.

Model findings

Hover over # Model Findings to see a preview of model findings associated with the documentation section.

Click to expand the finding.

Completion status

The #/# Done indicator reflects the completion status of your documentation sections.

Recent activity

At the bottom of the Document Overview page, you will also see quick view of any recent documentation activity.

• Use the top tabs to narrow down the recent activity.
• Click on See All Activity to be taken to the Model Activity page.

What’s next

• Collaborate with others
• Working with model findings
• Assign section statuses
• View model activity