Finalizing
Validation Reports

Validator Fundamentals — Module 4 of 4

Click to start

Learning objectives

“As a validator who has logged validation tests with the ValidMind Library to the ValidMind Platform, I want to refine my model’s validation report, submit my validation report for approval, and track finding resolution and other updates to my model.”

This final module is part of a four-part series:

Validator Fundamentals

Module 4 — Contents

Section 1

• Refine validation report
• Manage model findings
• Submit validation report for approval

Section 2

• Collaborate with others
• Track model activity
• View analytics

First, let’s make sure you can log in to ​ValidMind.

Training is interactive — you explore ​ValidMind live. Try it!

→ , ↓ , SPACE , N — next slide     ← , ↑ , P , H — previous slide     ? — all keyboard shortcuts

Before you begin

• Prerequisite courses
• Log in

To continue, you need to have been onboarded onto ValidMind Academy with the Validator role and completed the first three modules of this course:

Module 1

Module 2

Module 3

Already logged in and refreshed this module? Click to continue.

1. Log in to check your access:

Log in to ​ValidMind

Be sure to return to this page afterwards.

2. After you successfully log in, refresh the page to connect this training module up to the ValidMind Platform:

Section 1

Refine validation report

Make qualitative edits

(Scroll down for the full instructions.)

Learn more …

Try it live on the next page.

• Add content blocks
• Edit test result descriptions

1. From the Inventory in the ValidMind Platform, go to the model you connected to earlier.

2. In the left sidebar that appears for your model, click Validation Report.

3. Click on 1. Executive Summary to expand and add content to that section.

4. Hover your mouse over the space where you want your new block to go until a horizontal dashed line with a sign appears that indicates you can insert a new block:

Adding a content block in the UI

After adding the block to your documentation, generate a content draft with AI using the content editing toolbar:

1. Click ^beta (Generate Text with AI) in the toolbar while editing a content block.

2. Enter an optional prompt to guide the output, then click Generate Content to compose a draft for review.

3. Review the draft composed by the ​ValidMind AI Content Builder for accuracy and relevance, then:

   • Click Insert to document to add the draft into your content block.
   • Or, submit a different prompt in the dialogue box and click Send to regenerate a different draft.

4. After you insert the AI-generated draft, click on the text box to make the necessary edits and adjustments to your copy, ensure that content is in compliance with the quality guidelines outlined by your organization.

Generating content with AI within a simple text block

You can also use the content editing toolbar to revise the description of test results to explain the changes made to the raw data and the reasons behind them.

For example:

1. Within your validation report, click on 2.2.1. Data Quality to expand that section and locate the linked Class Imbalance Assessment evidence.

2. Click See evidence details to review the LLM-generated description that summarizes the test results, that confirm that our final preprocessed dataset actually passes our test.

3. Edit the description for our individually inserted ClassImbalance:raw_dataset_preprocessed test:

Editor for a test result description

Add & edit content blocks

1. Select the name of your model you registered for this course to open up the model details page.
2. On the left sidebar that appears for your model, click Validation Report.
3. Click on 1. Executive Summary to add and edit a content block.
4. Click on 2.2.1. Data Quality to edit the description for the linked Class Imbalance Assessment test results.

When you’re done, click to continue.

Assess compliance

(Scroll down for the full instructions.)

Learn more …

Try it live on the next page.

• Add risk assessment notes
• Provide compliance assessments

1. From the Inventory in the ValidMind Platform, go to the model you connected to earlier.

2. In the left sidebar that appears for your model, click Validation Report.

3. Click on 2.2.1. Data Quality to expand that section and locate the Class Imbalance Assessment sub-section.

4. Click under Risk Assessment Notes to edit the content block using the content editing toolbar.

   For example, use ^beta (Generate Text with AI) to create a draft summarizing the contents of the Class Imbalance Assessment sub-section.

   Sample compliance assessment

In the same Class Imbalance Assessment sub-section, above the Risk Assessment Notes, locate the Guideline with the assessment drop-down.

Select one of the available options:

• No compliance — No tests have been run and no other evidence has been provided.
• Some compliance — Evidence provided but not properly documented or verifiable.
• Strong compliance — Evidence provided and documented, but not validated.
• Full compliance — Evidence provided, documented, and validated.

For example, to indicate that there is some compliance based on the evidence or findings you linked to:

Validation report section 2.1.1. that shows a compliance assessment with the option to link to finding

Confirm that the compliance summary shown for each subsection under 2. Validation provides an accurate overview for current qualitative and quantitative risk assessments:

Risk assessment compliance summary

Add your compliance assessments

1. Select the name of your model you registered for this course to open up the model details page.
2. On the left sidebar that appears for your model, click Validation Report.
3. Click on 2.2.1. Data Quality to assess compliance for the Class Imbalance Assessment sub-section.

When you’re done, click to continue.

Manage model findings

Add more findings

(Scroll down for the full instructions.)

Learn more …

Try it live on the next pages.

Along with adding findings directly via validation reports, you can also add findings during your review of documentation:

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.

3. In the left sidebar that appears for your model, click Documentation.

   You can now either log a finding on this overview page, or via a specific documentation section. Both methods will allow you to associate a finding with a documentation section.

• Add finding via overview
• Add finding via section

To log a finding from the documentation overview:

1. On your model’s Documentation page, click Add Finding.

2. On the Add Model Finding modal that opens, provide information for:

   • Title
   • Risk area
   • Owner
   • Severity
   • Due date
   • Documentation section
   • Description

3. When you are done, click Save to submit the finding.

   Once created, you can then add supporting documentation to your finding.

While working within a section of your documentation, you can easily log a finding associated with that section without leaving the page:

1. Click on ​ValidMind Insights™ to expand the insight panel.

2. For the section you want to add a Finding for, click Add Finding beneath the Documentation Guidelines.

3. On the Add Model Finding modal that opens, provide information for:

   • Title
   • Risk area
   • Owner
   • Severity
   • Due date
   • Documentation section
   • Description

   The documentation section will be auto-populated with the section you are working from — you are able to select another section if desired.

4. When you are done, click Save to submit the finding.

   Once created, you can then add supporting documentation to your finding.

Add a finding via overview

1. Select the name of your model you registered for this course to open up the model details page.
2. On the left sidebar that appears for your model, click Documentation.
3. Click Add Finding to add a finding from the overview.

When you’re done, click to continue.

Add a finding via section

1. Select the name of your model you registered for this course to open up the model details page.
2. On the left sidebar that appears for your model, click Documentation.
3. Click on any section heading to expand and add a finding to that section via the ​ValidMind Insights™ panel.

When you’re done, click to continue.

Track issue resolution

(Scroll down for the full instructions.)

Learn more …

Try it live on the next pages.

As you prepare your report, review open or past due findings, close resolved ones, or add a mitigation plan:

• Update a model finding
• View all model findings

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.

3. In the left sidebar that appears for your model, click Model Findings.

4. Go through the open findings one-by-one:

   • If the finding has been addressed:

     • Add any final comments to assess how the issue was resolved.
     • Under status, select Closed.

   • If part or all of the finding remains to be addressed:

     Assess if the issue identified by the finding prevents the model from being approved.

     Criteria include:

     1. High-severity findings — Must be resolved before approval.

     2. Medium-severity findings — May allow conditional approval with a mitigation plan.

     3. Low-severity findings — Don’t prevent approval and are typically resolved post-approval with a mitigation plan.

5. Track open issues until all findings are resolved or a remediation plan is in place for post-approval issues.

Along with model-specific findings, you can also view and filter a list of findings across all models within the ValidMind Platform:

To view findings for all models:

1. In the left sidebar, click Findings.

   In the page that opens is a list of all model findings, including information for:

   • Title
   • Severity
   • Status
   • Inventory model
   • Risk area
   • Assignee
   • Due date
   • Creation date
   • Business unit

   Filter this list to include only findings you want to see, or toggle visibilty for column headers.

2. Click on any model finding for more information, including the proposed remediation plan and any supporting attachments.

   Attachments are listed with the following information:

   • Filename
   • Icon representing file type
   • Date uploaded
   • The user who uploaded the file
   • File size
   • Notes

   Click on the attachment to view or download the file. expanded sidebar that appears for your model, click Model Activity.

Update a model finding

1. Select the name of your model you registered for this course to open up the model details page.
2. In the left sidebar that appears for your model, click Model Findings.
3. Select one of the findings you logged during this course, and make some changes to any of the fields.
4. When you are finished editing, set the finding status to Closed.

When you’re done, click to continue.

View all Model Findings

Filter this list to include only findings you want to see, or toggle visibilty for column headers.

When you’re done, click to continue.

Submit report for approval

Transition model status

(Scroll down for the full instructions.)

Learn more …

Try it live on the next page.

When you’re ready, verify the approval workflow, and then submit your model documentation for approval:

• Verify workflow
• Submit for approval

Workflow states and transitions are configured by an administrator in advance, but you should verify that the expected people are included in the approval process.

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.

3. On the landing page of your model, locate the model status section:

   • Click See Workflow to open the detailed workflow associated with that model.
   • The current workflow state will be highlighted on this detail view.

While your lifecycle statuses and workflows are custom to your organization, some examples are:

• In Documentation — The model is currently being documented and can be submitted for validation next.
• In Validation — The model is currently being validated and can be submitted for review and then approval.

To transition through the approval workflow, all required workflow steps must be completed. By default, a model must be in the
In Documentation state before you can submit it for validation.

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.

3. If an action is available to your role, you’ll see it listed under your model status on the model’s landing page.

   • Click to open up the transition panel for your selected action. This arrow will be followed by the action name.
   • Enter your notes and any other additional inventory fields then click Submit.

While your lifecycle statuses and workflows are custom to your organization, some examples are:

• To submit model documentation for validation — Click Ready for Validation to indicate that a model developer has completed the initial model documentation and is ready to have it validated. Add any notes that need to be included and then click Ready for Validation.
• To submit validation reports for review and approval — Click Ready for Review to indicate that you have completed your initial model validation report, fill in the mandatory notes, and submit.
• To request revisions to model documentation or validation reports — Click Request Revision, fill in the mandatory notes to explain the changes that are required, and submit.
• To have your model documentation and validation report approved — Click Ready for Approval, fill in the mandatory notes, and submit.

Submit for approval

1. Select the name of your model you registered for this course to open up the model details page.
2. Locate the model status section.
3. Open up the status transition panel, enter your notes and any other additional inventory fields, then click Submit.

When you’re done, click to continue.

Section 2

Collaborate with others

Comment threads

Learn more …

Try it live on the next page.

While working with content blocks, you can comment directly on specific portions of the text.

All users associated with a model, such as model developers and model validators, will see a notification that a comment has been posted in their Recent Activity feed, accessible via the Dashboard.

Have a question about the model? Collaborate with your developer right in the model documentation:

• Post comments
• Reply to comments
• Resolve comments

1. In any text block or test description, select the portion of text you want to comment on, then click the button that appears.

2. Enter your comment and click Comment.

3. You can view the comment by clicking the highlighted text. Comments will also appear in the right sidebar.

1. Click the highlighted text to view the comment thread.

2. Enter your comment and click Reply.

3. You can view the comment thread by clicking the highlighted text.

1. Click the highlighted text portion to view the thread, then click to resolve the thread.

2. To view the resolved comment thread, click the Comments archive button in the toolbar.

   You can view a history of all archived comments in the Comment archive.

To reopen a comment thread, reply to the comment thread in the Comment archive or click the Reopen button that appears next to the highlighted text portion.

Comment on a text block

1. Select the name of your model you registered for this course to open up the model details page.
2. On the left sidebar that appears for your model, click Validation Report.
3. In the content block you added earlier: Post a comment, reply to it, and then resolve the thread.

When you’re done, click to continue.

Track model activity

Track changes & updates

Learn more …

Try it live on the next page.

View documentation activity

The Model Activity page shows a record of all activities, including actions performed by users in your organization and updates generated via the library such as:

• Inventory fields updated on the model
• Model or documentation status transitions
• Updates to model documentation, validation reports, or ongoing monitoring plans
• Test results added to your model
• Findings added, updated, or removed
• Comment creation and replies

To view model activity:

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.

3. In the expanded sidebar that appears for your model, click Model Activity.

Review model activity

1. Select the name of your model you registered for this course to open up the model details page.
2. In the left sidebar that appears for your model, click Model Activity.
3. Filter the following activity:
   Comments | Status Updates | Model Updates | Test Results

When you’re done, click to continue.

View analytics

Welcome to Analytics

Here, you can find executive summaries, track information on models, findings, and more.

For example:

1. Click Findings to review reports on findings.
2. Click into any widget to review the findings reported by that widget.

When you’re done, click to continue.

In summary

Finalizing validation reports

Want to learn more? Find your next learning resource on ValidMind Academy.

In this final module, you learned how to:

• Add or edit content blocks in your validation report
• Assess the compliance of a model within your validation report
• Manage model findings via multiple methods
• Submit your validation report for approval
• Collaborate with other stakeholders on your model
• Track updates on your model
• Navigate the analytics dashboard

There is more that ​ValidMind can do to help you validate models, from using your own template to code samples you can adapt for your own use case:

All model validation guides