Add and manage model findings

Published

November 20, 2024

Add findings within the ValidMind Platform at the model or documentation section level, update your findings to include proposed remediation plans and supporting documentation, or delete findings that no longer need to be tracked.

Prerequisites

Add model findings

  1. In the left sidebar, click Model Inventory.

  2. Select a model or find your model by applying a filter or searching for it.4

  3. In the left sidebar that appears for your model, click Documentation.

    You can now either log a finding on this overview page, or via a specific documentation section. Both methods will allow you to associate a finding with a documentation section.

Add finding via overview

To log a finding from the documentation overview:

  1. On your model’s Documentation page, click Add Finding.

  2. On the Add Model Finding page that opens, provide information for:

    • Title
    • Risk area
    • Owner
    • Severity
    • Due date
    • Documentation section
    • Description
  3. When you are done, click Save to submit the finding.

    Once created, you can then add supporting documentation to your finding.5

Add finding via section

While working within a section of your documentation, you can easily log a finding associated with that section without leaving the page:

  1. Click on ValidMind Insights™ to expand the insight panel.

  2. For the section you want to add a Finding for, click Add Finding beneath the Documentation Guidelines.

  3. On the Add Model Finding page that opens, provide information for:

    • Title
    • Risk area
    • Owner
    • Severity
    • Due date
    • Documentation section
    • Description

    The documentation section will be auto-populated with the section you are working from — you are able to select another section if desired.

    An animated gif demonstrating how to add a finding with the ValidMind Insights™ panel

    Adding a finding with the ValidMind Insights™ panel
  4. When you are done, click Save to submit the finding.

    Once created, you can then add supporting documentation to your finding.6

Update model findings

As findings get resolved or require other changes during the model validation process, you can update them:

  1. Locate the finding you want to update.7

  2. Click on a field to make changes. You can make updates to:

    • Title
    • Description
    • Proposed remediation plan
    • Supporting documentation8
    • Status
    • Severity
    • Risk area
    • Due date
    • Assignee
    • Documentation section

    You can also add comments to a finding.

Most updates are applied immediately but you must click Save to make changes to the finding title, description, proposed remediation plan, and attachments effective.

Track issue resolution

As you prepare your validation report, review open or past due model findings, close resolved ones, or add a mitigation plan:

  1. In the left sidebar, click Model Inventory.

  2. Select a model or find your model by applying a filter or searching for it.9

  3. In the left sidebar that appears for your model, click Model Findings.

    In the view that opens, all findings for the model that you are validating are shown. For example:

    A screenshot showing several model findings

    Sample model findings
  4. Go through the open findings one-by-one:

    • If the finding has been addressed:

      • Add any final comments to assess how the issue was resolved.
      • Under status, select Closed.
    • If part or all of the finding remains to be addressed:

      • Assess if the issue identified by the finding prevents the model from being approved.
      • If a remediation plan is required, enter the details in the Remediation Plan section of the finding.
  5. Track open issues until all findings are resolved or a remediation plan is in place for post-approval issues.

How should I assess open issues?

The decision to approve a model will depend on whether unresolved findings pose unacceptable risks and how well the mitigation plan addresses outstanding issues. Criteria include:

High-severity findings (Level 1)
These are issues that significantly affect model reliability, conceptual soundness, or compliance with regulations. Examples include incorrect model assumptions, data integrity issues, or failure to meet key risk thresholds. Critical findings must be resolved before a model can be approved, as they pose a substantial risk to the organization.
Medium-severity findings (Level 2)
These are important but less severe issues, such as incomplete documentation, minor deviations in model performance, or gaps in testing. While they don’t prevent model approval outright, they often require a mitigation plan outlining steps to address the issues within a specified timeframe. The model may be approved with conditions, pending resolution.
Low-severity findings (Level 3)
These are minor issues, such as small discrepancies that do not materially affect model performance or the risk profile. These findings usually don’t prevent model approval and can often be resolved post-approval as part of ongoing model maintenance.

Manage supporting documentation

After a finding is created, you’re able to add supporting documentation to it.

Add attachments to findings

Uploaded files must be less than 50 MB each in size.

  1. On the findings detail page, click on the attachments header.

  2. Click Select Files to add a file.

    • Add a note to the file by clicking on the menu, then select Add Note.
    • Update a note by making your changes in the existing text field.
  3. Click Save to submit the upload.

    An animated gif demonstrating how to add attachment notes

    Adding attachment notes

Remove attachments from findings

  1. On the findings detail page, click on the attachments header.

  2. Locate the file you want to remove, and click on the menu.

    • Select Delete File to remove the file. After you confirm, the attachment will be removed from the list.
    • Select Remove Notes to delete any notes.
  3. Click Save to apply the deletion.

    After you save, the attachment or notes will be removed permanently.

    An animated gif demonstrating how to delete attachment notes and attachments

    Deleting attachment notes and attachments

Delete model findings

Finding deletion is permanent.

While finding deletion will be logged under your Model Activity,10 deleted findings cannot be retrieved.

If you logged a finding in error or otherwise no longer need to track that finding, you can delete it:

  1. Locate the finding you want to delete.11

  2. On the finding’s detail page, click Delete Finding in the right sidebar.

    Once you confirm, the finding will be permanently deleted.

    An animated gif demonstrating how to delete a finding

    Deleting a finding