Assess compliance

Use the ValidMind Platform to assess compliance of your models with guidelines based on analyzing evidence and artifacts.

Compliance assessments provide an unbiased starting point that enables more efficient discussions between validators and developers and involves three steps:

1. Link evidence to reports
2. Link artifacts to reports
3. Provide compliance assessments

NoneCompliance assessments cannot be performed within static PDF documents.

You can only assess compliance within PDFs converted to editable documents,¹ validation reports generated by the ValidMind Library, or validation reports created in the ValidMind Platform.

¹ Manage model documents

Prerequisites

• You are logged in to ValidMind.
• The model you are validating is registered in the model inventory.²
• A model developer has submitted their model documentation for validation.³
• Assessment options have been configured for the validation report template if required by your organization.⁴
• You are a Validator or assigned another role with sufficient permissions to perform the tasks in this guide.⁵

² Register models in the inventory

³ Submit for approval

⁴ Configure assessment options

⁵ Manage permissions

Link evidence to reports

Link developer evidence

To link evidence logged by developers⁶ to your validation report:

⁶ ValidMind Library

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.⁷

3. In the left sidebar that appears for your model, click Documents and select the Latest tab.⁸

4. Click on a Validation Report type file.⁹

   Expand any subsection of the validation report you would like to work with.

5. In any section of the report where the button is available, click Link Developer Evidence.

6. On the Link Developer Evidence to Validation Report page that opens, select the evidence that is related to your assessment.

   • Available evidence is associated with the relevant documentation section.
   • If you are not sure if something is relevant, you can expand the section by clicking for more details.

7. Click Update Linked Evidence.

   • Confirm that the newly linked-to evidence shown under Developer Evidence is accurate and is connected to the correct documentation section.
   • Evidence that needs your attention gets flagged with Requires Attention. These sections get flagged automatically whenever a test result is above or below a certain threshold.

⁷ Working with the model inventory

⁸ Work with document versions

⁹ Preparing validation reports

Link validator evidence

To link validator evidence to a report, you must first log tests as a validator with the ValidMind Library.¹⁰

¹⁰ ValidMind Library

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.¹¹

3. In the left sidebar that appears for your model, click Documents and select the Latest tab.¹²

4. Click on a Validation Report type file.¹³

   You can now expand any subsection of the validation report you would like to work with.

5. In any section of the report where the button is available, click Link Evidence to Report.

6. On the Link Validator Evidence to Validation Report page that opens, select the evidence that is related to your assessment.

   If you are not sure if something is relevant, you can expand the section by clicking for more details.

7. Click Update Linked Evidence.

   • Confirm that the newly linked-to evidence shown under Developer Evidence is accurate.
   • Evidence that needs your attention gets flagged with Requires Attention. These sections get flagged automatically whenever a test result is above or below a certain threshold.

¹¹ Working with the model inventory

¹² Work with document versions

¹³ Preparing validation reports

Link artifacts to reports

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.¹⁴

3. In the left sidebar that appears for your model, click Documents and select the Latest tab.¹⁵

4. Click on a Validation Report type file.¹⁶

5. Expand any subsection of the validation report you would like to work with.

6. In any section of the report where the button is available, click Link Artifact to Report and select the artifact type¹⁷ you want to add:

   • Validation Issue
   • Policy Exception
   • Model Limitation

7. On the Link Artifact to Report modal that opens, select from the list of available artifacts, or click Update Linked Artifacts.¹⁸

8. Click Update Linked Artifacts.

   Confirm that newly linked artifact shown under Artifacts is accurate.

¹⁴ Working with the model inventory

¹⁵ Work with document versions

¹⁶ Preparing validation reports

¹⁷ Manage artifact types

¹⁸ Add and manage artifacts

Provide compliance assessments

NoneAssessment options available for selection depend on configuration for individual validation report templates.

Your organization can customize these options to match its own assessment framework, or choose to remove them from templates entirely.¹⁹

¹⁹ Configure assessment options

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.²⁰

3. In the left sidebar that appears for your model, click Documents and select the Latest tab.²¹

4. Click on a Validation Report type file.²²

   Expand any subsection of the validation report you would like to work with.

5. In any section of the documentation where the assessment dropdown menu is available, select one of the available assessment options.

   Confirm that the compliance summary shown for each subsection provides an accurate overview for current qualitative and quantitative risk assessments.

6. Click under Risk Assessment Notes to add your risk assessment notes for that section using the content editing toolbar.²³

²⁰ Working with the model inventory

²¹ Work with document versions

²² Preparing validation reports

²³ Work with content blocks