Create a compliance evaluation configuration

task brazil Updated Sep 10, 2026 3 min read airc-compliance-evaluation-configuration.md
Raw file servicenow.com

Define the AI systems, control objectives, metrics, and schedule that a compliance evaluation monitors on an ongoing basis.

Before you begin

Role required: sn_grc_ai_gov.ai_risk_and_compliance_manager

About this task

A compliance evaluation configuration monitors AI systems for compliance and updates evaluation scores on an ongoing basis. Use evaluation frameworks from ServiceNow® and Traceloop to produce trace, session, or span records for your AI systems. Use these frameworks to produce an evaluation of your AI systems. For information about connecting external AI systems to send trace data, see Activate evaluation scoring for external AI systems.

Procedure

  1. Navigate to All > AI Risk and Compliance > AI Risk and Compliance Workspace.

  2. Select the list icon [Omitted image "list-icon-airc-ws.png"] Alt text:.

  3. From the Controls monitoring module, select the Compliance evaluation configurations and select New.

  4. Define the evaluation details and data scope details.

Field

Description

Basic details

Evaluation name

Unique, descriptive name for this evaluation, using specific terms that identify the AI system, assessment scope, or version being evaluated (for example, Monitoring AI Toxicity).

Description

Purpose and scope of this evaluation, including what is being assessed, why it matters, and any key constraints or context users should know.

Data scope details

Authority documents

Authority documents that govern this evaluation. The following options are provided: - NIST AI Risk Management Framework

  • EU Artificial Intelligence Act
  • AI Content Safety & Toxicity Standard

Policies

Policies that this evaluation aligns with or enforces. The following options are provided: - Artificial Intelligence Software Development Lifecycle Policy

  • Enterprise Artificial Intelligence Governance Policy
  • Internal use of AI Systems

AI system type

Category of AI system being evaluated. The following options are provided:- Agentic AI

  • Generative AI

Provider

Provider of the AI system. The following options are provided:- ServiceNow

  • Others

Metric category

Metric category used in this evaluation:- Safety

  • Security
  • Quality
\[Omitted image "airc-configure-evaluation-define.png"\] Alt text: Form showing compliance evaluation configuration with fields for evaluation details and data scope. The fields shown include options for selecting authority documents, policies, AI system type, and metric category.
  1. Select Next.

  2. Select Add control objectives to add control objectives to the scope.

  3. Map control objectives from the filtered list by selecting the check box of each desired control objective.

  4. Select Add to complete the control objective mapping, and then select Next.

    [Omitted image "airc-configure-evaluation-scope-control-obj.png"] Alt text: Form showing a table of compliance control objectives with check boxes to select controls for evaluation scope.

  5. Define the evaluation criteria and frequency in the Evaluation criteria and frequency section.

Field

Description

Frequency

Frequency at which the evaluation runs and updates evaluation scores for the AI systems in scope. The following options are provided:- Daily: Runs the evaluation every day.

  • Weekly: Runs the evaluation once a week.
  • Monthly: Runs the evaluation once a month. For example, for AI toxicity, a monthly evaluation monitors control drift.

Success condition result

Result assigned to an AI system when the evaluation criteria are met. The following options are provided:- Passed

  • Failed
10. In the **All Evaluations** section, define the conditions and the metrics under which the configuration is applicable.
If multiple conditions are specified, they are evaluated in the order listed to determine applicability.

Field

Description

Name

Name for the evaluation.

Conditions

Field, operator, and value that filter which records this configuration applies to, for example, [Risk classification] [is] [High]. Select and or or to combine multiple conditions, and select New condition set to add a condition set that is evaluated independently of other condition sets.

Metric thresholds

Metric

Metric, operator, and threshold value that determine when a control is evaluated as compliant or non-compliant, for example, [Toxicity] [is] [True]. Select Add metric to define additional metric thresholds for this configuration.

\[Omitted image "airc-configure-evaluation.png"\] Alt text: Compliance evaluation configuration form showing the final step of configuring the evaluation. The form displays evaluation conditions and metric thresholds.
  1. Select Submit.

What to do next

The compliance evaluation configuration is ready to be mapped to one or more AI systems. For information about mapping an evaluation configuration to AI systems, see Use a compliance evaluation on an AI system record.

Keywords compliance evaluation configurationevaluation frameworkscontrol objectives
Search documentation
Search document titles and file paths on the brazil branch