Configure asset-specific metrics for external AI systems

task australia Updated Sep 10, 2026 2 min read mon-ai-configure-asset-metrics-external.md
Raw file servicenow.com

Add or remove metrics for one or more external AI systems without changing the global metric configuration, and adjust metric sample rates.

Before you begin

Role required: sn_ai_governance.ai_steward

Note: The AI system must have evaluation enabled. See Enable evaluation for an AI system.

About this task

You can optionally override which metrics are evaluated for specific external AI systems. For details on adding or removing metrics for an AI system from that system's asset record instead, see Configure metrics evaluated for an AI system.

Procedure

  1. Navigate to All > AI Control Tower > Home > Settings > Rules and templates > Evaluation.

  2. On the AI evaluations sub-tab, select External AI systems.

  3. Configure the metrics that you want to evaluate for specific AI systems.

    Important: Adding more metrics increases the visibility you gain into each session, but also increases assist usage to evaluate it. Select the metrics that give you the insight you need.

Option

Steps

Add one or more AI systems and selected metrics

  1. In the Asset-specific metrics section, select Add.
  2. In the side panel, select one or more AI systems that you want to add a metric for.
  3. Select Next.
  4. Select one or more metrics that you want to evaluate for the AI systems that you selected.
  5. Select Add metrics.

Remove one or more metrics

  1. In the Asset-specific metrics section, select the check box next to the metric or metrics that you want to remove.
  2. Select Remove.
  3. In the confirmation dialog, select Remove.
4. Adjust the sample rate for one or more metrics.
The sample rate determines what percentage of AI executions a metric evaluates. For external AI systems, each metric has its own sample rate, so you can evaluate the metrics that matter most on more executions and sample the rest.

When metrics that contribute to the same quality or safety score use different sample rates, the metric with the higher rate evaluates more executions and can skew that score toward its results.

**Important:** Increasing a metric's sample rate evaluates more executions and gives you more confidence in its score, but also increases assist usage. Set the lowest rate that produces enough evaluated sessions to trust the score.

1.  In the Asset-specific metrics section, select one or more AI systems that you want to update.

2.  In the More actions menu, select **Edit sample rate**.

3.  In the side panel, select the pencil icon for the metric that you want to update.

4.  Enter the sample rate that you want to use.

5.  Select **Apply**.

6.  Update the sample rate for additional metrics in the side panel as needed.

7.  Select **Save**.

Parent Topic:Configure evaluation scoring for external AI systems

Related topics

Activate evaluation scoring for external AI systems

Configure global metrics for external AI systems

Exclude external AI systems from a metric

Keywords ServiceNow OttoAI Agentsgenerative AIagentic AI
Search documentation
Search document titles and file paths on the australia branch