Review Arc traces in AI Control Tower

task australia Updated Sep 30, 2026 2 min read cowork-review-traces-aict.md
Raw file servicenow.com

Check the quality and safety scores of Arc sessions in AI Control Tower, then open a session or trace to see which metric scores and details.

Before you begin

The AI Control Tower for Enterprise AI Foundation plugin (sn_aict_foundation) must be activated on the instance. You can't review Arc traces until this plugin is active.

Role required: sn_app_arc.admin and sn_ai_governance.ai_steward or sn_app_arc.user and sn_ai_observe.ai_data_sender

About this task

In AI Control Tower, each AI system is tracked as an asset in the Inventory. Arc appears as the ServiceNow Arc Agent asset, which AI Control Tower creates when a user connects Arc to the instance. The asset starts in the Unmanaged state, with limited functionality, and shows traces only after you move it to the Managed state. Nothing else needs to be configured to receive traces. For more on asset states, see Managed and unmanaged AI assets.

Review traces to see how users work with Arc and to catch a drop in quality or safety scores, or a security issue in a response.

For how AI Control Tower scores traces, see Trace evaluation for Arc in AI Control Tower.

Procedure

  1. Navigate to All > AI Control Tower > Home,

  2. Select Inventory.

  3. In the search field, enter Arc.

  4. Select ServiceNow Arc Agent.

  5. Select Move to Managed to move the asset to Managed.

    The asset shows Managed, and the Monitor tab appears.

    To move several assets at once from the Inventory list, see Move AI assets to managed.

  6. Select the Monitor tab.

    The tab shows the average overall quality and safety scores, the metrics evaluated and their sample rate, average latency and tokens per session, and agent activity over time.

    Note: Scores appear only after evaluation finishes, which takes some time after a trace arrives. Until then, the score cards show no data. Refresh the page to see new scores.

  7. Scroll to Recent evaluated sessions and review the quality and safety score for each session.

  8. Select a session.

    The session page lists the lowest scoring metrics, a score and reason for each metric, and the traces in the session.

  9. Select a trace, then select a span.

    The span details show each metric score and the reason behind it.

    To trace a low score to its cause, see Investigate a low-scoring session.

  10. To change which metrics run on this asset, select the gear icon on the Metrics evaluated card.

    Select the metrics in Edit metrics evaluated for this asset, then select Save metric.

    For the available metrics, see Evaluation metrics.

    For more options, including sample rates for this asset, see Configure asset-specific metrics for external AI systems.

  11. To score more traces, navigate to All > AI Control Tower > Home > Settings > Rules and templates > Evaluation, and raise the Sample rate on the AI evaluations sub tab.

    Select Update to save the change.

    For more about evaluation settings, see Activate evaluation scoring for external AI systems.

    To set the sample rate for each metric, see Configure global metrics for external AI systems.

Parent Topic:Trace evaluation for Arc in AI Control Tower

Keywords AI Control TowertracesMonitor tabsample rate
Search documentation
Search document titles and file paths on the australia branch