Trace evaluation for Arc in AI Control Tower

concept australia Updated Sep 30, 2026 2 min read cowork-trace-evaluation.md
Raw file servicenow.com

AI Control Tower scores the traces that Arc sends for quality and safety. Review the scores to understand usage patterns and identify where responses fall short.

As users work in Arc, it records how its agents and skills run and sends that record to your ServiceNow instance in OpenTelemetry (OTel) format. AI Control Tower evaluates the records against a set of metrics and shows the results on the Arc asset.

How traces reach AI Control Tower

When a user logs in to Arc with a ServiceNow instance, Arc registers itself on that instance as an AI application. The registration appears in the AI Control Tower inventory as the ServiceNow Arc Agent asset. See Managing your AI asset inventory.

No trace connection is required. Arc sends traces to the instance the user is logged in to and authenticates with that user's login.

AI systems that don't send traces this way connect to AI Control Tower through SDK instrumentation or a trace connection. See Activate evaluation scoring for external AI systems and Configuring trace connections.

Arc sends traces whether or not the asset is managed, but AI Control Tower shows them only after an administrator moves the asset to the Managed state.

For more on asset states, see Managed and unmanaged AI assets. To move the asset and review its traces, see Review Arc traces in AI Control Tower.

A managed asset becomes eligible for life cycle review. See Managing your AI asset lifecycle.

Each user who sends traces requires the sn_app_arc.user and sn_ai_observe.ai_data_sender roles.

Arc doesn't display the traces it sends. Review traces and change the asset state in AI Control Tower.

Blocking access to Arc

An AI Control Tower administrator can block access to Arc with an Explicit Block policy. A policy scoped to a specific user ends that user's active Arc session and helps prevent that user from starting a new one. A policy that doesn't name a user blocks everyone who has used Arc. The policy stays in effect until it's deleted.

For how these policies work, see Explicit Block policies. To block access, see Create an Explicit Block policy.

Sessions, traces, and spans

  • Session

    One Arc conversation. Every trace from the conversation belongs to the same session, including background work that runs after a response, such as updating memory.

  • Trace

    One agent run, from the user's request to the response. For example, asking Arc to retrieve all incidents produces one trace. The agent run is the parent of every other span in the trace.

  • Span

    One operation inside a trace, such as the agent run, a tool call, or a model call. Arc sends the agent run and tool spans. The ServiceNow generative AI controller adds a span for each model call and places it under the agent run.

For how AI Control Tower structures and scores each level, see Sessions, traces, and spans.

Parent Topic:Configuring ServiceNow Arc

Keywords AI Control Towertrace evaluationOpenTelemetryquality scoresafety score
Search documentation
Search document titles and file paths on the australia branch