Managing evaluation cost

concept australia Updated Sep 15, 2026 1 min read mon-ai-managing-evaluation-cost.md
Raw file servicenow.com

Reduce the assists that evaluation consumes by adjusting what you evaluate, how often you evaluate it, and which AI systems you evaluate.

Evaluating both ServiceNow and external AI systems consumes assists. Three settings determine how many assists your evaluations consume.

  • Consider which metrics require evaluation. Each metric increases the visibility you gain into a session but also increases assist usage to evaluate it. Evaluate only the metrics that give you the insight you need.
  • Adjust the sample rate as needed. A higher sample rate evaluates more executions and gives you more confidence in your scores but also increases assist usage. Set the lowest rate that produces enough evaluated sessions to trust the score. ServiceNow AI systems use a single sample rate for all metrics. External AI systems have a sample rate per metric, so you can keep higher rates for the metrics that matter most and sample the rest.
  • Evaluate AI systems that require oversight. Evaluation runs for every AI system that has it turned on, so turn it off for the systems that you don't need to monitor, such as test or retired systems.

Related topics

Enable evaluation for an AI system

Disable evaluation for an AI system

Configure global metrics for ServiceNow AI systems

Configure global metrics for external AI systems

Configure asset-specific metrics for ServiceNow AI systems

Configure asset-specific metrics for external AI systems

Configure metrics evaluated for an AI system

Keywords ServiceNow OttoAI Agentsgenerative AIagentic AI
Search documentation
Search document titles and file paths on the australia branch