Configure runtime security metrics
Set up a Traceloop connection and API key for prompt injection, offensive content, sensitive data input, and sensitive data anonymized trace data from external AI servers. Review data privacy settings to see which patterns detect sensitive data in LLM input and output.
Before you begin
Role required: admin
Install the open-source Traceloop SDK. In a terminal window, run this command:
pip install traceloop-sdk
After you install Traceloop SDK, you can customize the following code to initialize the Traceloop tracer:
import os from openaiimport OpenAI from traceloop.sdkimport Traceloop from traceloop.sdk.decoratorsimport workflow task
# InitializeTraceloop SDKTraceloop.init(app_name="joke_generation_service", disable_batch=True)client = OpenAI(api_key=os.environ.get("OPENAI_API_KEY"))For more information, see Traceloop OpenLLMetry for Python.
If you have a domain-separated instance, create an alias with a parent of connection alias sn_ai_security.Traceloop_API. Create one active connection and credential record under this new alias. The domain of each connection record determines the domain of the runtime metrics it pulls.
Procedure
-
Configure a trace connection for every external AI system for which you want to show runtime metrics.
For more information, see Configuring trace connections.
-
Generate an API key to authenticate trace data requests from your external AI system.
-
Navigate to All > Connections & Credentials > Credentials.
-
Create credentials of type API Key Credentials.
Fill out these fields and select Submit.
Field Description Name Traceloop API Key Applies to All MID servers Active Selected. Order 100 API Key Header Authorization API Key Prefix Bearer API Key <your Traceloop API key> Credential alias Locked.
For more information, see API key credentials.
-
-
Link the API key to your trace connection.
-
Navigate to All > Connections & Credentials > Connections.
-
Create an HTTPS connection with the sn_ai_security.Traceloop_API connection alias and a connection URL of
https://api.traceloop.com. For more information, see Create an HTTP(s) connection.
The scheduled job will automatically pull runtime metrics from the linked Traceloop environment.
-
-
Configure the Traceloop SDK in your agent code by adding these ServiceNow attributes when initializing Traceloop.
These are unique user-defined identifiers for tracking.
ShellTraceloop.init( app_name="your_agent_name", api_key=traceloop_api_key, resource_attributes={ "sn.aict.system.id": "your_agent_system_id", "sn.aict.system.name": "your_agent_name", "sn.aict.system.version": "1.0.0", "sn.aict.system.source": "your_source" })For more information about configuring Traceloop in your agent, see Traceloop - Guardrails.
-
To review data privacy, in AI Control Tower, navigate to Settings > Rules and templates > Security > Data Privacy.
This section shows the data patterns enabled in Data Privacy to detect and anonymize information in LLM prompts. Use this view as a quick reference when troubleshooting sensitive data charts. This feature requires the Data privacy plugin to be activated. For more information on how the data is sent and stored, see User data usage policy for Now Assist.
-
Return to the AI Control Tower Security tab and refresh the page.
Select the Runtime tab and verify that metrics are populated.
Parent Topic:Configuring security metrics in AI Control Tower
---
title: Configure runtime security metrics
description: Set up a Traceloop connection and API key for prompt injection, offensive content, sensitive data input, and sensitive data anonymized trace data from external AI servers. Review data privacy settings to see which patterns detect sensitive data in LLM input and output.
locale: en-US
canonical_url: https://www.servicenow.com/docs/r/intelligent-experiences/gov-sec-configure-pi-sensitive-metrics.html
release: brazil
topic_type: task
last_updated: "2026-10-27"
reading_time_minutes: 2
keywords: [ServiceNow Otto, AI Agents, generative AI, agentic AI]
breadcrumb: [Configure, Managing AI asset security, Govern AI assets, AI Control Tower, Establishing AI governance, Enable AI Experiences]
---
# Configure runtime security metrics
Set up a Traceloop connection and API key for prompt injection, offensive content, sensitive data input, and sensitive data anonymized trace data from external AI servers. Review data privacy settings to see which patterns detect sensitive data in LLM input and output.
## Before you begin
Role required: admin
Install the open-source Traceloop SDK. In a terminal window, run this command:
`pip install traceloop-sdk`
After you install Traceloop SDK, you can customize the following code to initialize the Traceloop tracer:
```
import os from openai
import OpenAI from traceloop.sdk
import Traceloop from traceloop.sdk.decorators
import workflow task
# Initialize
Traceloop SDKTraceloop.init(app_name="joke_generation_service", disable_batch=True)
client = OpenAI(api_key=os.environ.get("OPENAI_API_KEY"))
```
For more information, see [Traceloop OpenLLMetry for Python](https://www.traceloop.com/docs/openllmetry/getting-started-python).
If you have a domain-separated instance, create an alias with a parent of connection alias sn\_ai\_security.Traceloop\_API. Create one active connection and credential record under this new alias. The domain of each connection record determines the domain of the runtime metrics it pulls.
## Procedure
1. Configure a trace connection for every external AI system for which you want to show runtime metrics.
For more information, see [Configuring trace connections](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/brazil/markdown/intelligent-experiences/aict-configuring-trace-connections.md).
2. Generate an API key to authenticate trace data requests from your external AI system.
1. Navigate to **All** > **Connections & Credentials** > **Credentials**.
2. Create credentials of type **API Key Credentials**.
Fill out these fields and select **Submit**.
|Field|Description|
|-----|-----------|
|Name|Traceloop API Key|
|Applies to|All MID servers|
|Active|Selected.|
|Order|100|
|API Key Header|Authorization|
|API Key Prefix|Bearer|
|API Key|<your Traceloop API key>|
|Credential alias|Locked.|
For more information, see [API key credentials](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/brazil/markdown/platform-security/API-key-credential-form.md).
3. Link the API key to your trace connection.
1. Navigate to **All** > **Connections & Credentials** > **Connections**.
2. Create an HTTPS connection with the sn\_ai\_security.Traceloop\_API connection alias and a connection URL of `https://api.traceloop.com`. For more information, see [Create an HTTP\(s\) connection](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/brazil/markdown/platform-security/create-https-connection.md).
The scheduled job will automatically pull runtime metrics from the linked Traceloop environment.
4. Configure the Traceloop SDK in your agent code by adding these ServiceNow attributes when initializing Traceloop.
These are unique user-defined identifiers for tracking.
```
Traceloop.init(
app_name="your_agent_name",
api_key=traceloop_api_key,
resource_attributes={
"sn.aict.system.id": "your_agent_system_id",
"sn.aict.system.name": "your_agent_name",
"sn.aict.system.version": "1.0.0",
"sn.aict.system.source": "your_source"
}
)
```
For more information about configuring Traceloop in your agent, see [Traceloop - Guardrails](https://www.traceloop.com/docs/evaluators/guardrails).
5. To review data privacy, in AI Control Tower, navigate to **Settings** > **Rules and templates** > **Security** > **Data Privacy**.
This section shows the data patterns enabled in Data Privacy to detect and anonymize information in LLM prompts. Use this view as a quick reference when troubleshooting sensitive data charts. This feature requires the Data privacy plugin to be activated. For more information on how the data is sent and stored, see [User data usage policy for Now Assist](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/brazil/markdown/intelligent-experiences/user-data-usage-policy-now-assist.md).
6. Return to the AI Control Tower Security tab and refresh the page.
Select the Runtime tab and verify that metrics are populated.
**Parent Topic:**[Configuring security metrics in AI Control Tower](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/brazil/markdown/intelligent-experiences/gov-sec-configuring.md)
| title | Configure runtime security metrics |
| description | Set up a Traceloop connection and API key for prompt injection, offensive content, sensitive data input, and sensitive data anonymized trace data from external AI servers. Review data privacy settings to see which patterns detect sensitive data in LLM input and output. |
| locale | en-US |
| canonical_url | https://www.servicenow.com/docs/r/intelligent-experiences/gov-sec-configure-pi-sensitive-metrics.html |
| release | brazil |
| topic_type | task |
| last_updated | 2026-10-27 |
| reading_time_minutes | 2 |
| keywords | ServiceNow OttoAI Agentsgenerative AIagentic AI |
| breadcrumb | ConfigureManaging AI asset securityGovern AI assetsAI Control TowerEstablishing AI governanceEnable AI Experiences |