Large language models on the ServiceNow AI Platform

concept brazil Updated Sep 10, 2026 3 min read exploring-large-language-models.md
Raw file servicenow.com

ServiceNow AI Platform® utilises large language models (LLM) for generative AI and agentic AI functionality. You can choose the ServiceNow® LLM or supported third-party models. LLMs bring about the Generative AI application capabilities by understanding and generating human language, and processing vast amount of data.

Third-party model strategy

ServiceNow® supports third-party AI model providers, which signifies that the admin persona can select a third-party large language or an AI model provider for Now Assist skills that are available out of box. Find the supported model providers, the LLM services and the version.

Model provider

Large language model

Version

Deployment policy

ServiceNow®

Now LLM Service

Latest update for your instance

 

Microsoft Azure

Azure OpenAI

OpenAI GPT-4.1 and GPT-4.1-mini

https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/deployment-types#global-standard

Google

Google Gemini

Gemini 2.5 Flash and 2.5 Pro

https://cloud.google.com/vertex-ai/generative-ai/docs/learn/locations

AWS

AWS Claude

Claude 3.7 Sonnet

https://docs.aws.amazon.com/bedrock/latest/userguide/models-regions.htmlNote: Some out of box skills, Agents, and Agentic Workflows do not support Now LLM Service or third party model providers. To learn more about the exceptions to LLM service and third party model providers support, see https://support.servicenow.com/kb?id=kb_article_view&sysparm_article=KB2222333

**Note:** Some out of box skills, Agents, and Agentic Workflows do not support Now LLM Service or third party model providers. To learn more about the exceptions to LLM service and third party model providers support, see [https://support.servicenow.com/kb?id=kb\_article\_view&sysparm\_article=KB2222333](https://support.servicenow.com/kb?id=kb_article_view&sysparm_article=KB2222333)

Large language model selection

This selection is supported at various levels such as, skill, skill group and instance levels. However, the controls that define LLMs mapping to different skills, allowed at various global locations, are configured and approved in AI Control Tower by the AI steward. The model provider options for custom skills created in Now Assist skill kit and AI Agent Studio are also configured in AI Control Tower. See Configure third-party LLMs using AI Control Tower to learn more.

The Manage large language models feature enables the admin persona to perform additional actions like:

  • Edit the model provider at the instance, skill group and skill levels
  • Deactivate active skills which are non-compliant with fallback as No. See Configuring AI model providers to learn more.
  • View audit history on policy updates by AI steward in AI Control Tower
  • Select allowed model providers across domain separated instances.

See Manage AI models to learn about managing.

For more information on selecting and updating model providers, see Manage model providers.

  • Model provider updates
    Review these updates to learn which model providers and models are available for your skills and agents. Review the model cards for information about how each model is intended to be used.
  • General guidelines for writing instructions for generative AI large language models (LLMs)
    When using Now Assist products and skills, you may have the option to give specific instructions or other guidance to the LLM. Writing generative AI instructions is different from conducting a keyword search. Use the following general guidelines when crafting your instructions.
  • Discrepancies when using different AI search tools
    Different AI search tools may return different answers for the same or similar searches. This difference in results is expected. It occurs because each large language model (LLM) uses a different approach to find results and generate answers that match your search.
  • Providers and Models
    You can bring your own large language model (LLM) provider and API to use with Now Assist.

Parent Topic:Large language models and providers

Search documentation
Search document titles and file paths on the brazil branch