Generative Ai Controller

The bring-your-own-key (BYOK) feature enables you to use your own API credentials from supported cloud AI providers, such as Azure OpenAI, Amazon Bedrock, and Google Gemini, to run generative AI skills and AI agents.

Connect an external LLM to the ServiceNow AI Platform by using a generic LLM connector. With a connector, you can write your own prompts to send to the LLM and create your own generative AI capabilities.

Configure LLM providers for Generative AI Controller at the backend level. For most use cases, configure capabilities using AI Admin Hub.

AI web search is a OneExtend capability that enables end users to perform web searches and receive AI-powered answers. The capability supports multiple AI providers and integrates with virtual assistants and workflows.

Use a generic LLM connector to connect an external AI provider to Generative AI Controller to use generative AI capabilities in your instance.

Configure your API credentials to use AWS Bedrock as your LLM provider for Generative AI Controller capabilities.

Configure your API credentials to use Azure OpenAI as your LLM provider for Generative AI Controller capabilities.

Configure your API credentials to use Google AI Studio as your LLM provider for Generative AI Controller capabilities.

Configure your API credentials to use Google Vertex AI as your LLM provider for Generative AI Controller capabilities.

Configure your API credentials to use IBM watsonx Granite models as your LLM provider for Generative AI Controller capabilities.

Configure your API credentials to use OpenAI as your LLM provider for Generative AI Controller capabilities.

Enter a custom resource path in your bring-your-own-key (BYOK) model configuration so that Generative AI Controller can connect to AI service providers that use a different web address than the default.

Configure Generative AI Controller providers and capabilities.

Configure rate limiting to control the traffic flow to the one_extend request by restricting the number of requests that can be made within a certain time frame.

Redirect users to different Virtual Agent topics if small talk, such as greetings, expressions of gratitude, complaints, or requests to close, are detected in conversations.

Configure the credentials and connections for your preferred generative AI service provider to integrate third-party generative AI on the ServiceNow AI Platform.

Enable dynamic translation of chat messages into English before they are sent to the large language model in generative AI topics to support users who speak other languages.

If any conkeyrefs are broken, re-add them from the doc/source/reuse/domain-separation/domain-separation-overview.dita file.In the short description, edit the first sentence to state whether domain separation is supported or not and add the application name. Keep the conkeyref at the end that describes domain separation.Domain separation is supported for Generative AI Controller. Domain separation enables you to separate data, processes, and administrative tasks into logical groupings called domains. You can control several aspects of this separation, including which users can see and access data.

Use Dynamic Translation to add multiple language support for generative AI capabilities to support users who speak languages other than English.

Use recursive summarization to break down the requests to the large language models (LLMs) into smaller pieces so that you can maintain the context for generative AI capabilities.

Learn how Generative AI Controller works as the control and visibility layer for all generative AI requests across your ServiceNow applications, what it controls, and how it integrates with third-party LLM providers.

Generative AI Controller use dedicated tables to log AI activities and track AI usage across the platform.

Use Generative AI Controller to integrate your ServiceNow applications with third-party large language models (LLMs) and manage how generative AI requests are governed, protected, and logged.

The Generative AI Controller application (sn.generative.ai) is automatically installed with ServiceNow AI applications.

Reference topics provide information about Generative AI Controller tables, and properties.

Choose which large language model (LLM) to use with Amazon Bedrock for custom skills.