# US 2026/0087328 A1 · Inference-time steering in language model applications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087328 A1
- Document ID: US20260087328A1
- Status: Published application
- Kind: A1
- Application number: 19/044,429
- Filed: 2025-02-03
- Published: 2026-03-26
- Earliest claimed: 2024-09-24
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: Shaona Ghosh; Amrita Bhattacharjee; Christopher Parisien; Traian Rebedea
- Web page: https://patentgrep.com/patent/US20260087328A1

## CPC

- G06N 3/048: Activation functions
- G06N 3/08: Learning methods
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Disclosed are apparatuses, systems, and techniques for compliance of outputs of artificial intelligence (AI) systems with pertinent use policies. The techniques include processing, using a neuron layer of a model, an input to generate an activation of the neuron layer; determining that the activation corresponds to a non-compliant content region in a reduced-dimensionality latent space; modifying, using a steering vector, the activation; and causing the modified activation to be input into a second, subsequent neuron layer of the model.

## Claims

### Claim 1

A method comprising:
processing, using a neuron layer of a model, an input to generate an activation of the neuron layer;
determining that the activation corresponds to a non-compliant content region in a reduced-dimensionality latent space;
modifying, using a steering vector, the activation;
causing the modified activation to be input into a second, subsequent neuron layer of the model;
receiving an output using the model and based at least on the modified activation; and
causing presentation of the output.

### Claim 2 (depends on 1)

The method of claim 1, wherein the neuron layer of the model comprises at least one of:
an attention layer;
a hidden layer of a feed forward neural network;
a residual stream layer; or
an output layer.

### Claim 3 (depends on 1)

The method of claim 1, wherein the non-compliant content region in the reduced-dimensionality latent space comprises a region corresponding to non-compliant content categories that are not compliant with one or more policies, the non-compliant content categories comprising at least one of:
a hate content category;
a sexual content category;
a harassing content category;
a violent content category;
a profane content category;
a self-harm content category;
a threat content category;
a minor-directed content category;
an illegal weapon content category;
a controlled substance content category;
a criminal content category;
a privacy content category;
a misinformation content category;
a fraudulent content category;
an intellectual property-infringing content category;
a plagiarism content category;
an economic harm content category;
a biological harm content category;
a malware content category;
a jailbreak content category;
a product or services content category;
an off-topic content category;
a bias content category;
a contextual content category; or
a hallucination content category.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
obtaining a first set of activations generated by the neuron layer and associated with a non-compliant state;
obtaining a second set of activations generated by the neuron layer and associated with a compliant state; and
calculating a difference based at least on a comparison of the first set of activations and the second set of activations; and
generating the steering vector based at least on the difference.

### Claim 5 (depends on 4)

The method of claim 4, wherein:
the second set of activations are generated by processing, using the neuron layer, a plurality of second inputs; and
the second inputs comprise a plurality of model prompts.

### Claim 6 (depends on 5)

The method of claim 5, further comprising obtaining the plurality of model prompts, wherein the obtaining comprises modifying, using a second model, a second plurality of model prompts used to generate the first set of activations.

### Claim 7 (depends on 5)

The method of claim 5, further comprising using noise filtering to remove, from the first set of activations and the second set of activations, a pair of activations.

### Claim 8 (depends on 4)

The method of claim 4, further comprising:
processing, using the model, a plurality of model prompts to generate a plurality of model outputs; and
determining, using a second model and for each model output of the plurality of model outputs, whether the respective model output is associated with the non-compliant state or the compliant state.

### Claim 9 (depends on 8)

The method of claim 8, further comprising, responsive to the respective model output being associated with the non-compliant state, adding an activation associated with the respective model output to the first set of activations.

### Claim 10 (depends on 8)

The method of claim 8, further comprising, responsive to the respective model output being associated with the compliant state, adding the activation associated with the respective model output to the second set of activations.

### Claim 11

A system comprising:
one or more processors to:
process, using a neuron layer of a model, an input to generate an activation of the neuron layer;
determine that the activation corresponds to a non-compliant content region in a reduced-dimensionality latent space;
modify, using a steering vector, the activation;
generate an output of the model based at least on the modified activation being processed using a second, subsequent neuron layer of the model; and
cause presentation of the output.

### Claim 12 (depends on 11)

The system of claim 11, wherein the neuron layer of the model comprises at least one of:
an attention layer;
a hidden layer of a feed forward neural network;
a residual stream layer; or
an output layer.

### Claim 13 (depends on 11)

The system of claim 11, wherein the non-compliant content region in the reduced-dimensionality latent space comprises a region corresponding to non-compliant content categories that are not compliant with one or more policies, the non-compliant content categories comprising at least one of:
a hate content category;
a sexual content category;
a harassing content category;
a violent content category;
a profane content category;
a self-harm content category;
a threat content category;
a minor-directed content category;
an illegal weapon content category;
a controlled substance content category;
a criminal content category;
a privacy content category;
a misinformation content category;
a fraudulent content category;
an intellectual property-infringing content category;
a plagiarism content category;
an economic harm content category;
a biological harm content category;
a malware content category;
a jailbreak content category;
a product or services content category;
an off-topic content category;
a bias content category;
a contextual content category; or
a hallucination content category.

### Claim 14 (depends on 11)

The system of claim 11, wherein the one or more processors are further to:
obtain a first set of activations generated by the neuron layer and associated with a non-compliant state;
obtain a second set of activations generated by the neuron layer and associated with a compliant state; and
calculate a difference based at least on a comparison of the first set of activations and the second set of activations; and
generate the steering vector based at least on the difference.

### Claim 15 (depends on 14)

The system of claim 14, wherein:
the second set of activations are generated by processing, using the neuron layer, a plurality of second inputs; and
the second inputs comprise a plurality of model prompts.

### Claim 16 (depends on 15)

The system of claim 15, wherein the one or more processors are further to obtain the plurality of model prompts, wherein the obtaining comprises modifying, using a second model, a second plurality of model prompts used to generate the first set of activations.

### Claim 17 (depends on 15)

The system of claim 15, wherein the one or more processors are further to use noise filtering to remove, from the first set of activations and the second set of activations, a pair of activations.

### Claim 18 (depends on 14)

The system of claim 14, wherein the one or more processors are further to:
process, using the model, a plurality of model prompts to generate a plurality of model outputs; and
determine, using a second model and for each model output of the plurality of model outputs, whether the respective model output is associated with the non-compliant state or the compliant state.

### Claim 19 (depends on 11)

The system of claim 11, wherein the system is comprised in at least one of:
an in-vehicle infotainment system for an autonomous or semi-autonomous machine;
a system for performing simulation operations;
a system for performing digital twin operations;
a system for performing light transport simulation;
a system for performing one or more medical operations;
a system for performing one or more factory operations;
a system for performing one or more analytics operations;
a system implementing one or more inference microservices;
a system for performing light transport simulations;
a system for performing collaborative content creation for 3D assets;
a system for performing deep learning operations;
a system implemented using an edge device;
a system for generating or presenting at least one of virtual reality content, mixed reality content, or augmented reality content;
a system implemented using a robot;
a system for performing one or more conversational AI operations;
a system implementing one or more large language models (LLMs);
a system implementing one or more vision language models (VLMs);
a system implementing one or more multi-modal language models (MMLMs);
a system implementing one or more language models;
a system for performing one or more generative AI operations;
a system for generating synthetic data;
a system incorporating one or more virtual machines (VMs);
a system implemented at least partially in a data center; or
a system implemented at least partially using cloud computing resources.

### Claim 20

A processing device comprising processing circuitry to:
process, using one or more layers of a machine learning model, an input to generate one or more activations;
determine that at least one activation of the one or more activations corresponds to a non-compliant content region in a reduced-dimensionality latent space;
modify, using a steering vector, the at least one activation;
generate a response to the input based at least on one or more second layers of the machine learning model processing the at least one modified activation; and
at least one of:
send data corresponding to the response to one or more devices for presentation; or
cause presentation of the response.
