# US 2026/0037834 A1 · Performing transformer-based design verification for coverage closure in processor devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0037834 A1
- Document ID: US20260037834A1
- Status: Published application
- Kind: A1
- Application number: 18/789,646
- Filed: 2024-07-30
- Published: 2026-02-05
- Earliest claimed: 2024-07-30
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Harikrishnan KUMARAPILLAI CHANDRIKAKUTTY; Sirish Kumar MUNIPALLI; Fnu SHASHANK; Aung Thu HTET; Matthew N. PUMAR; Erik William BERG
- Web page: https://patentgrep.com/patent/US20260037834A1

## CPC

- G06N 5/02: Knowledge representation; Symbolic representation
- G06F 11/27: Built-in tests
- G06F 30/33: Design verification, e.g. functional simulation or model checking
- G06N 3/092: Reinforcement learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Performing transformer-based design verification for coverage closure in processor devices is disclosed herein. In one exemplary embodiment, a processor device trains an online decision transformer (ODT) using initial trajectories based on regression testing of a Design-Under-Test (DUT). The processor device then performs an online learning phase using the ODT by first generating a plurality of new trajectories. For each new trajectory, the processor device uses the ODT to generate a sequence of actions based on maximizing coverage, transmits the sequence of actions to a testbench environment, receives a corresponding sequence of observed states and a corresponding sequence of coverage metrics from the testbench environment, and generates the new trajectory. The processor device identifies a subset of the new trajectories having a final coverage metric that exceeds a coverage threshold, adds the subset to a replay buffer of the ODT, and retrains the ODT using the replay buffer.

## Claims

### Claim 1

A processor device, configured to:
train an online decision transformer (ODT) using a plurality of initial trajectories that are based on regression testing of a Design-Under-Test (DUT) and that are stored in an offline trajectory database; and
perform an online learning phase using the ODT by being configured to:
generate a plurality of new trajectories by being configured to, for each new trajectory:
generate, using the ODT, a sequence of actions based on maximizing coverage;
transmit the sequence of actions to a testbench environment;
receive, by executing a State/Action/Return-to-Go (SAR) generator, a corresponding sequence of observed states and a corresponding sequence of coverage metrics from the testbench environment; and
generate, by executing the SAR generator, the new trajectory based on the sequence of observed states, the sequence of actions, and the sequence of coverage metrics;
identify, by executing the SAR generator, a subset of the plurality of new trajectories having a final coverage metric that exceeds a coverage threshold;
add, by executing the SAR generator, the subset of the plurality of new trajectories to a replay buffer of the ODT; and
retrain the ODT using the replay buffer.

### Claim 2 (depends on 1)

The processor device of claim 1, wherein:
each trajectory of the plurality of initial trajectories and the plurality of new trajectories comprises a plurality of sets; and
each set of each plurality of sets comprises:
a state corresponding to one or more previous transactions of the regression testing;
an action corresponding to a next transaction of the regression testing; and
a return-to-go value corresponding to a coverage metric of the action.

### Claim 3 (depends on 1)

The processor device of claim 1, wherein the processor device is configured to perform the online learning phase using the ODT by being further configured to:
determine whether 100% coverage closure of the DUT has been reached; and
responsive to determining that 100% coverage closure of the DUT has not been reached, repeat the online learning phase.

### Claim 4 (depends on 1)

The processor device of claim 1, wherein the processor device is further configured to:
receive, by executing a trajectory generator, regression results of the regression testing;
generate, by executing the trajectory generator, the plurality of initial trajectories based on the regression results;
store, by executing the trajectory generator, the plurality of initial trajectories in the offline trajectory database;
identify, by executing a replay buffer generator, a subset of the plurality of initial trajectories having a final coverage metric that exceeds the coverage threshold; and
store, by executing the replay buffer generator, the subset of the plurality of initial trajectories in the replay buffer of the ODT.

### Claim 5 (depends on 1)

The processor device of claim 1, wherein the processor device is further configured to:
receive, by executing the testbench environment, the sequence of actions;
convert, by executing the testbench environment, the sequence of actions into a corresponding sequence of stimuli to the DUT;
determine, by executing the testbench environment, the sequence of observed states and the sequence of coverage metrics; and
transmit, by executing the testbench environment, the sequence of observed states and the sequence of coverage metrics to the SAR generator.

### Claim 6 (depends on 1)

The processor device of claim 1, wherein the testbench environment comprises a System Verilog testbench environment.

### Claim 7 (depends on 1)

The processor device of claim 1, wherein the processor device is further configured to update the coverage threshold to a value of a highest final coverage metric of the subset of the plurality of new trajectories.

### Claim 8

A method for performing transformer-based design verification for coverage closure in processor devices, comprising:
training an online decision transformer (ODT) using a plurality of initial trajectories that are based on regression testing of a Design-Under-Test (DUT) and that are stored in an offline trajectory database; and
performing an online learning phase using the ODT by:
generating a plurality of new trajectories by, for each new trajectory:
generating, using the ODT, a sequence of actions based on maximizing coverage;
transmitting the sequence of actions to a testbench environment;
receiving, using a State/Action/Return-to-Go (SAR) generator, a corresponding sequence of observed states and a corresponding sequence of coverage metrics from the testbench environment; and
generating, using the SAR generator, the new trajectory based on the sequence of observed states, the sequence of actions, and the sequence of coverage metrics;
identifying, using the SAR generator, a subset of the plurality of new trajectories having a final coverage metric that exceeds a coverage threshold;
adding, using the SAR generator, the subset of the plurality of new trajectories to a replay buffer of the ODT; and
retraining the ODT using the replay buffer.

### Claim 9 (depends on 8)

The method of claim 8, wherein:
each trajectory of the plurality of initial trajectories and the plurality of new trajectories comprises a plurality of sets; and
each set of each plurality of sets comprises:
a state corresponding to one or more previous transactions of the regression testing;
an action corresponding to a next transaction of the regression testing; and
a return-to-go value corresponding to a coverage metric of the action.

### Claim 10 (depends on 8)

The method of claim 8, wherein performing the online learning phase using the ODT further comprises:
determining whether 100% coverage closure of the DUT has been reached; and
responsive to determining that 100% coverage closure of the DUT has not been reached, repeating the online learning phase.

### Claim 11 (depends on 8)

The method of claim 8, further comprising:
receiving, using a trajectory generator, regression results of the regression testing;
generating, using the trajectory generator, the plurality of initial trajectories based on the regression results;
storing, using the trajectory generator, the plurality of initial trajectories in the offline trajectory database;
identifying, using a replay buffer generator, a subset of the plurality of initial trajectories having a final coverage metric that exceeds the coverage threshold; and
storing, using the replay buffer generator, the subset of the plurality of initial trajectories in the replay buffer of the ODT.

### Claim 12 (depends on 8)

The method of claim 8, further comprising:
receiving, using the testbench environment, the sequence of actions;
converting, using the testbench environment, the sequence of actions into a corresponding sequence of stimuli to the DUT;
determining, using the testbench environment, the sequence of observed states and the sequence of coverage metrics; and
transmitting, using the testbench environment, the sequence of observed states and the sequence of coverage metrics to the SAR generator.

### Claim 13 (depends on 8)

The method of claim 8, wherein the testbench environment comprises a System Verilog testbench environment.

### Claim 14 (depends on 8)

The method of claim 8, further comprising updating the coverage threshold to a value of a highest final coverage metric of the subset of the plurality of new trajectories.

### Claim 15

A non-transitory computer-readable medium, having stored thereon computer-executable instructions that, when executed by a processor device, causes the processor device to:
train an online decision transformer (ODT) using a plurality of initial trajectories that are based on regression testing of a Design-Under-Test (DUT) and that are stored in an offline trajectory database; and
perform an online learning phase using the ODT by causing the processor device to:
generate a plurality of new trajectories by causing the processor device to, for each new trajectory:
generate, using the ODT, a sequence of actions based on maximizing coverage;
transmit the sequence of actions to a testbench environment;
receive, by executing a State/Action/Return-to-Go (SAR) generator, a corresponding sequence of observed states and a corresponding sequence of coverage metrics from the testbench environment; and
generate, by executing the SAR generator, the new trajectory based on the sequence of observed states, the sequence of actions, and the sequence of coverage metrics;
identify, by executing the SAR generator, a subset of the plurality of new trajectories having a final coverage metric that exceeds a coverage threshold;
add, by executing the SAR generator, the subset of the plurality of new trajectories to a replay buffer of the ODT; and
retrain the ODT using the replay buffer.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein:
each trajectory of the plurality of initial trajectories and the plurality of new trajectories comprises a plurality of sets; and
each set of each plurality of sets comprises:
a state corresponding to one or more previous transactions of the regression testing;
an action corresponding to a next transaction of the regression testing; and
a return-to-go value corresponding to a coverage metric of the action.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the computer-executable instructions cause the processor device to perform the online learning phase using the ODT by further causing the processor device to:
determine whether 100% coverage closure of the DUT has been reached; and
responsive to determining that 100% coverage closure of the DUT has not been reached, repeat the online learning phase.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the computer-executable instructions further cause the processor device to:
receive, by executing a trajectory generator, regression results of the regression testing;
generate, by executing the trajectory generator, the plurality of initial trajectories based on the regression results;
store, by executing the trajectory generator, the plurality of initial trajectories in the offline trajectory database;
identify, by executing a replay buffer generator, a subset of the plurality of initial trajectories having a final coverage metric that exceeds the coverage threshold; and
store, by executing the replay buffer generator, the subset of the plurality of initial trajectories in the replay buffer of the ODT.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the computer-executable instructions further cause the processor device to:
receive, by executing the testbench environment, the sequence of actions;
convert, by executing the testbench environment, the sequence of actions into a corresponding sequence of stimuli to the DUT;
determine, by executing the testbench environment, the sequence of observed states and the sequence of coverage metrics; and
transmit, by executing the testbench environment, the sequence of observed states and the sequence of coverage metrics to the SAR generator.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the computer-executable instructions further cause the processor device to update the coverage threshold to a value of a highest final coverage metric of the subset of the plurality of new trajectories.
