# US 2025/0165689 A1 · Adaptive test generation for functional coverage closure

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0165689 A1
- Document ID: US20250165689A1
- Status: Published application
- Kind: A1
- Application number: 18/840,532
- Filed: 2023-02-28
- Published: 2025-05-22
- Earliest claimed: 2022-02-28
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Azade Nova; Qijing Huang; Hamid Shojaei; Azalia Mirhoseini; Chian-min Richard Ho
- Web page: https://patentgrep.com/patent/US20250165689A1

## CPC

- G06F 30/3308: using simulation
- G06Q 10/04: Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" (market predictions or forecasting for commercial activities G06Q30/0202)
- G06F 30/27: using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Methods, systems, and apparatus for adaptively generating test stimuli for testing a hardware design for an integrated circuit. In one aspect, a system comprises one or more computers configured to obtain graph data representing a coverage dependency graph associated with a hardware design for an integrated circuit. At each of a plurality of simulation cycles, the one or more computers obtain a set of coverage statistics as of the simulation cycle and update respective distribution constraints for one or more random variables in a set of random variables using the coverage dependency graph and the coverage statistics. After the updating, the one or more computers generate one or more test stimuli by, for each test stimulus, sampling a respective value for each of the random variables based on the respective distribution constraints. The one or more computers simulate a performance of the integrated circuit for each of the test stimuli.

## Claims

### Claim 1

A method performed by one or more computers, the method comprising:
obtaining graph data representing a coverage dependency graph associated with a hardware design for an integrated circuit; and
at each of a plurality of simulation cycles, performing operations comprising:
obtaining a set of coverage statistics as of the simulation cycle;
updating, using the coverage dependency graph and the coverage statistics, respective distribution constraints for one or more random variables in a set of random variables;
after the updating, generating one or more test stimuli by, for each test stimulus, sampling a respective value for each of the random variables in the set of random variables based on the respective distribution constraints; and
simulating a performance of the integrated circuit for each of the test stimuli.

### Claim 2 (depends on 1)

The method of claim 1, wherein obtaining graph data representing a coverage dependency graph associated with a hardware design for an integrated circuit comprises:
extracting the coverage dependency graph from a testbench for design verification of the hardware design.

### Claim 3 (depends on 1)

The method of claim 1, wherein updating, using the coverage dependency graph and the coverage statistics, respective distribution constraints for one or more random variables in a set of random variables comprises:
identifying one or more uncovered coverpoints in the coverage dependency graph;
for each uncovered coverpoint:
determining, using the graph data, a set of random variables that relate to the uncovered coverpoint and a set of coveritem nodes for each random variable; and for each coveritem node and for each random variable, determining whether to update a weight assigned to the coveritem node in the distribution constraints for the random variable based on whether the coveritem node is covered according to the coverage statistics.

### Claim 4 (depends on 3)

The method of claim 3, wherein updating, using the coverage dependency graph and the coverage statistics, respective distribution constraints for one or more random variables in a set of random variables further comprises:
for each coveritem node and for each random variable, increasing a weight assigned to the coveritem node in the distribution constraints for the random variable based on determining that the coveritem node is not covered according to the coverage statistics.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
after performing the plurality of simulation cycles, fabricating the integrated circuit according to the hardware design.

### Claim 6 (depends on 1)

The method of claim 1, the operations further comprising:
updating the set of coverage statistics after performing the simulation cycle.

### Claim 7

(canceled)

### Claim 8

(canceled)

### Claim 9

A system comprising one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
obtaining graph data representing a coverage dependency graph associated with a hardware design for an integrated circuit; and
at each of a plurality of simulation cycles, performing operations comprising:
obtaining a set of coverage statistics as of the simulation cycle;
updating, using the coverage dependency graph and the coverage statistics, respective distribution constraints for one or more random variables in a set of random variables;
after the updating, generating one or more test stimuli by, for each test stimulus, sampling a respective value for each of the random variables in the set of random variables based on the respective distribution constraints; and
simulating a performance of the integrated circuit for each of the test stimuli.

### Claim 10 (depends on 9)

The system of claim 9, wherein obtaining graph data representing a coverage dependency graph associated with a hardware design for an integrated circuit comprises:
extracting the coverage dependency graph from a testbench for design verification of the hardware design.

### Claim 11 (depends on 9)

The system of claim 9, wherein updating, using the coverage dependency graph and the coverage statistics, respective distribution constraints for one or more random variables in a set of random variables comprises:
identifying one or more uncovered coverpoints in the coverage dependency graph;
for each uncovered coverpoint:
determining, using the graph data, a set of random variables that relate to the uncovered coverpoint and a set of coveritem nodes for each random variable; and for each coveritem node and for each random variable, determining whether to update a weight assigned to the coveritem node in the distribution constraints for the random variable based on whether the coveritem node is covered according to the coverage statistics.

### Claim 12 (depends on 11)

The system of claim 11, wherein updating, using the coverage dependency graph and the coverage statistics, respective distribution constraints for one or more random variables in a set of random variables further comprises:
for each coveritem node and for each random variable, increasing a weight assigned to the coveritem node in the distribution constraints for the random variable based on determining that the coveritem node is not covered according to the coverage statistics.

### Claim 13 (depends on 9)

The system of claim 9, further comprising:
after performing the plurality of simulation cycles, fabricating the integrated circuit according to the hardware design.

### Claim 14 (depends on 9)

The system of claim 9, the operations further comprising:
updating the set of coverage statistics after performing the simulation cycle.

### Claim 15

One or more non-transitory computer storage media encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
obtaining graph data representing a coverage dependency graph associated with a hardware design for an integrated circuit; and
at each of a plurality of simulation cycles, performing operations comprising:
obtaining a set of coverage statistics as of the simulation cycle;
updating, using the coverage dependency graph and the coverage statistics, respective distribution constraints for one or more random variables in a set of random variables;
after the updating, generating one or more test stimuli by, for each test stimulus, sampling a respective value for each of the random variables in the set of random variables based on the respective distribution constraints; and
simulating a performance of the integrated circuit for each of the test stimuli.

### Claim 16 (depends on 15)

The non-transitory computer storage media of claim 15, wherein obtaining graph data representing a coverage dependency graph associated with a hardware design for an integrated circuit comprises:
extracting the coverage dependency graph from a testbench for design verification of the hardware design.

### Claim 17 (depends on 15)

The non-transitory computer storage media of claim 15, wherein updating, using the coverage dependency graph and the coverage statistics, respective distribution constraints for one or more random variables in a set of random variables comprises:
identifying one or more uncovered coverpoints in the coverage dependency graph;
for each uncovered coverpoint:
determining, using the graph data, a set of random variables that relate to the uncovered coverpoint and a set of coveritem nodes for each random variable; and for each coveritem node and for each random variable, determining whether to update a weight assigned to the coveritem node in the distribution constraints for the random variable based on whether the coveritem node is covered according to the coverage statistics.

### Claim 18 (depends on 17)

The non-transitory computer storage media of claim 17, wherein updating, using the coverage dependency graph and the coverage statistics, respective distribution constraints for one or more random variables in a set of random variables further comprises:
for each coveritem node and for each random variable, increasing a weight assigned to the coveritem node in the distribution constraints for the random variable based on determining that the coveritem node is not covered according to the coverage statistics.

### Claim 19 (depends on 15)

The non-transitory computer storage media of claim 15, further comprising:
after performing the plurality of simulation cycles, fabricating the integrated circuit according to the hardware design.

### Claim 20 (depends on 15)

The non-transitory computer storage media of claim 15, the operations further comprising:
updating the set of coverage statistics after performing the simulation cycle.
