# US 2022/0286135 A1 · Dual-mode operation of application specific integrated circuits

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0286135 A1
- Document ID: US20220286135A1
- Status: Published application
- Kind: A1
- Application number: 17/634,744
- Filed: 2020-08-14
- Published: 2022-09-08
- Earliest claimed: 2019-08-14
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Reiner Pope
- Web page: https://patentgrep.com/patent/US20220286135A1

## CPC

- H03K 19/1774: {for global signals, e.g. clock, reset}
- G06F 15/7867: {with reconfigurable architecture}
- G06N 3/063: using electronic means
- H03K 19/17748: Structural details of configuration resources
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- H03K: PULSE TECHNIQUE (measuring pulse characteristics G01R; modulating sinusoidal oscillations with pulses H03C; transmission of digital information H04L; discriminator circuits detecting phase difference between two signals by counting or integrating cycles of oscillation H03D3/04; automatic control, starting, synchronisation or stabilisation of generators of electronic oscillations or pulses where the type of generator is irrelevant or unspecified H03L; coding, decoding or code conversion, in general H03M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

A method for operating an integrated circuit chip including multiple tiles (202a-202d) includes determining a configuration for the tiles for execution of a computation. When the configuration for the tiles satisfies a first criterion, the integrated circuit is operated in a first mode, including concurrently receiving respective input data (208a, 208b) at each of the tiles (202a-202d). When the configuration for the tiles satisfies a second criterion, the integrated circuit is operated in a second mode, including: at a first time, concurrently receiving respective first input data (208a, 208b) at each tile (202a, 202b) of a first group of tiles; at the first time, storing respective second input data (208a, 208b) in each of multiple delay registers (212a, 212b), each delay register corresponding to a tile (202c, 202d) of a second group of tiles; at a second time, releasing the second input data from the delay registers (212a, 212b) and receiving the released respective second input data at each tile (202c, 202d) of the second group of tiles.

## Claims

### Claim 1

A method for operating an integrated circuit chip comprising multiple tiles, the method comprising:
determining a configuration for the tiles of the integrated circuit for execution of a computation;
when the configuration for the tiles satisfies a first criterion, operating the integrated circuit in a first mode, including:
concurrently receiving respective input data for the computation at each of the tiles of the integrated circuit; and
when the configuration for the tiles satisfies a second criterion, operating the integrated circuit in a second mode, including:
at a first time, concurrently receiving respective first input data for the computation at each tile of a first group of tiles of the integrated circuit;
at the first time, storing respective second input data for the computation in each of multiple delay registers, each delay register corresponding to a tile of a second group of tiles of the integrated circuit; and
at a second time, releasing the second input data from the delay registers and receiving the released respective second input data at each tile of the second group of tiles.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining a configuration for the tiles for execution of the computation comprises determining one or more of a number and a percentage of tiles operable for executing the computation.

### Claim 3 (depends on 2)

The method of claim 2, wherein:
the first criterion comprises the number or percentage of tiles operable for executing the computation being less than a threshold number or percentage, and
the second criterion comprises the number or percentage of tiles operable for executing the computation being greater than a threshold number or percentage.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining a configuration for the tiles for execution of the computation comprises determining a number of columns of tiles operable for executing the computation.

### Claim 5 (depends on 4)

The method of claim 4, wherein:
the first criterion comprises the number or percentage of columns of tiles operable for executing the computation being less than a threshold number or percentage, and
the second criterion comprises the number or percentage of columns of tiles operable for executing the computation being greater than a threshold number or percentage.

### Claim 6 (depends on 1)

The method of claim 1, comprising determining whether the configuration for the tiles satisfies the first criterion or the second criterion.

### Claim 7 (depends on 1)

The method of claim 1, wherein operating the integrated circuit in a second mode comprises operating a multiplexer to enable the delay registers.

### Claim 8 (depends on 7)

The method of claim 7, wherein operating the integrated circuit in a first mode comprises operating the multiplexer to disable the delay registers.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first time is a first clock cycle and the second time is the next clock cycle.

### Claim 10 (depends on 1)

The method of claim 1, wherein concurrently receiving respective input data in the first mode comprises receiving a vector of input data at each tile.

### Claim 11 (depends on 1)

The method of claim 1, wherein operating the integrated circuit in a first mode comprises operating each of the tiles of the integrated circuit to process the respective input data.

### Claim 12 (depends on 1)

The method of claim 1, wherein operating the integrated circuit in a second mode comprises:
operating each of the tiles of the first group to process the respective first input data; and
operating each of the tiles of the second group to process the respective second input data released from the delay register.

### Claim 13 (depends on 1)

The method of claim 1, comprising receiving an indication of the first criterion and the second criterion from a compiler.

### Claim 14

An integrated circuit comprising:
multiple delay registers each connected to a corresponding first bus line;
multiple tiles, each tile of a first group of the tiles connected to a corresponding second bus line, and each tile of a second group of the tiles connected to a corresponding one of the first bus lines; and
a controller configured to:
determine a configuration of the first and second groups of tiles for execution of a computation;
when the configuration for the tiles satisfies a first criterion, control the integrated circuit to operate in a first mode in which respective input data for the computation is concurrently received at each of the multiple tiles via the first and second bus lines; and
when the configuration for the tiles satisfies a second criterion, control the integrated circuit to operate in a second mode, in which:
at a first time, respective first input data for the computation is concurrently received at each tile of the first group of tiles;
at the first time, second input data for the computation is stored in each of the delay registers; and
at a second time, the second input data is released from the delay registers and the respective second input data is received at each tile of the second group of tiles.

### Claim 15 (depends on 14)

The integrated circuit of claim 14, comprising a multiplexer connected to each second bus line.

### Claim 16 (depends on 14)

The integrated circuit of claim 14, wherein the tiles are arranged in a two-dimensional array.

### Claim 17 (depends on 14)

The integrated circuit of claim 14, wherein the integrated circuit comprises an application-specific integrated circuit (ASIC).

### Claim 18 (depends on 14)

The integrated circuit of claim 14, wherein each tile comprises:
multiple computational cells;
a memory coupled to the computational cells; and
controllable bus lines configured to convey data to or from the tile.

### Claim 19 (depends on 14)

The integrated circuit of claim 14, wherein at least one of the tiles is configured to act as the controller.

### Claim 20 (depends on 14)

The integrated circuit of claim 14, comprising a communication interface.
