# US 2022/0277191 A1 · Synthetic Scaling Applied to Shared Neural Networks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0277191 A1
- Document ID: US20220277191A1
- Status: Published application
- Kind: A1
- Application number: 17/742,245
- Filed: 2022-05-11
- Published: 2022-09-01
- Earliest claimed: 2020-10-15
- Assignees: Gigantor Technologies Inc.
- Applicants: Gigantor Technologies Inc.
- Inventors: Mark Ashley Mathews
- Web page: https://patentgrep.com/patent/US20220277191A1

## CPC

- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G06N 3/063: using electronic means
- G06F 17/153: {Multidimensional correlation or convolution}
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A system processing a stream of input data ordered row by row from a data array has a first integrated circuit (IC) adapted to apply an aperture function to the stream of input data, to produce an output data stream, and a second IC coupled to the first IC, the second IC adapted to manage context from row to row, retaining partial values as computed by the aperture function for each column along a row, and providing the partial values back to the aperture function for subsequent rows as needed to complete output values.

## Claims

### Claim 1

A system processing a stream of input data ordered row by row from a data array, comprising:
a first integrated circuit (IC) adapted to apply an aperture function to the stream of input data, to produce an output data stream; and
a second IC coupled to the first IC, the second IC adapted to manage context from row to row, retaining partial values as computed by the aperture function for each column along a row, and providing the partial values back to the aperture function for subsequent rows as needed to complete output values.

### Claim 2 (depends on 1)

The system of claim 1 further comprising a first stream of input data from a first data array and a second stream of input data from a second data array, and an interleaving IC combining the first and second continuous data streams into a single interleaved data stream supplied to the aperture function IC.

### Claim 3 (depends on 1)

The system of claim 1 further comprising a sampler IC circuit receiving the stream of input data, producing a data stream scaled by a fixed ratio, the full-scale stream and the scaled stream combined by an interleaving IC to the aperture function IC, which produces an interleaved multi-scale output stream.

### Claim 4 (depends on 1)

The system of claim 1 wherein the interleaved output stream is from a first node of a convoluted neural network (CNN) and the interleaved output stream is processed in a second CNN node w/o further downscaling, by an unchanged aperture function IC.

### Claim 5

A system producing an interleaved, multi-scale sample stream from a full-scale 1:1 array stream, comprising:
a first FIFO circuit receiving and delaying the full-scale 1:1 array stream;
a U:1 sampler circuit receiving the full-scale 1:1 array stream, producing a U:1 downscaled stream;
a second FIFO circuit receiving and delaying the U:1 downscaled stream; and
a multiplexor circuit receiving output from the FIFO circuits, and producing an interleaved, multi-scale sample stream.

### Claim 6 (depends on 5)

The system of claim 5 further comprising a V:1 sampler circuit receiving the U:1 downscaled stream, producing a UV:1 downscaled stream, and a third FIFO circuit receiving the UV:1 downscaled stream, wherein the multiplexor circuit receives output from the FIFO circuits and produces an interleaved, multi-scale sample stream.

### Claim 7 (depends on 6)

The system of claim 6 further comprising a W:1 sampler circuit receiving the UV:1 downscaled stream, producing a UVW:1 downscaled stream, and a fourth FIFO circuit receiving the UVW:1 downscaled stream, wherein the multiplexor circuit receives output from the FIFO circuits and produces an interleaved, multi-scale sample stream.

### Claim 8 (depends on 7)

The system of claim 7 further comprising additional sampler circuits receiving additional downscaled streams, and additional FIFO circuits receiving the additional downscaled streams, wherein the multiplexor circuit receives output from the FIFO circuits and produces an interleaved, multi-scale sample stream.

### Claim 9 (depends on 6)

The system of claim 6 further comprising a W:1 sampler circuit receiving the U:1 downscaled stream, producing a UW:1 downscaled stream, and a fourth FIFO circuit receiving the UW:1 downscaled stream, wherein the syncopated multiplexor circuit receives output from the FIFO circuits and produces an interleaved, multi-scale sample stream.

### Claim 10 (depends on 9)

The system of claim 9 further comprising additional sampler circuits receiving additional downscaled streams, and additional FIFO circuits receiving the additional downscaled streams, wherein the syncopated multiplexor circuit receives output from the FIFO circuits and produces an interleaved, multi-scale sample stream.

### Claim 11 (depends on 5)

The system of claim 5 further comprising a 1:T sampler circuit receiving the 1:1 full scale stream, producing a 1:T upscaled sample stream, and a third FIFO circuit receiving the 1:T upscaled sample stream, the multiplexor circuit receiving output from the FIFO circuits, and producing an interleaved, multi-scale sample stream.

### Claim 12 (depends on 7)

The system of claim 7 wherein U, V, and W are integers.

### Claim 13 (depends on 11)

The system of claim 11 wherein T, U, V, and W are integers.

### Claim 14 (depends on 7)

The system of claim 7 wherein U, V, and W are each equal to 2.

### Claim 14 (depends on 11)

The system of claim 11 wherein T, U, V, and W are each equal to 2.

### Claim 15 (depends on 7)

The system of claim 7 wherein one or more of U, V, and W is a non-integer.

### Claim 16 (depends on 11)

The system of claim 11 wherein one or more of T, U, V, and W is a non-integer.

### Claim 17 (depends on 15)

The system of claim 15 wherein V and W are equal to 2 and U is equal to √{square root over (2)}.
