# US 2023/0069360 A1 · System and method for energy-efficient implementation of neural networks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0069360 A1
- Document ID: US20230069360A1
- Status: Published application
- Kind: A1
- Application number: 17/984,722
- Filed: 2022-11-10
- Published: 2023-03-02
- Earliest claimed: 2017-02-24
- Assignees: Untether Ai Corporation
- Applicants: Untether Ai Corporation
- Inventors: William Martin SNELGROVE; Darrick WIEBE
- Web page: https://patentgrep.com/patent/US20230069360A1

## CPC

- G06N 3/063: using electronic means
- G06F 9/3887: {controlled by a single instruction for multiple data lanes [SIMD]}
- G06F 13/4022: {using switching circuits, e.g. switching matrix, connection or expansion network (G06F13/4009 takes precedence)}
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

A system and method for enhancing C*RAM, improving its performance for known applications such as video processing but also making it well suited to low-power implementation of neural nets. The required computing engine is decomposed into banks of enhanced C*RAM each having a SIMD controller, thus allowing operations at several scales simultaneously. Several configurations of suitable controllers are discussed, along with communication structures and enhanced processing elements.

## Claims

### Claim 1

A SIMD controller device having instruction memory configured to be loaded from memory of one or more banks, each bank including memory and a plurality of processing elements for performing parallel operations using the memory.

### Claim 2 (depends on 1)

The device of claim 1, further comprising a decompressor operable to stream variable-length data from the instruction memory and produce fixed-length representations of coefficients.

### Claim 3 (depends on 1)

The device of claim 1, further comprising a decompressor operable to stream variable-length data from the instruction memory and produce instruction sequences.

### Claim 4

A plurality of SIMD controller devices, each SIMD controller device including instruction memory configured to be loaded from memory of one or more banks, each bank including memory and a plurality of processing elements for performing parallel operations using the memory, wherein at least one of the SIMD controller device includes a decompressor operable to stream variable-length data from instruction memory and produce decompressed information that includes one or both of fixed-length representations of coefficients and instruction sequences, the plurality of SIMD controller devices interconnected by a column bus to share the decompressed information.
