# US 2015/0106574 A1 · Performing Processing Operations for Memory Circuits using a Hierarchical Arrangement of Processing Circuits

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0106574 A1
- Document ID: US20150106574A1
- Status: Published application
- Kind: A1
- Application number: 14/053,957
- Filed: 2013-10-15
- Published: 2015-04-16
- Earliest claimed: 2013-10-15
- Assignees: Advanced Micro Devices, Inc.
- Applicants: Advanced Micro Devices, Inc.
- Inventors: Nuwan S. Jayasena; Anton Chernoff
- Web page: https://patentgrep.com/patent/US20150106574A1

## CPC

- G06F 15/7821: {Tightly coupled to memory, e.g. computational memory, smart memory, processor in memory}
- G06F 3/061: {Improving I/O performance}
- G06F 3/0659: {Command handling arrangements, e.g. command buffers, queues, command scheduling}
- G06F 3/0673: {Single storage device}
- G06F 9/3881: {Arrangements for communication of instructions and data}
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

The described embodiments include a computing device that comprises at least one memory die having memory circuits and memory die processing circuits, and a logic die coupled to the at least one memory die, the logic die having logic die processing circuits. In the described embodiments, the memory die processing circuits are configured to perform memory die processing operations on data retrieved from or destined for the memory circuits and the logic die processing circuits are configured to perform logic die processing operations on data retrieved from or destined for the memory circuits.

## Claims

### Claim 1

A computing device, comprising:
at least one memory die comprising memory circuits and memory die processing circuits; and
a logic die coupled to the at least one memory die, the logic die comprising logic die processing circuits;
wherein the memory die processing circuits are configured to perform memory die processing operations on data retrieved from or destined for the memory circuits; and
wherein the logic die processing circuits are configured to perform logic die processing operations on data retrieved from or destined for the memory circuits.

### Claim 2 (depends on 1)

The computing device of claim 1, further comprising:
a processor die comprising a processor, wherein the processor die is coupled to the at least one memory die and the logic die;
wherein the processor is configured to send commands to at least one of the memory die processing circuits and the logic die processing circuits, the commands causing the at least one of the memory die processing circuits to perform at least one of the memory die processing operations and the logic die processing circuits to perform at least one of the logic die processing operations.

### Claim 3 (depends on 2)

The computing device of claim 2, wherein the logic die processing circuits are further configured to:
extract at least one command from the commands received from the processor; and
forward the extracted command to the at least one memory die as the commands from the processor that cause the memory die processing circuits to perform the memory die processing operations.

### Claim 4 (depends on 2)

The computing device of claim 2, wherein the at least one memory die is coupled in a stack with the logic die.

### Claim 5 (depends on 4)

The computing device of claim 4, further comprising:
a mounting device;
wherein the stack and the processor die are coupled to the mounting device so that the processor die is located beside the stack.

### Claim 6 (depends on 2)

The computing device of claim 2, wherein at least one of the memory die processing circuits and the logic die processing circuits are each configured to perform a corresponding predetermined subset of operations that the processor is configured to perform.

### Claim 7 (depends on 2)

The computing device of claim 2, wherein the at least one memory die further comprises:
a command memory element;
wherein, when sending a command to the memory die processing circuits, the processor is configured to write one or more corresponding values into the command memory element; and
wherein the memory die processing circuits are configured to interpret the one or more corresponding values to determine the command.

### Claim 8 (depends on 2)

The computing device of claim 2, wherein the logic die further comprises:
a command memory element;
wherein, when sending a command to the logic die processing circuits, the processor is configured to write one or more corresponding values into the command memory element; and
wherein the logic die processing circuits are configured to interpret the one or more corresponding values to determine the command.

### Claim 9 (depends on 2)

The computing device of claim 2, wherein, when sending commands to the memory die processing circuits or the logic die processing circuits, the processor is configured to:
send a program counter to the memory die processing circuits or the logic die processing circuits, the program counter indicating a location from where one or more instructions are retrieved for execution by the at least one of the memory die processing circuits and the logic die processing circuits, the instructions causing the at least one of the memory die processing circuits to perform at least one of the memory die processing operations and the logic die processing circuits to perform at least one of the logic die processing operations.

### Claim 10 (depends on 1)

The computing device of claim 1, wherein the logic die processing circuits are further configured to:
send commands to the memory die processing circuits that cause the memory die processing circuits to perform at least one of the memory die processing operations.

### Claim 11 (depends on 1)

The computing device of claim 1, wherein at least one of the memory die processing operations and the logic die processing operations comprise single-instruction-multiple-data operations.

### Claim 12

A memory die, comprising:
memory circuits;
a controller; and
memory die processing circuits;
wherein the memory die is configured to be coupled in a hierarchical processing arrangement with at least one of a logic die and a processor die; and
wherein the controller is configured to cause the memory die processing circuits to perform memory die processing operations on data retrieved from or destined for the memory circuits based on a command received from the logic die or the processor die.

### Claim 13 (depends on 12)

The memory die of claim 12, further comprising:
a command memory element in the memory die;
wherein the controller is configured to store information related to one or more commands received from the logic die or the processor die to the command memory element; and
wherein, when causing the memory die processing circuits to perform memory die processing operations, the controller is configured to cause the memory die processing circuits to perform the memory die processing operations based on information related to the one or more commands from the command memory element.

### Claim 14 (depends on 12)

The memory die of claim 12, wherein, when performing memory die processing operations on data retrieved from the memory circuits, the memory die processing circuits are configured to:
retrieve the data from the memory circuits;
perform the memory die processing operations on data in the memory die processing circuits based on the command received from the logic die or the processor die; and
after performing the operations on the data, at least one of:
storing the data in the memory circuits; and
sending the data to the logic die or the processor die.

### Claim 15 (depends on 12)

The memory die of claim 12, wherein, when performing memory die processing operations on data destined for the memory circuits, the memory die processing circuits are configured to:
receive the data from a functional block external to the memory die;
perform the memory die processing operations on data in the memory die processing circuits based on the command received from the logic die or the processor die; and
after performing the operations on the data, at least one of:
storing the data to the memory circuits; and
sending the data to the logic die or the processor die.

### Claim 16

A logic die, comprising:
a controller; and
logic die processing circuits;
wherein the logic die is configured to be coupled in a hierarchical processing arrangement with at least one of a memory die and a processor die; and
wherein the controller is configured to cause the logic die processing circuits to perform logic die processing operations on data retrieved from or destined for memory circuits in a memory die based on a command received from the processor die or the memory die.

### Claim 17 (depends on 16)

The logic die of claim 16, further comprising:
a command memory element in the logic die;
wherein the controller is configured to store information related to one or more commands received from the processor die or the memory die to the command memory element; and
wherein, when causing the logic die processing circuits to perform logic die processing operations, the controller is configured to cause the logic die processing circuits to perform the logic die processing operations based on information related to the one or more commands from the command memory element.

### Claim 18 (depends on 16)

The logic die of claim 16, wherein, when performing logic die processing operations on data retrieved from or destined for the memory circuits, the logic die processing circuits are configured to:
receive the data from a functional block external to the logic die;
perform the logic die processing operations on the data based on the command received from the processor die or the memory die; and
after performing the operations on the data, at least one of:
sending the data to a memory die to be stored in the memory circuits; or
sending the data to a functional block external to the logic die.

### Claim 19 (depends on 16)

The logic die of claim 16, wherein the controller is further configured to:
extract a second command from a command received from the processor die, the second command configured to cause memory die processing circuits in the memory die to perform corresponding memory die processing operations on data retrieved from or destined for the memory circuits; and
send the second command to the memory die.

### Claim 20

A method for performing processing operations in a computing device that comprises a memory die coupled to a logic die, the method comprising:
in one or more of memory die processing circuits on the memory die and logic die processing circuits on the logic die, performing processing operations on data retrieved from or destined for memory circuits in the memory die;
wherein performing the processing operations on the data comprises performing the processing operations based on a hierarchical arrangement of processing operations in which specified processing operations are performed in the memory die processing circuits and other processing operations are performed in the logic die processing circuits.

### Claim 21 (depends on 20)

The method of claim 20, further comprising:
in a processor, performing processing operations on data retrieved from or destined for memory circuits in the memory die;
wherein performing the processing operations on the data in the processor comprises performing the processing operations based on the hierarchical arrangement of processing operations in which some processing operations are performed in the memory die processing circuits and the logic die processing circuits, and other processing operations are performed in the processor.

### Claim 22 (depends on 21)

The method of claim 21, further comprising:
in the logic die processing circuits, receiving a command from the processor or the memory die processing circuits, the command configured to cause the logic die processing circuits to perform corresponding processing operations on the data.

### Claim 23 (depends on 22)

The method of claim 22, further comprising:
in the logic die processing circuits, extracting a second command from the received command and sending the extracted command to the memory die processing circuits, the command configured to cause the memory die processing circuits to perform corresponding processing operations on the data.

### Claim 24 (depends on 22)

The method of claim 22, further comprising:
in the logic die processing circuits, storing information from the command as control information and, based on the stored control information, configuring the logic die processing circuits to perform the processing operations.

### Claim 25 (depends on 21)

The method of claim 21, further comprising:
in the memory die processing circuits, receiving a command from the processor or the logic die processing circuits, the command configured to cause the memory die processing circuits to perform corresponding processing operations on the data.

### Claim 26 (depends on 25)

The method of claim 25, further comprising:
in the memory die processing circuits, storing information from the command as control information and, based on the stored control information, configuring the memory die processing circuits to perform the processing operations.

### Claim 27 (depends on 20)

The method of claim 20, wherein, in the hierarchical arrangement of processing operations, one or both of higher-bandwidth and lower-complexity processing operations are performed in the memory die processing circuits and one or both of lower-bandwidth and higher-complexity operations are performed in the logic die processing circuits.
