# US 2025/0165411 A1 · Transfer data in a memory system with artificial intelligence mode

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0165411 A1
- Document ID: US20250165411A1
- Status: Published application
- Kind: A1
- Application number: 19/027,483
- Filed: 2025-01-17
- Published: 2025-05-22
- Earliest claimed: 2019-08-29
- Assignees: Micron Technology, Inc.
- Applicants: Micron Technology, Inc.
- Inventors: Alberto Troia
- Web page: https://patentgrep.com/patent/US20250165411A1

## CPC

- G06F 13/1678: {using bus width}
- G06F 12/0284: {Multiple user address space allocation, e.g. using different base addresses (interprocessor communication G06F15/163)}
- G06F 15/7821: {Tightly coupled to memory, e.g. computational memory, smart memory, processor in memory}
- G06F 18/2148: {characterised by the process organisation or structure, e.g. boosting cascade}
- G06N 3/0499: Feedforward networks
- G06N 3/06: Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N 3/063: using electronic means
- G06N 3/08: Learning methods
- G11C 7/1006: {Data managing, e.g. manipulating data before writing or reading out, data bus switches or control circuits therefor}
- G11C 7/1048: {Data bus control circuits, e.g. precharging, presetting, equalising}
- G11C 7/22: Read-write [R-W] timing or clocking circuits; Read-write [R-W] control signal generators or management
- G11C 11/409: Read-write [R-W] circuits
- G11C 11/54: using elements simulating biological cells, e.g. neuron
- G06F 12/0207: {with multidimensional access, e.g. row/column, matrix}
- G06F 12/0238: {Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory}
- G06F 2212/1024: Latency reduction
- G06F 2212/7208: Multiple device management, e.g. distributing data over multiple flash devices
- G11C 11/4096: Input/output [I/O] data management or control circuits, e.g. reading or writing circuits, I/O drivers or bit-line switches
- G11C 2207/2236: Copy
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G11C: STATIC STORES (semiconductor memory devices H10B)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

The present disclosure includes apparatuses and methods related to transferring data in a memory system with an artificial intelligence (AI) mode. An apparatus can receive a command indicating that the apparatus operate in an artificial intelligence (AI) mode, a command to perform AI operations using an AI accelerator based on a status of a number of registers, and a command to transfer data between memory devices that are performing an AI operation. The memory system can transfer output data of a layer and/or neuron of an AI operation from a first memory device to a second memory device; and the second memory device can use the output data transferred to the second memory device as input data for a subsequent layer and/or neuron of the AI operation.

## Claims

### Claim 1

An apparatus, comprising:
a controller;
a first memory device coupled to the controller, wherein the first memory device includes a first artificial intelligence (AI) accelerator configured as part of a neural network and includes a first number of memory arrays; and
a second memory device coupled to the controller, wherein the second memory device includes a second artificial intelligence (AI) accelerator configured as part of the neural network and includes a second number of memory arrays, and wherein the first memory device and the second memory device are configured to:
store an input or a weight associated with the neural network,
wherein the input or the weight are represented as data values stored in the first memory device;
execute a training or inference operation on the first memory device;
transfer data from the first memory device to the second memory device; and
continue to execute the training or inference operation on the second memory device using the data transferred from the first memory device to the second memory device.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the data transferred from the first memory device to the second memory device is an output of the training or inference operation executed on the first memory device.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the data transferred from the first memory device to the second memory device is an input of the training or inference operation for a first layer executed on the second memory device.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the first memory device and the second memory device are selected by the controller to transfer the data on a bus shared by the number of memory devices.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein a command enables the first and second memory devices to enter an artificial intelligence (AI) mode to perform the training or inference operation.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the first memory device is configured to transfer the data to the second memory device in response to the first memory device completing a first portion of the training or inference operation on a first layer.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the second memory device is configured to complete the training or inference operation on the first layer in response to receiving the data from the first memory device.

### Claim 8

A system, comprising:
a host; and
a memory system, wherein the memory system includes
a controller,
a first memory device coupled to the controller, wherein the first memory device includes a first artificial intelligence (AI) accelerator configured as part of a neural network and includes a first number of memory arrays, and
a second memory device coupled to the controller, wherein the second memory device includes a second artificial intelligence (AI) accelerator configured as part of the neural network and includes a second number of memory arrays, and wherein the first memory device and the second memory device are configured to:
execute training operation by performing a first portion of the training operation for a first layer within the neural network at the first AI accelerator on the first memory device wherein the first portion of the training operation comprises combining a first input or a first weight, or both, represented as one or more data values stored within the first memory device with another input or another weight, or both, represented as other data stored within the first memory device or received from another memory device;
transfer an output of the first portion of the training operation from the first memory device to the second memory device; and
execute the training operation by performing a second portion of the training operation for the first layer within the neural network at the second AI accelerator on the second memory device wherein the second portion of the training operation for the first layer comprises combining the output of the first portion of the training operation as an input of the second portion of the training operation with an additional input or an additional weight, or both, represented as additional data stored within the second memory device.

### Claim 9 (depends on 8)

The system of claim 8, wherein the memory devices are configured to execute a third portion of the training operation on the first memory device.

### Claim 10 (depends on 9)

The system of claim 9, wherein the third portion of the training operation is executed while the second portion of the training operation is executed.

### Claim 11 (depends on 8)

The system of claim 8, wherein the memory devices are configured to transfer an output of the second portion of the training operation from the second memory device to the first memory device and to the host.

### Claim 12 (depends on 11)

The system of claim 11, wherein the memory devices are configured to execute a third portion of the training operation on the first memory device using the output of the second portion of the training operation as an input of the third portion of the training operation.

### Claim 13 (depends on 8)

The system of claim 8, wherein the memory devices are configured to transfer neural network data from the first memory device to the second memory device.

### Claim 14 (depends on 8)

The system of claim 8, wherein the memory devices are configured to transfer activation function data from the first memory device to the second memory device.

### Claim 15

A method, comprising:
storing an input or a weight associated with the neural network, wherein the input or the weight are represented as data values stored in a first memory device and wherein the first memory device includes a first artificial intelligence (AI) accelerator configured as part of a neural network and a first number of memory arrays;
executing a first portion of a training or inference operation on the first memory device;
transferring data from the first memory device to a second memory device, wherein the second memory device includes a second AI accelerator configured as part of the neural network and a second number of memory arrays; and
continuing to execute the training or inference operation on the second memory device using the data transferred from the first memory device to the second memory device.

### Claim 16 (depends on 15)

The method of claim 15, wherein transferring the data from the first memory device to the second memory device includes transferring an output of the training or inference operation.

### Claim 17 (depends on 15)

The method of claim 15, wherein continuing to execute the training operation includes using the data transferred from the first memory device to the second memory device as an input for a second portion of the training operation.

### Claim 18 (depends on 15)

The method of claim 15, further including transferring an output of the second portion of the training operation to a controller.

### Claim 19 (depends on 15)

The method of claim 15, wherein transferring data from the first memory device to the second memory device includes transferring neural network data for the training or inference operation.

### Claim 20 (depends on 15)

The method of claim 15, wherein transferring data from the first memory device to the second memory device includes transferring activation function data for the training or inference operation.
