# US 2024/0241641 A1 · Packet routing between memory devices and related apparatuses, methods, and memory systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0241641 A1
- Document ID: US20240241641A1
- Status: Published application
- Kind: A1
- Application number: 18/618,966
- Filed: 2024-03-27
- Published: 2024-07-18
- Earliest claimed: 2014-05-09
- Assignees: Micron Technology, Inc.
- Applicants: Micron Technology, Inc.
- Inventors: John D. Leidel
- Web page: https://patentgrep.com/patent/US20240241641A1

## CPC

- G06F 3/0607: {by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device}
- G06F 3/0659: {Command handling arrangements, e.g. command buffers, queues, command scheduling}
- G06F 3/0685: {Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays}
- G06F 13/1621: {by maintaining request order}
- G06F 13/1657: {Access to multiple memories}
- G06F 13/1673: {using buffers}
- G06F 13/1684: {using multiple buses}
- G06F 13/40: Bus structure {(for computer networks G06F15/163; for optical bus networks H04B10/25)}
- G06F 13/4022: {using switching circuits, e.g. switching matrix, connection or expansion network (G06F13/4009 takes precedence)}
- G06F 13/4234: {being a memory bus}
- G11C 7/1075: {for multiport memories each having random access ports and serial ports, e.g. video RAM}
- G11C 21/00: Digital stores in which the information circulates {continuously}(stepwise G11C19/00)
- G06F 2212/205: Hybrid memory, e.g. using both volatile and non-volatile memory
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11C: STATIC STORES (semiconductor memory devices H10B)

## Abstract

An interconnect system includes host devices, one or more memory devices, and a routing system to connect the host devices and the one or more memory devices. Respective ones of the host devices include an interface to communicate packet requests over respective packetized links. Respective ones of the one or more memory devices include an interface to receive and respond to the packet requests over the respective packetized links. The routing system includes devices interconnected in a routing topology. Respective ones of the devices include a switch and interfaces. The routing system is to route the packet requests and responses between the host devices and respective memory device destinations over the respective packetized links.

## Claims

### Claim 1

An interconnect system comprising:
host devices, respective ones of the host devices including an interface to communicate packet requests over respective packetized links;
one or more memory devices, respective ones of the one or more memory devices including an interface to receive and respond to the packet requests over the respective packetized links; and
a routing system to connect the host devices and the one or more memory devices, the routing system comprising devices interconnected in a routing topology, respective ones of the devices comprising a switch and interfaces, the routing system to route the packet requests and responses between the host devices and respective memory device destinations over the respective packetized links.

### Claim 2 (depends on 1)

The interconnect system of claim 1, wherein the routing topology comprises one of a chain topology, a ring topology, a modified ring topology, a mesh topology, or a crossbar topology.

### Claim 3 (depends on 1)

The interconnect system of claim 1, wherein the routing topology comprises a mesh topology.

### Claim 4 (depends on 1)

The interconnect system of claim 1, wherein the routing system comprising the devices includes a hub.

### Claim 5 (depends on 1)

The interconnect system of claim 1, wherein the devices interconnected in the routing topology are to create multiple routing paths to route the packet requests and responses over the respective packetized links.

### Claim 6 (depends on 1)

The interconnect system of claim 1, wherein the devices of the routing system are to receive routing configuration information to route the packet requests and responses over the respective packetized links.

### Claim 7 (depends on 1)

The interconnect system of claim 1, wherein the interconnect system is to provide the host devices with access to memory of the one or more memory devices, and the packet requests comprise read requests and write requests to the memory of the one or more memory devices.

### Claim 8 (depends on 1)

The interconnect system of claim 1, wherein the interconnect system is to provide the host devices with shared access to memory of the one or more memory devices, the respective ones of the host devices include a local memory comprising a cache, and the respective ones of the host devices are to receive cache coherency request packets over the packetized links, the cache coherency request packets comprising coherency invalidations to support cache coherency.

### Claim 9 (depends on 1)

The interconnect system of claim 1, wherein the respective ones of the devices of the routing system comprise semiconductor memory devices.

### Claim 10 (depends on 1)

The interconnect system of claim 1, wherein the one or more memory devices include a memory device comprising a crossbar switch and multiple memory dies.

### Claim 11 (depends on 1)

The interconnect system of claim 1, wherein the respective ones of the host devices comprise System on a Chip (SoC) devices.

### Claim 12 (depends on 1)

The interconnect system of claim 1, wherein the respective ones of the one or more memory devices further include a controller, and the respective ones of one or more memory devices are to:
receive a packet request through an interface of the memory device;
pass the received packet request to the controller responsive to a determination that the received packet request indicates the memory device as a destination of the received packet request; and
pass the received packet through another interface of the memory device toward another memory device responsive to a determination that the received packet request indicates the other memory device as the destination of the received packet request.

### Claim 13 (depends on 1)

The interconnect system of claim 1, wherein the respective ones of the devices of the routing system further include a controller, and the respective ones of the devices of the routing system are to:
receive a packet request through an interface of the device;
pass the received packet request through a first other interface of the device toward a first other device responsive to a determination that the received packet request indicates the first other device as a destination of the received packet request; and
pass the received packet request through a second other interface of the device toward a second other device responsive to a determination that the received packet request indicates the second other device as the destination of the received packet request.

### Claim 14

A method for interconnecting host devices and one or more memory devices, the host devices each including an interface to communicate packet requests over respective packetized links, the one or more memory devices each including an interface to receive and respond to the packet requests over the respective packetized links, the method comprising:
receiving routing configuration information at devices of a routing system, the devices of the routing system interconnected in a routing topology, respective ones of the devices comprising a switch and interfaces; and
routing packet requests and responses between the host devices and respective memory device destinations over the respective packetized links based on the routing configuration information.

### Claim 15 (depends on 14)

The method of claim 14, wherein the routing topology comprises a mesh topology.

### Claim 16 (depends on 14)

The method of claim 14, wherein the devices of the routing system include a hub.

### Claim 17 (depends on 14)

The method of claim 14, wherein the devices interconnected in the routing topology are to create multiple routing paths to route the packet requests and responses over the respective packetized links.

### Claim 18 (depends on 14)

The method of claim 14, wherein the one or more memory devices include a memory device comprising a crossbar switch and multiple memory dies.

### Claim 19 (depends on 14)

The method of claim 14, wherein each one of the host devices includes a local memory comprising a cache, the method comprising:
conveying cache coherency request packets over the packetized links to respective host devices, the cache coherency request packets comprising coherency invalidations to support cache coherency.

### Claim 20

An interconnect system comprising:
host devices including a first host device and a second host device, the first host device including a first interface to communicate packet requests over a first packetized link, the second host device including a second interface to communicate packet requests over a second packetized link;
memory devices including a first memory device and a second memory device, the first memory device including a first interface to receive and respond to the packet requests over the first packetized link, the second memory device including a second interface to receive and respond to packet requests over the second packetized link; and
a device of a routing system, the device of the routing system to route the packet requests and responses between the host devices and respective memory device destinations, the device comprising a switch and interfaces, the interfaces of the device including a first interface of the device to connect to the first interface of the first host device, a second interface of the device to connect to the second interface of the second host device, a third interface of the device to connect to the first interface of the first memory device, and a fourth interface of the device to connect to the second interface of the second memory device.

### Claim 21 (depends on 20)

The interconnect system of claim 20, wherein the device of the routing system comprises a hub.

### Claim 22 (depends on 20)

The interconnect system of claim 20, wherein the device of the routing system is to receive routing configuration information to route the packet requests and responses between the host devices and the respective memory device destinations.

### Claim 23 (depends on 20)

The interconnect system of claim 20, wherein the routing system includes the device and additional devices interconnected in a mesh topology.

### Claim 24 (depends on 20)

The interconnect system of claim 20, wherein the interconnect system is to provide the host devices with shared access to memory of the memory devices, each one of the first host device and the second host device includes a local memory comprising a cache, and each one of the first host device and the second host device is to receive cache coherency request packets over the packetized links, the cache coherency request packets comprising coherency invalidations to support cache coherency.
