# US 2023/0409332 A1 · Devices transferring cache lines, including metadata on external links

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0409332 A1
- Document ID: US20230409332A1
- Status: Published application
- Kind: A1
- Application number: 17/841,850
- Filed: 2022-06-16
- Published: 2023-12-21
- Earliest claimed: 2022-06-16
- Assignees: Ampere Computing LLC
- Applicants: Ampere Computing LLC
- Inventors: Robert James Safranek
- Web page: https://patentgrep.com/patent/US20230409332A1

## CPC

- G06F 9/30047: {Prefetch instructions; cache control instructions}
- G06F 9/3816: {Instruction alignment, e.g. cache line crossing}
- G06F 9/3836: {Instruction issuing, e.g. dynamic instruction scheduling or out of order instruction execution}
- G06F 9/3877: {using a secondary processor, e.g. coprocessor (peripheral processor G06F13/12)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In a processing system, a conversion circuit coupled to a system bus generates a flow control unit (FLIT) and provides the FLIT to a link interface circuit for transmission over an external link. The external link may be a peripheral component interface (PCI) express (PCIe) link coupled to an external device comprising a cache or memory. The conversion circuit generates the FLIT, including write information based on the write instruction, metadata associated with at least one cache line, and cache line chunks, including bytes of a cache line. The cache line chunks may be chunks of one of the at least one cache line. Including the metadata in the FLIT avoids separately transmitting the at least one cache line and the metadata over the external link, which improves performance compared to generating separate transmissions. In some examples, the FLIT corresponds to a compute express link (CXL) protocol FLIT.

## Claims

### Claim 1

A device comprising:
a system bus;
a link interface circuit coupled to an external link;
a conversion circuit coupled to the system bus and to the link interface circuit, the conversion circuit configured to, in response to receiving a write instruction, at least one first cache line, and metadata associated with the at least one first cache line on the system bus, provide a flow control unit (FLIT) to the link interface circuit for transmission on the external link, the FLIT comprising:
a first header slot comprising write information based on the write instruction for writing the at least one first cache line to an external memory coupled to the external link;
a first metadata slot comprising the metadata; and
at least two generic slots, each comprising a cache line chunk, each cache line chunk comprising bytes of a cache line.

### Claim 2 (depends on 1)

The device of claim 1, wherein the conversion circuit is further configured to provide the FLIT comprising, sequentially:
the first header slot comprising a first slot;
the first metadata slot comprising a second slot; and
the at least two generic slots comprising a third slot and the fourth slot,
wherein each of the first header slot, the first metadata slot, and the at least two generic slots comprise a first number of bytes.

### Claim 3 (depends on 2)

The device of claim 2, wherein the cache line chunk in each of the at least two generic slots comprises the first number of bytes of a first cache line of the at least one first cache line.

### Claim 4 (depends on 2)

The device of claim 2, wherein the conversion circuit is further configured to provide the FLIT comprising, in the at least two generic slots, a second cache line chunk of a second cache line of the at least one first cache line.

### Claim 5 (depends on 4)

The device of claim 4, wherein the conversion circuit is further configured to provide the FLIT comprising, in the at least two generic slots, a third cache line chunk of a third cache line of the at least one first cache line.

### Claim 6 (depends on 1)

The device of claim 1, wherein the conversion circuit is further configured to provide, sequentially, in the FLIT:
the first header slot;
a first plurality of the at least two generic slots, each comprising a cache line chunk of a cache line other than the at least one first cache line; and
the first metadata slot.

### Claim 7 (depends on 6)

The device of claim 6, wherein the conversion circuit is further configured to provide, sequentially, in the FLIT:
a second plurality of the at least two generic slots, each comprising a data chunk of one of the at least one first cache line.

### Claim 8 (depends on 1)

The device of claim 1, wherein the conversion circuit is further configured to provide a second FLIT comprising a plurality of data slots, each comprising a cache line chunk of one of the at least one first cache line.

### Claim 9 (depends on 8)

The device of claim 8, wherein the plurality of data slots each comprising a cache line chunk of a second one of the at least one first cache line.

### Claim 10 (depends on 1)

The device of claim 1, wherein:
the link interface circuit comprises a peripheral component interface (PCI) express (PCIe) physical link; and
the conversion circuit is further configured to generate the FLIT comprising a compute express link (CXL) FLIT.

### Claim 11 (depends on 10)

The device of claim 10, wherein the link interface circuit is further configured to provide a transaction layer function and a link layer function of the CXL.mem protocol.

### Claim 12 (depends on 11)

The device of claim 11, wherein the link interface circuit is further configured to provide a transaction layer function and a link layer function of the CXL.cache protocol.

### Claim 13 (depends on 1)

The device of claim 1, wherein the conversion circuit is further configured to provide in each metadata slot:
at least one metadata field corresponding to one of the at least one first cache line; and
a valid bit corresponding to a metadata field and indicating whether metadata in the corresponding metadata field is valid.

### Claim 14 (depends on 1)

The device of claim 1, wherein:
each of the first header slot, the first metadata slot, and the at least two generic slots comprise sixteen (16) bytes;
the at least two generic slots consist of two generic slots; and
the FLIT further comprises:
a two-byte protocol identifier; and
a two-byte error detection code.

### Claim 15 (depends on 1)

The device of claim 1, wherein:
each of the first header slot, the first metadata slot, and the at least two generic slots comprise sixteen (16) bytes;
the at least two generic slots comprise at least (12) slots; and
the FLIT further comprises:
a protocol identifier; and
an error detection field.

### Claim 16 (depends on 1)

The device of claim 1, wherein the conversion circuit is further configured to:
receive a read instruction from the system bus; and
in response to receiving the read instruction, providing a read FLIT to the link interface circuit, the read FLIT comprising:
a second header slot comprising read information for reading at least a second cache line on the external link; and
at least three generic slots.

### Claim 17 (depends on 16)

The device of claim 16, the conversion circuit further configured to receive a second FLIT from the link interface circuit, the second FLIT comprising:
a second header slot comprising read response information for at least the second cache line;
a second metadata slot comprising second metadata associated with the at least a second cache line; and
at least two generic slots comprising second cache line chunks of one of the at least a second cache line.

### Claim 18 (depends on 17)

The device of claim 17, wherein the conversion circuit is further configured to:
receive in the second metadata slot, at least one second metadata field, each of the at least one second metadata field corresponding to one of the at least one second cache line and comprising a corresponding valid bit; and
determine whether metadata in each of the at least one second metadata fields is valid based on the corresponding valid bit.

### Claim 19 (depends on 1)

The device of claim 1, further comprising at least one of a host processing device and an accelerator device comprising a cache or memory.

### Claim 20 (depends on 1)

The device of claim 1, further integrated into a device selected from a group consisting of: a server, a computer, a portable computer, a desktop computer, a mobile computing device, a set top box, an entertainment unit, a navigation device, a communications device, a fixed location data unit, a mobile location data unit, a global positioning system (GPS) device, a mobile phone, a cellular phone, a smartphone, a session initiation protocol (SIP) phone, a tablet, a phablet, a wearable computing device (e.g., a smartwatch, a health or fitness tracker, eyewear, etc.), a personal digital assistant (PDA), a monitor, a computer monitor, a television, a tuner, a radio, a satellite radio, a music player, a digital music player, a portable music player, a digital video player, a video player, a digital video disc (DVD) player, a portable digital video player, an automobile, a vehicle component, avionics systems, a drone, and a multicopter.

### Claim 21

A method, in a device, of a conversion circuit providing a flow control unit (FLIT) to a link interface circuit of the device, the method comprising:
receiving, in a conversion circuit, a write instruction, at least a first cache line, and metadata associated with the at least a first cache line on a system bus;
generating a FLIT comprising:
a first header slot comprising write information based on the write instruction for transmitting the at least one first cache line on an external link coupled to the link interface circuit;
a first metadata slot comprising the metadata; and
at least two generic slots comprising cache line chunks, each cache line chunk comprising bytes of a cache line; and
providing the FLIT to the link interface circuit for transmission on the external link.

### Claim 22

A device comprising:
data storage;
a link interface circuit coupled to an external link;
a conversion circuit coupled to the link interface circuit and the data storage, the conversion circuit configured to:
receive, from the link interface circuit, a read flow control unit (FLIT) comprising a read instruction requesting at least one cache line from the data storage;
generating a response FLIT comprising:
a header slot comprising response information based on the read instruction for the at least one first cache line;
a first metadata slot comprising metadata associated with the at least one first cache line; and
at least two generic slots, each comprising a cache line chunk, each cache line chunk comprising bytes of one of the at least one first cache line.
