# US 2026/0064795 A1 · Content adaptive datatype

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0064795 A1
- Document ID: US20260064795A1
- Status: Published application
- Kind: A1
- Application number: 18/818,702
- Filed: 2024-08-29
- Published: 2026-03-05
- Earliest claimed: 2024-08-29
- Assignees: Advanced Micro Devices, Inc.; Xilinx, Inc.
- Applicants: Advanced Micro Devices, Inc.; Xilinx, Inc.
- Inventors: Alireza KHODAMORADI; Kristof DENOLF; Eric DELLINGER; Adam LI
- Web page: https://patentgrep.com/patent/US20260064795A1

## CPC

- G06F 17/10: Complex mathematical operations {(function generation by table look-up G06F1/03; evaluation of elementary functions by calculation G06F7/544)}
- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Embodiments herein describe a content adaptive array that can include different types of data. A compute unit can include conversion circuitry (e.g., upcast circuitry) that can identify the datatype(s) in the content adaptive array and convert the data so it has a desired datatype. For example, if the content adaptive array has both FP and INT, the upcast circuitry converts the data into the same datatype (e.g., FP8). If the array includes FP4 and FP8 (or INT4 and INT8), the upcast circuitry converts the data into FP8. This means the circuitry in the compute unit that performs the data operation (e.g., matrix multiplication) does not have to support many different types of datatypes.

## Claims

### Claim 1

A compute unit, comprising:
encoding circuitry configured to receive an array, the array comprising multiple data values and one or more type selector bits, the one or more type selector bits indicating a datatype of at least one of the data values;
a floating point (FP) converter comprising circuitry configured to convert FP data values in the array to a desired datatype;
an integer (INT) converter comprising circuitry configured to convert INT data values in the array to the desired datatype; and
compute circuitry configured to perform a compute operation using the multiple data values after being converted into the desired datatype.

### Claim 2 (depends on 1)

The compute unit of claim 1, wherein the FP converter and INT converter are configured to upcast the data values in the array from a first datatype to a higher precision datatype, wherein the compute circuitry comprises a matrix multiplier configured to perform multiplications when the data values are in the higher precision datatype.

### Claim 3 (depends on 2)

The compute unit of claim 2, wherein the array is transmitted from memory to the compute unit when the data values are the first datatype.

### Claim 4 (depends on 1)

The compute unit of claim 1, wherein the array comprises a shared minimum (min) value indicating a zero value of the data values in the array, the compute unit further comprising:
a zero adjustor comprising circuitry configured to adjust a mean of the data values based on the shared min value in the array.

### Claim 5 (depends on 4)

The compute unit of claim 4, wherein when detecting that two received input arrays have data values with the same datatypes, the encoding circuitry is configured to bypass at least one of the FP and INT convertors when transmitting data values of at least one of the two received input arrays to the compute circuitry,
wherein the zero adjustor is configured to adjust the mean, and scale, data values output by the compute circuitry after processing the data values of the two received input arrays.

### Claim 6 (depends on 1)

The compute unit of claim 1, wherein the array comprises both INT and FP data values, wherein the encoding circuitry is configured to:
separate the INT and FP values so that the FP data values are transmitted to the FP converter and the INT data values are transmitted to the INT converter.

### Claim 7 (depends on 1)

The compute unit of claim 1, wherein the one or more type selector bits includes a plurality of type selector bits, wherein a first bit of the plurality of type selector bits indicates a first data value of the multiple data values is a first datatype and a second bit of the plurality of type selector bits indicates a second data value of the multiple data values is a second datatype.

### Claim 8 (depends on 7)

The compute unit of claim 7, wherein the first bit of the plurality of type selector bits indicates at least two of the multiple data values are the first datatype and the second bit of the plurality of type selector bits indicates at least two of the multiple data values are the second datatype.

### Claim 9 (depends on 8)

The compute unit of claim 8, wherein the at least two of multiple data values corresponding to the first bit comprises data values in at least two rows and at least two columns of the array and the at least two of multiple data values corresponding to the second bit comprises data values in at least two rows and at least two columns of the array.

### Claim 10 (depends on 1)

The compute unit of claim 1, wherein the array is part of a machine learning (ML) application, wherein the compute circuitry comprises matrix multipliers configured to process the data values.

### Claim 11

A compute system, comprising:
memory configured to store an array, the array comprising multiple data values and one or more type selector bits, the one or more type selector bits indicating a datatype of at least one of the data values; and
a compute unit configured to:
receive the array from the memory,
convert FP data values in the array to a desired datatype,
convert INT data values in the array to the desired datatype, and
perform a compute operation using the multiple data values after being converted into the desired datatype.

### Claim 12 (depends on 11)

The compute system of claim 11, wherein the compute unit is configured to upcast the data values in the array from a first datatype to a higher precision datatype when converting the FP data values and the INT data values to the desired datatype, wherein the compute unit comprises a matrix multiplier configured to perform multiplications when the data values are in the higher precision datatype.

### Claim 13 (depends on 12)

The compute system of claim 12, wherein the array is transmitted from memory to the compute unit when the data values are the first datatype.

### Claim 14 (depends on 11)

The compute system of claim 11, wherein the array comprises a shared minimum (min) value indicating a zero value of the data values in the array, the compute unit further configured to:
adjust a mean of the data values based on the shared min value in the array.

### Claim 15 (depends on 14)

The compute system of claim 14, wherein when detecting that two received input arrays have data values with the same datatypes, the compute unit is configured to bypass converting the FP or INT data values for at least one or the two received input arrays to the desired datatype before performing the compute operation,
wherein the compute unit is configured to adjust the mean, and scale, data values output after performing the compute operation using the data values of the two received input arrays.

### Claim 16 (depends on 11)

The compute system of claim 11, wherein the array comprises both INT and FP data values, wherein the compute unit is configured to:
separate the INT and FP values so that the FP data values are transmitted to an FP converter in compute unit and the INT data values are transmitted to an INT converter in the compute unit.

### Claim 17 (depends on 11)

The compute system of claim 11, wherein the one or more type selector bits includes a plurality of type selector bits, wherein a first bit of the plurality of type selector bits indicates a first data value of the multiple data values is a first datatype and a second bit of the plurality of type selector bits indicates a second data value of the multiple data values is a second datatype.

### Claim 18 (depends on 17)

The compute system of claim 17, wherein the first bit of the plurality of type selector bits indicates at least two of the multiple data values are the first datatype and the second bit of the plurality of type selector bits indicates at least two of the multiple data values are the second datatype.

### Claim 19 (depends on 18)

The compute system of claim 18, wherein the at least two of multiple data values corresponding to the first bit comprises data values in at least two rows and at least two columns of the array and the at least two of multiple data values corresponding to the second bit comprises data values in at least two rows and at least two columns of the array.

### Claim 20

A method, comprising:
receiving an array from memory, the array comprising multiple data values and one or more type selector bits, the one or more type selector bits indicating a datatype of at least one of the data values;
upcasting FP data values in the array to a desired datatype;
upcasting INT data values in the array to the desired datatype; and
performing a compute operation using the multiple data values after being converted into the desired datatype.
