# US 2024/0394018 A1 · Dot Product Pipeline for Floating Point and Shared Exponent Floating Point Data Types

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0394018 A1
- Document ID: US20240394018A1
- Status: Published application
- Kind: A1
- Application number: 18/321,646
- Filed: 2023-05-22
- Published: 2024-11-28
- Earliest claimed: 2023-05-22
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Mathew Kent HALL
- Web page: https://patentgrep.com/patent/US20240394018A1

## CPC

- G06F 7/5443: {Sum of products (for applications thereof, see the relevant places, e.g. G06F17/10, H03H17/00)}
- G06F 7/483: Computations with numbers represented by a non-linear combination of denominational numbers, e.g. rational numbers, logarithmic number system or floating-point numbers {(G06F7/4806, G06F7/4824, G06F7/49, G06F7/491, G06F7/544 take precedence)}
- G06F 7/485: Adding; Subtracting {(G06F7/4833, G06F7/4836 take precedence)}
- G06F 7/4876: {Multiplying}
- G06F 2207/382: Reconfigurable for different fixed word lengths
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Embodiments of the present disclosure include systems and methods for providing a dot product pipeline for floating point and shared exponent floating point data types. During a first mode of operation, a method uses a first subset of the plurality of hardware components of the dot product hardware pipeline to perform a first dot product operation on a first plurality of floating point numbers and a second plurality of floating point numbers. During a second mode of operation, the method uses a second subset of the plurality of hardware components of the dot product hardware pipeline to perform a second dot product operation on a third plurality of floating point numbers and a fourth plurality of floating point numbers. A third subset of the plurality of hardware components are shared between the first subset of the plurality of hardware components and the second subset of the plurality of hardware components.

## Claims

### Claim 1

A method executable by a dot product hardware pipeline comprising a plurality of hardware components, the method comprising:
configuring the dot product hardware pipeline to operate in a first mode of operation;
during the first mode of operation, using a first subset of the plurality of hardware components of the dot product hardware pipeline to perform a first dot product operation on a first plurality of floating point numbers and a second plurality of floating point numbers;
configuring the dot product hardware pipeline to operate in a second mode of operation; and
during the second mode of operation, using a second subset of the plurality of hardware components of the dot product hardware pipeline to perform a second dot product operation on a third plurality of floating point numbers and a fourth plurality of floating point numbers,
wherein the third plurality of floating point numbers are extracted from a first instance of a shared exponent floating point data type, wherein the fourth plurality of floating point numbers are extracted from a second instance of the shared exponent floating point data type,
wherein a third subset of the plurality of hardware components are shared between the first subset of the plurality of hardware components and the second subset of the plurality of hardware components.

### Claim 2 (depends on 1)

The method of claim 1 further comprising:
based on the first dot product operation, generating a first scalar output value; and
based on the second dot product operation, generating a second scalar output value.

### Claim 3 (depends on 2)

The method of claim 2, where the third subset of the plurality of hardware components comprises a two's complement to floating point converter configured to generate the first and second scalar output values.

### Claim 4 (depends on 1)

The method of claim 1, where the third subset of the plurality of hardware components comprises a fixed point to two's complement converter.

### Claim 5 (depends on 4)

The method of claim 4, wherein the fixed point to two's complement converter converts values represented in a fixed point representation to a two's complement representation based on sign values of the first plurality of floating point numbers and the second plurality of floating point numbers.

### Claim 6 (depends on 1)

The method of claim 1, where the second subset of the plurality of hardware components comprises a significand and sub exponent manager configured to perform a partial reduction operation on the third plurality of floating point numbers and the fourth plurality of floating point numbers.

### Claim 7 (depends on 6)

The method of claim 6, wherein the partial reduction operation is a first partial reduction operation, where the third subset of the plurality of hardware components comprises an adder configured to perform a second partial reduction operation on the third plurality of floating point numbers and the fourth plurality of floating point numbers.

### Claim 8 (depends on 1)

The method of claim 1, wherein the second subset of the plurality of hardware components comprises a leading zero counter.

### Claim 9 (depends on 1)

The method of claim 1, where the third subset of the plurality of hardware components comprises a max exponent selector.

### Claim 10 (depends on 1)

The method of claim 1, wherein the shared exponent floating point data type represents exponents based on a set of shared sub exponent values and a shared main exponent value.

### Claim 11

A dot product hardware pipeline comprising:
a plurality of hardware components,
wherein when the dot product hardware pipeline is configured to operate in a first mode of operation, a first subset of the plurality of hardware components are used to perform a first dot product operation on a first plurality of floating point numbers and a second plurality of floating point numbers,
wherein when the dot product hardware pipeline is configured to operate in a second mode of operation, a second subset of the plurality of hardware components are used to perform a second dot product operation on a third plurality of floating point numbers and a fourth plurality of floating point numbers,
wherein the third plurality of floating point numbers are extracted from a first instance of a shared exponent floating point data type, wherein the fourth plurality of floating point numbers are extracted from a second instance of the shared exponent floating point data type,
wherein a third subset of the plurality of hardware components are shared between the first subset of the plurality of hardware components and the second subset of the plurality of hardware components.

### Claim 12 (depends on 11)

The dot product hardware pipeline of claim 11, wherein, based on the first dot product operation, the dot product hardware pipeline generates a first scalar output value,
wherein, based on the second dot product operation, the dot product hardware pipeline generates a second scalar output value.

### Claim 13 (depends on 12)

The dot product hardware pipeline of claim 12, where the third subset of the plurality of hardware components comprises a two's complement to floating point converter configured to generate the first and second scalar output values.

### Claim 14 (depends on 11)

The dot product hardware pipeline of claim 11, where the third subset of the plurality of hardware components comprises a fixed point to two's complement converter.

### Claim 15 (depends on 14)

The dot product hardware pipeline of claim 14, wherein the fixed point to two's complement converter converts values represented in a fixed point representation to a two's complement representation based on sign values of the first plurality of floating point numbers and the second plurality of floating point numbers.

### Claim 16 (depends on 11)

The dot product hardware pipeline of claim 11, where the second subset of the plurality of hardware components comprises a significand and sub exponent manager configured to perform a partial reduction operation on the third plurality of floating point numbers and the fourth plurality of floating point numbers.

### Claim 17 (depends on 16)

The dot product hardware pipeline of claim 16, wherein the partial reduction operation is a first partial reduction operation, where the third subset of the plurality of hardware components comprises an adder configured to perform a second partial reduction operation on the third plurality of floating point numbers and the fourth plurality of floating point numbers.

### Claim 18 (depends on 11)

The dot product hardware pipeline of claim 11, wherein the second subset of the plurality of hardware components comprises a leading zero counter.

### Claim 19 (depends on 11)

The dot product hardware pipeline of claim 11, where the third subset of the plurality of hardware components comprises a max exponent selector.

### Claim 20 (depends on 11)

The dot product hardware pipeline of claim 11, wherein the shared exponent floating point data type represents exponents based on a set of shared sub exponent values and a shared main exponent value.
