# US 12,764,029 B2 · Transmission and processing of data in parallel systems > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,764,029 B2 - Document ID: US12764029B2 - Status: Granted - Kind: B2 - Application number: 18/759,693 - Filed: 2024-06-28 - Published: 2026-01-01 - Granted: 2026-10-13 - Earliest claimed: 2024-06-28 - Assignees: Xilinx, Inc. - Applicants: Xilinx, Inc. - Inventors: Haris Javaid; Guanwen Zhong; Mario Baldi - Web page: https://patentgrep.com/patent/US12764029B2 ## CPC - H04L 41/14: Network analysis or design - H04L 41/16: using machine learning or artificial intelligence - H04L 69/22: Parsing or analysis of headers - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Systems and methods for transmitting and processing data can use representations of data portions (e.g., blocks, chunks, or other subunits of data) that match a specified pattern, such as zero gradients in a machine learning training algorithm. These representations can allow different parts of a system to communicate the existence of these data portions to each other without actually transmitting the data portions while also allowing for the transmission of data portions that do not match the specified pattern. Processing of data can also use these representations or indicators as placeholders for the omitted data and perform calculations based on tallies, skipped memory locations, or other ways of accounting for the omitted data. This can in some cases reduce computing resources used to process data, such as data that may have been communicated using such representations. ## Claims ### Claim 1 A method comprising: receiving, via a network by at least one first receiving device from at least one transmitting device, at least one message comprising first data to be provided to at least one second receiving device and an indicator of second data, the second data being omitted from the at least one message; in response to receiving the at least one message and based on the indicator of the second data, analyzing the at least one message to identify the second data; generating, based on analyzing the at least one message, a representation of an original data payload, the representation comprising at least the first data and an identification of the second data omitted from the at least one message; and providing the representation of the original data payload to the at least one second receiving device, wherein the original payload data comprised the first data and the second data. ### Claim 2 (depends on 1) The method of claim 1, wherein: the at least one transmitting device comprises a worker from among a plurality of workers of a machine learning training system; the at least one first receiving device comprises an aggregator of the machine learning training system; the at least one second receiving device comprises a circuit of the first receiving device or an alternate device of the machine learning training system; the first data comprises a first subset of training gradients generated by the worker; and the second data comprises a second subset of training gradients generated by the worker. ### Claim 3 (depends on 1) The method of claim 1, wherein the second data comprises blocks of data that match a specified pattern. ### Claim 4 (depends on 3) The method of claim 3, wherein the specified pattern comprises at least one of: a machine learning training gradient comprising data of a specified value; a machine learning training gradient comprising data within a specified range of values; an identity matrix; or a null matrix. ### Claim 5 (depends on 3) The method of claim 3, wherein the second data comprises blocks of data that match each other. ### Claim 6 (depends on 1) The method of claim 1, wherein: the indicator of the second data indicates that no data has been omitted from the at least one message; and providing the representation of the original data payload comprises providing the first data and an indication that no data was omitted from the at least one message. ### Claim 7 (depends on 1) The method of claim 1 wherein: the indicator of the second data indicates that all payload data has been omitted from the at least one message; and providing the representation of the original data payload comprises providing a representation of the second data and an indication that all payload data was omitted from the at least one message. ### Claim 8 (depends on 1) The method of claim 1, wherein each message in the at least one message comprises: a transmission control header; a header segment comprising the indicator of the second data, the indicator comprising a payload presence encoding that indicates whether a given portion of payload data is included in a payload of the at least one message; and the payload of the at least one message, the payload comprising portions of payload data indicated as present by the header segment, each portion of payload data comprising a non-overlapping subset of the first data. ### Claim 9 (depends on 8) The method of claim 8, wherein the header segment further comprises a portion size parameter that defines a number of portions in the payload data. ### Claim 10 A system comprising: at least one receiving device that is configured to receive messages via a network; and a transmitting device that: partitions a payload using hierarchical segmentation by: partitioning the payload into data portions; and partitioning the data portions into data sub-portions; divides the data payload based at least in part on the data portions and the data sub-portions into a first data and a second data, the second data comprising data that matches one or more criteria; generates at least one message that includes the first data and omits the second data, the at least one message comprising: the first data; and an indicator of the second data omitted from the at least one message; and transmits, via the network and to the at least one receiving device, the at least one message. ### Claim 11 (depends on 10) The system of claim 10, wherein: each one or more data sub-portions includes a plurality of compute parts, each compute part representing a quantity of data that can be processed in a single step of processing by the at least one receiving device; and each message in the at least one message comprises a plurality of data sub-portions. ### Claim 12 (depends on 10) The system of claim 10, wherein: the transmitting device comprises a worker from among a plurality of workers of a machine learning training system; the at least one receiving device comprises an aggregator of the machine learning training system; the first data comprises a first subset of training gradients generated by the worker; and the second data comprises a second subset of training gradients generated by the worker. ### Claim 13 (depends on 10) The system of claim 10, wherein the receiving device performs a summation aggregation operation without processing the second data. ### Claim 14 (depends on 13) The system of claim 13, wherein the second data comprises portions of data that match a specified pattern comprising at least one of: a machine learning training gradient comprising data of a specified value; a machine learning training gradient comprising data within a specified range of values; an identity matrix; or a null matrix. ### Claim 15 (depends on 13) The system of claim 13, wherein the second data comprises blocks of data that match each other. ### Claim 16 (depends on 10) The system of claim 10, wherein: the indicator of the second data indicates that no data has been omitted from the at least one message; and generating the at least one message comprises generating the at least one message without omitting data and including an indication that no data was omitted from the at least one message. ### Claim 17 (depends on 10) The system of claim 10 wherein: the indicator of the second data indicates that all payload data has been omitted from the at least one message; and generating the at least one message comprises generating the at least one message without including payload data and including an indication that all payload data was omitted from the at least one message. ### Claim 18 (depends on 10) The system of claim 10, wherein each message in the at least one message comprises: a transmission control header; a header segment comprising the indicator of the second data, the indicator comprising a payload presence encoding that indicates whether a given portion of payload data is included in a payload of the at least one message; and the payload of the at least one message, the payload comprising portions of payload data indicated as present by the header segment, each portion of payload data comprising a non-overlapping subset of the first data. ### Claim 19 (depends on 18) The system of claim 18, wherein the header segment further comprises a portion size parameter that defines a data number of portions included in the payload data. ### Claim 20 A method comprising: partitioning a payload using hierarchical segmentation by: partitioning the payload into data portions; and partitioning the data portions into data sub-portions; dividing the data payload that is to be transmitted to at least one receiving device based at least in part on the data portions and the data sub-portions into a first data and a second data, the second data comprising blocks of data that match each other; generating, based at least in part on dividing the data payload, at least one message that includes the first data and omits the second data, the at least one message comprising: the first data; and an indicator of the second data; and transmitting, to the at least one receiving device and via a network, the at least one message.