Back to results
US 2026/0065018 A1Published application
Multi-device large language model distribution with input chunking
AssigneeQUALCOMM Incorporated
InventorsQi XUE, Abhijit NAVALEKAR
Life of this patent
Estimating the term…
Loading patent…
Loading patent…
AssigneeQUALCOMM Incorporated
InventorsQi XUE, Abhijit NAVALEKAR
Estimating the term…
Various embodiments include systems and methods for distributing a large generative AI model (LXM) across computing devices and implementing the LXM distributed across the computing devices. Embodiments may include dividing the LXM into portions, each portion having at least one input layer, decoder layer, or output layer, with the division based on characteristics of the computing devices. Some embodiments may include receiving a second set of characteristics of the computing devices, including at least one value different from values in the first set of characteristics, dividing the LXM into second portions that each has at least one layer of the LXM, wherein dividing the LXM is based on the second set of characteristics, and allocating the second portions to a second plurality of the computing devices.
A method performed by processor of at least one computing device for distributing a large generative AI model (LXM) across a cluster of computing devices, comprising:
A computing device, comprising:
A non-transitory processor-readable medium having stored thereon processor-executable instructions configured to cause a processor of a computing device to perform operations for distributing a large generative AI model (LXM) across a cluster of computing devices, comprising:
Dependencies are inferred from the claim text.