# US 2025/0094780 A1 · Multi-resolution field representations in neural networks > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0094780 A1 - Document ID: US20250094780A1 - Status: Published application - Kind: A1 - Application number: 18/468,203 - Filed: 2023-09-15 - Published: 2025-03-20 - Earliest claimed: 2023-09-15 - Assignees: QUALCOMM Incorporated - Applicants: QUALCOMM Incorporated - Inventors: Kartikeya BHARDWAJ; Piero ZAPPI; Paul Nicholas WHATMOUGH; Christopher LOTT; Viswanath GANAPATHY; Chirag Sureshbhai PATEL; Joseph Binamira SORIAGA - Web page: https://patentgrep.com/patent/US20250094780A1 ## CPC - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/045: Combinations of networks - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract Certain aspects provide techniques and apparatuses for efficiently processing inputs in a neural network using multiple receptive field sizes. An example method includes partitioning a first input into a first set of channels and a second set of channels. At a first layer of a neural network, the first set of channels and the second set of channels are convolved into a first output having a smaller dimensionality a dimensionality of the first input. The first set of channels and the first output are concatenated into a second input. The second input is convolved into a second output via a second layer of the neural network, wherein the second output merges a first receptive field generated by the first layer with a larger second receptive field generated by the second layer. One or more actions are taken based on at least one of the first output and the second output. ## Claims ### Claim 1 A processing system, comprising: at least one memory having executable instructions stored thereon; and one or more processors communicatively coupled with the at least one memory and configured to execute the executable instructions in order to cause the processing system to: partition a first input into a first set of channels and a second set of channels; convolve, at a first layer of a neural network, the first set of channels and the second set of channels into a first output having a smaller dimensionality than a dimensionality of the first input; concatenate the first set of channels and the first output into a second input for a second layer of the neural network; convolve the second input into a second output via the second layer of the neural network, wherein: the second output merges a first receptive field generated by the first layer of the neural network with a second receptive field generated by the second layer of the neural network, and the first receptive field covers a larger receptive field in the first input than the second receptive field; and take one or more actions based on at least one of the first output and the second output. ### Claim 2 (depends on 1) The processing system of claim 1, wherein the first set of channels and the second set of channels comprise equal-sized contiguous portions of the first input. ### Claim 3 (depends on 1) The processing system of claim 1, wherein the first output has a size corresponding to a size of the first set of channels or a size of the second set of channels. ### Claim 4 (depends on 1) The processing system of claim 1, wherein the second output has a size corresponding to a size of the first set of channels or a size of the second set of channels. ### Claim 5 (depends on 1) The processing system of claim 1, wherein in order to concatenate the first set of channels and the first output into the second input, the one or more processors are configured to cause the processing system to concatenate a reference to the first set of channels and the first output. ### Claim 6 (depends on 1) The processing system of claim 1, wherein the one or more processors are further configured to cause the processing system to discard at least a portion of the first input based at least in part on portions of the first input used in convolving the second input into the second output. ### Claim 7 (depends on 6) The processing system of claim 6, wherein the at least the portion of the first input is discarded further based on portions of the first input used in performing one or more additional convolutions for layers of the neural network deeper than the second layer of the neural network. ### Claim 8 (depends on 1) The processing system of claim 1, wherein to partition the first input, the one or more processors are configured to cause the processing system to partition the first input such that the first set of channels has a different number of channels as the second set of channels. ### Claim 9 (depends on 1) The processing system of claim 1, wherein to convolve the second input into a second output via the second layer of the neural network, the one or more processors are configured to cause the processing system to process the first set of channels based on identity weights between an input and an output of the second layer of the neural network and to process the second input based on convolutional weights defined in the second layer of the neural network. ### Claim 10 (depends on 1) The processing system of claim 1, wherein the one or more processors are further configured to cause the processing system to: concatenate the first set of channels and the second output into a third input for a third layer of the neural network; and convolve the third input into a third output via the third layer of the neural network, wherein: the third output merges a first receptive field generated by the first layer of the neural network, a second receptive field generated by the second layer of the neural network, and a third receptive field generated by the third layer of the neural network; and the third receptive field covers a smaller receptive field in the first input than the first receptive field and the second receptive field; and the one or more actions are taken further based, at least in part, on the third output. ### Claim 11 A processor-implemented method, comprising: partitioning a first input into a first set of channels and a second set of channels; convolving, at a first layer of a neural network, the first set of channels and the second set of channels into a first output having a smaller dimensionality than a dimensionality of the first input; concatenating the first set of channels and the first output into a second input for a second layer of the neural network; convolving the second input into a second output via the second layer of the neural network, wherein: the second output merges a first receptive field generated by the first layer of the neural network with a second receptive field generated by the second layer of the neural network, and the first receptive field covers a larger receptive field in the first input than the second receptive field; and taking one or more actions based on at least one of the first output and the second output. ### Claim 12 (depends on 11) The method of claim 11, wherein the first set of channels and the second set of channels comprise equal-sized contiguous portions of the first input. ### Claim 13 (depends on 11) The method of claim 11, wherein the first output has a size corresponding to a size of the first set of channels or a size of the second set of channels. ### Claim 14 (depends on 11) The method of claim 11, wherein the second output has a size corresponding to a size of the first set of channels or a size of the second set of channels. ### Claim 15 (depends on 11) The method of claim 11, wherein concatenating the first set of channels and the first output into the second input comprises concatenating a reference to the first set of channels and the first output. ### Claim 16 (depends on 11) The method of claim 11, further comprising discarding at least a portion of the first input based at least in part on portions of the first input used in convolving the second input into the second output. ### Claim 17 (depends on 16) The method of claim 16, wherein the at least the portion of the first input is discarded further based on portions of the first input used in performing one or more additional convolutions for layers of the neural network deeper than the second layer of the neural network. ### Claim 18 (depends on 11) The method of claim 11, wherein partitioning the first input comprises unevenly partitioning the first input such that the first set of channels has a different number of channels as the second set of channels. ### Claim 19 (depends on 11) The method of claim 11, wherein convolving the second input into a second output via the second layer of the neural network comprises processing the first set of channels based on identity weights between an input and an output of the second layer of the neural network and processing the second input based on convolutional weights defined in the second layer of the neural network. ### Claim 20 (depends on 11) The method of claim 11, further comprising: concatenating the first set of channels and the second output into a third input for a third layer of the neural network; and convolving the third input into a third output via the third layer of the neural network, wherein: the third output merges a first receptive field generated by the first layer of the neural network, a second receptive field generated by the second layer of the neural network, and a third receptive field generated by the third layer of the neural network; the third receptive field covers a smaller receptive field in the first input than the first receptive field and the second receptive field; and the one or more actions are taken further based, at least in part, on the third output. ### Claim 21 A system, comprising: means for partitioning a first input into a first set of channels and a second set of channels; means for convolving, at a first layer of a neural network, the first set of channels and the second set of channels into a first output having a smaller dimensionality than a dimensionality of the first input; means for concatenating the first set of channels and the first output into a second input for a second layer of the neural network; means for convolving the second input into a second output via the second layer of the neural network, wherein: the second output merges a first receptive field generated by the first layer of the neural network with a second receptive field generated by the second layer of the neural network, and the first receptive field covers a larger receptive field in the first input than the second receptive field; and means for taking one or more actions based on at least one of the first output and the second output. ### Claim 22 (depends on 21) The system of claim 21, wherein the first set of channels and the second set of channels comprise equal-sized contiguous portions of the first input. ### Claim 23 (depends on 21) The system of claim 21, wherein the first output has a size corresponding to a size of the first set of channels or a size of the second set of channels. ### Claim 24 (depends on 21) The system of claim 21, wherein the second output has a size corresponding to a size of the first set of channels or a size of the second set of channels. ### Claim 25 (depends on 21) The system of claim 21, wherein the means for concatenating the first set of channels and the first output into the second input comprises means for concatenating a reference to the first set of channels and the first output. ### Claim 26 (depends on 21) The system of claim 21, further comprising means for discarding at least a portion of the first input based at least in part on portions of the first input used in convolving the second input into the second output. ### Claim 27 (depends on 26) The system of claim 26, wherein the means for discarding are configured to discard at least the portion of the first input based on portions of the first input used in performing one or more additional convolutions for layers of the neural network deeper than the second layer of the neural network. ### Claim 28 (depends on 21) The system of claim 21, wherein the means for partitioning the first input comprises means for unevenly partitioning the first input such that the first set of channels has a different number of channels as the second set of channels. ### Claim 29 (depends on 21) The system of claim 21, wherein the means for convolving the second input into a second output via the second layer of the neural network comprises means for processing the first set of channels based on identity weights between an input and an output of the second layer of the neural network and means for processing the second input based on convolutional weights defined in the second layer of the neural network. ### Claim 30 (depends on 21) The system of claim 21, further comprising: means for concatenating the first set of channels and the second output into a third input for a third layer of the neural network; and means for convolving the third input into a third output via the third layer of the neural network, wherein: the third output merges a first receptive field generated by the first layer of the neural network, a second receptive field generated by the second layer of the neural network, and a third receptive field generated by the third layer of the neural network; the third receptive field covers a smaller receptive field in the first input than the first receptive field and the second receptive field; and the one or more actions are taken further based, at least in part, on the third output.