Data processing performance enhancement for neural networks using a virtualized data iterator

A computer-implemented method for enhanced data processing using an iterator in a computing device, the iterator configured to execute multiple instances for parallel processing of one or more data iteration functions, the method comprising:

• loading data from a memory component of the computing device;
• receiving one or more initialization parameters indicative of dimensions of the data as a data volume comprising any of height, width, number of channels, number of kernels, or one or more other data descriptors;
• receiving one or more instructions to traverse the loaded data according to one or more iterator operation types and the one or more initialization parameters and using one or more selected traversal patterns;
• processing the one or more instructions to select one or more portions of the loaded data according to one or more iterator operation types and the one or more initialization parameters;
• and
• communicating the one or more portions of the loaded data to one or more processing components of the computing device;
• wherein the iterator is virtualized using logical mapping to the data in the memory component, the logical mapping determined using parameters indicative of the data's physical memory addressing, dimension, and volume.

A computer-readable storage medium having computer-executable instructions stored thereupon which, when executed by one or more processors of a computing device, cause the computing device to:

• instantiate an iterator configured to execute multiple instances for parallel processing of one or more data iteration functions;
• receive one or more initialization parameters comprising data representative of dimensions of data to be processed, the dimensions of the data comprising data representative of a volume of the data, the one or more initialization parameters comprising a physical memory addressing of the data to be processed;
• load the data utilizing the one or more initialization parameters;
• receive one or more instructions to traverse the loaded data according to one or more iterator operation types and the one or more initialization parameters and using one or more selected traversal patterns;
• process the one or more instructions to select one or more portions of the loaded data according to the one or more iterator operation types and the one or more initialization parameters;
• and
• communicate the one or more portions of the loaded data to one or more processing components;
• wherein the iterator is virtualized using logical mapping to the data, the logical mapping determined using parameters indicative of the data's physical memory addressing, dimension, and volume.