Single-pass distributed sampling from block-partitioned matrices

A computer program product for performing single-pass distributed sampling from block-partitioned matrices, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:

• identify, by the processor, an input dataset formatted as an input matrix that includes a plurality of rows and a plurality of columns;
• divide, by the processor, the input matrix into a plurality of input matrix blocks;
• distribute, by the processor, the input matrix blocks to a plurality of different machines across a distributed filesystem, wherein at least two of the different machines sample, in parallel, at least two of the input matrix blocks;
• and
• generate, by the processor, at least one sample matrix based on the sampling of the at least two of the input matrix blocks.

A system, comprising:

• one or more processors and logic integrated with the processors, executable by the processors, or integrated with and executable by the processors, the logic being configured to:
• identify an input dataset formatted as an input matrix that includes a plurality of rows and a plurality of columns;
• divide the input matrix into a plurality of input matrix blocks;
• distribute the input matrix blocks to a plurality of different machines across a distributed filesystem;
• sample, by at least two of the different machines in parallel, at least two of the input matrix blocks;
• and
• generate at least one sample matrix based on the sampling of the at least two of the input matrix blocks.