Data processing validation

A computer-implemented data processing method comprising:

• receiving a plurality of input data chunks, each having a pointer to a validation record, the validation records stored at a memory;
• creating an initially empty output validation record at the memory;
• linking the output validation record to the validation records of the input chunks;
• computing an output chunk from the input chunks and either dropping the output chunk or emitting the output chunk dependent on inspection of the output validation record and validation records linked to the output validation record;
• and
• sending a message to a validation process comprising a pointer to the output validation record.

One or more tangible device-readable media with device-executable instructions that, when executed by a computing system, direct the computing system to perform for performing steps comprising:

• receiving a plurality of input data chunks, each having a pointer to a validation record, the validation records stored at a memory;
• creating an initially empty output validation record at the memory;
• linking the output validation record to the validation records of the input chunks;
• and
• computing, in parallel with a validation process operating to fill the output validation record, an output chunk from the input chunks and either dropping the output chunk or emitting the output chunk dependent on inspection of the output validation record and validation records linked to the output validation record.