US 10,482,098 B2Granted

Consuming streamed data records

AssigneeMicrosoft Technology Licensing, LLC

InventorMichael J. Pizzo

Life of this patent

Estimating the term…

Loading patent…

Abstract

Aspects extend to methods, systems, and computer program products for consuming streamed data records. An application binds members (e.g., columns) of a structure (e.g., record) from a data source to memory buffers, and may specify one or more members be retrieved individually or be ignored entirely. The application requests one or more records from the data source be fetched into the memory buffers until it comes across a member that doesn't match the binding. The data source notifies of the application of data that is ready to be read from the exception member. The application can create or update binding information for the member, read data from the member, or ignore the member. When finished, the application requests the data source continue processing record(s). Additional members are copied into the memory buffers until the last member is read for the (set of) record(s) or another exception member is discovered.

Claims20

Dependent claims

A computer system, the computer system comprising:

one or more hardware processors;
system memory coupled to the one or more hardware processors, the system memory storing instructions that are executable by the one or more hardware processors;
the one or more hardware processors configured to execute the instructions stored in the system memory for an application to access a data instance from a data source, including the following:
receive member information for any known members of the data instance to be returned by a driver, the driver maintaining a template of member information for known members;
specify, based on the member information, instructions for binding known members to corresponding locations in the system memory;
issue a command to the driver to get the data instance from the data source, the driver populating the data instance for the known members into the corresponding locations in the system memory;
receive an exception code for the issued command from the driver, the exception code indicating that the driver has detected an exception to the template, the exception indicative of the data instance including one or more exception members, the one or more exception members representing members of the data instance do not match the template;
for at least one of the one or more exception members:
request the identity of the exception member from the driver;
receive an indication identifying the exception member;
request a description of the data in the exception member from the driver;
receive a description of the data in the exception member;
and
determine how to handle the data in the exception member.

11 more elements

A computer system, the computer system comprising:

one or more hardware processors;
system memory coupled to the one or more hardware processors, the system memory storing instructions that are executable by the one or more hardware processors;
the one or more hardware processors configured to execute the instructions stored in the system memory to update a template for a data source, including the following:
receive a command from an application to get data from a data instance of the data source in accordance with the template, the template indicating members of the data instance known to a driver;
formulate an exception code at the driver, the exception code indicating that the driver has detected an exception to the template, the exception indicative of the data instance including one or more exception members that do not match member information previously known to the driver;
for at least one of the one or more exception members:
receive a request for an identity of the exception member from the application;
send an indication identifying the exception member to the application;
receive a request for a description of the data in the exception member from the application;
send the description of the data in the exception member;
and
modify the template based on the description of the data in the exception member, modifying the template permitting the application to bind the exception member to system memory when accessing data from subsequent data instances of the data source.

9 more elements

Dependencies are inferred from the claim text.