Correlated incremental loading of multiple data sets for an interactive data prep application

A non-transitory computer readable storage medium storing one or more programs configured for execution by a computer system having one or more processors, memory, and a display, the one or more programs comprising instructions for:

• displaying a user interface that includes a data flow pane, a profile pane, and a data pane, wherein the data flow pane displays a node/link flow diagram that identifies a data source;
• for each of a plurality of queries against the data source:
• issuing the respective query against the data source asynchronously with an initial block size that specifies a number of rows;
• upon retrieval of a respective initial set of rows from the data source satisfying the respective query, repeating the respective query asynchronously with an updated block size until all of the rows satisfying the query have been retrieved;
• and
• storing retrieved rows satisfying the respective query in a local cache;
• periodically:
• determining a unique identifier that identifies rows from the data source that have been retrieved and stored in the local cache for all of the queries;
• and
• when the unique identifier changes, updating the profile pane to display data value histograms for a plurality of data fields in the data source, wherein each bar in each data value histogram indicates a count of rows from the data source that (i) are specified by the unique identifier and (ii) have a single specific data value or range of data values for a respective data field;
• thereby providing a consistent view of data in the profile pane while multiple independent queries run asynchronously.

A method of preparing data for subsequent analysis, comprising:

• at a computer system having a display, one or more processors, and memory storing one or more programs configured for execution by the one or more processors:
• displaying a user interface that includes a data flow pane, a profile pane, and a data pane, wherein the data flow pane displays a node/link flow diagram that identifies a data source;
• for each of a plurality of queries against the data source:
• issuing the respective query against the data source asynchronously with an initial block size that specifies a number of rows;
• upon retrieval of a respective initial set of rows from the data source satisfying the respective query, repeating the respective query asynchronously with an updated block size until all of the rows satisfying the query have been retrieved;
• and
• storing retrieved rows satisfying the respective query in a local cache;
• periodically:
• determining a unique identifier that identifies rows from the data source that have been retrieved and stored in the local cache for all of the queries;
• and
• when the unique identifier changes, updating the profile pane to display data value histograms for a plurality of data fields in the data source, wherein each bar in each data value histogram indicates a count of rows from the data source that (i) are specified by the unique identifier and (ii) have a single specific data value or range of data values for a respective data field;
• thereby providing a consistent view of data in the profile pane while multiple independent queries run asynchronously.