Explorable visual analytics system having reduced latency in loading data

A method, comprising:

• providing, using a processor, a tree corresponding to a dataset having a number of data points, the tree having a plurality of levels, each of the plurality of levels including a portion of the number of data points organized into at least one tile, the plurality of levels being based on the number of data points in the data set and at least one client resource of a client;
• providing, using the processor, a manifest for the tree, the manifest indicating a particular number of data points in each of the at least one tile for each level of the tree;
• providing the manifest to the client;
• and
• receiving, from the client, a request for a portion of the at least one tile of a level of the plurality of levels, the portion of the at least one tile for the level corresponding to a portion of the dataset and being determined based on the manifest, the portion of the at least one tile including not more than a maximum number of data points corresponding to the at least one client resource,
• wherein a first level of the plurality of levels includes not more than the maximum number of data points and a second level of the plurality of levels includes the number of data points, the maximum number of data points being selected from a predetermined maximum number of data points and a calculated maximum number of data points based on a query of the at least one client resource;
• and
• wherein the plurality of levels corresponds to a plurality of sampling ratios for the dataset.

A system, comprising:

• a processor configured to:
• provide a tree corresponding to a dataset having a number of data points, the tree having a plurality of levels, each of the plurality of levels including at least a portion of the number of data points organized into at least one tile, the plurality of levels being based on the number of data points in the data set and at least one client resource of a client, a first level of the plurality of levels including not more than a maximum number of data points corresponding to the at least one client resource, each tile of the at least one tile in a remaining portion of the plurality of levels including not more than the maximum number of data points;
• provide a manifest for the tree, the manifest indicating a particular number of data points in each of the at least one tile for each level of the tree;
• provide the manifest to the client;
• and
• receive, from the client, a request for a portion of the at least one tile of a level of the plurality of levels, the portion of the at least one tile for the level corresponding to a portion of the dataset and being determined based on the manifest, the portion of the at least one tile including not more than the maximum number of data points;
• and
• a memory coupled to the processor and configured to provide the processor with instructions.

A system, comprising:

• a processor configured to:
• provide a tree corresponding to a dataset having a number of data points, the tree having a plurality of levels, each of the plurality of levels including a portion of the number of data points organized into at least one tile, the plurality of levels being based on the number of data points in the data set and at least one client resource of a client;
• provide a manifest for the tree, the manifest indicating a particular number of data points in each of the at least one tile for each level of the tree;
• provide the manifest to the client;
• and
• receive, from the client, a request for a portion of the at least one tile of a level of the plurality of levels, the portion of the at least one tile for the level corresponding to a portion of the dataset and being determined based on the manifest, the portion of the at least one tile including not more than a maximum number of data points corresponding to the at least one client resource;
• and
• a memory coupled to the processor and configured to provide the processor with instructions;
• wherein a first level of the plurality of levels includes not more than the maximum number of data points and a second level of the plurality of levels includes the number of data points, the maximum number of data points being selected from a predetermined maximum number of data points and a calculated maximum number of data points based on a query of the at least one client resource;
• wherein the plurality of levels corresponds to a plurality of sampling ratios for the dataset.

A computer program product for processing a dataset having a number of data points, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

• providing a tree corresponding to the dataset, the tree having a plurality of levels, each of the plurality of levels including at least a portion of the number of data points organized into at least one tile, the plurality of levels being based on the number of data points in the data set and at least one client resource of a client, a first level of the plurality of levels including not more than a maximum number of data points corresponding to the at least one client resource, each tile of the at least one tile in a remaining portion of the plurality of levels including not more than the maximum number of data points;
• providing a manifest for the tree, the manifest indicating a particular number of data points in each of the at least one tile for each level of the tree;
• providing the manifest to the client;
• and
• receiving a request for a portion of the dataset from the client based on the manifest, the portion of the dataset corresponding to a level of the plurality of levels of the tree and at least a portion of the at least one tile for the level, the portion of the dataset including not more than a maximum number of data points corresponding to the at least one client resource.

A method, comprising:

• receiving, at a client, a manifest for a tree corresponding to a dataset having a number of data points, the tree having a plurality of levels, each of the plurality of levels including at least a portion of the number of data points organized into at least one tile, the plurality of levels being based on the number of data points in the data set and at least one client resource of the client, a first level of the plurality of levels including not more than a maximum number of data points corresponding to the at least one client resource, each tile of the at least one tile in a remaining portion of the plurality of levels including not more than the maximum number of data points, the manifest being for the tree and indicating a particular number of data points in each of the at least one tile for each level of the tree;
• receiving, at a processor for the client, a request for a portion of the dataset;
• determining, using the processor and based on the manifest, a level of the plurality of levels of the tree and a portion of the at least one tile for the level corresponding to the portion of the dataset and including not more than the maximum number of data points;
• and
• sending a request for the at least a portion of the at least one tile of the level.

A system for using a dataset having a number of data points, the system comprising:

• an execution engine for receiving a request for a portion of the dataset and tracking processing of the portion of the dataset;
• a download manager, coupled with the execution engine and for controlling reception and decompression of a manifest for a tree, the tree corresponding to the dataset and having a plurality of levels, each of the plurality of levels including a portion of the number of data points organized into at least one tile, the plurality of levels being based on the number of data points in the data set and at least one client resource of a client, the manifest indicating a particular number of data points in each of the at least one tile for each level of the tree, a first level of the plurality of levels including not more than a maximum number of data points corresponding to the at least one client resource, each tile of the at least one tile in a remaining portion of the plurality of levels including not more than the maximum number of data points;
• a dataset module coupled with the download manager and the execution engine, the dataset module determining, based on the manifest, a level of the plurality of levels of the tree and a portion of the at least one tile for the level corresponding to the portion of the data, the portion of the at least one tile including not more than a maximum amount of data, the maximum amount of data corresponding to the at least one client resource, the dataset module providing the portion of the at least one tile of the level to the download manager, the download manager further controlling an external request for, reception of and decompression of the portion of the at least one tile of the level.