# US 11,113,853 B2 · Systems and methods for blending and aggregating multiple related datasets and rapidly generating a user-directed series of interactive 3D visualizations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,113,853 B2
- Document ID: US11113853B2
- Status: Granted
- Kind: B2
- Application number: 15/734,169
- Filed: 2020-05-29
- Published: 2021-08-12
- Granted: 2021-09-07
- Earliest claimed: 2019-05-29
- Assignees: Aqumin LLC
- Applicants: Aqumin, LLC
- Inventors: Denis R. Papp; Michael J. Zeitlin
- Web page: https://patentgrep.com/patent/US11113853B2

## CPC

- G06T 11/26: Drawing of charts or graphs
- G06T 17/05: Geographic models
- G06F 16/24556: {Aggregation; Duplicate elimination}
- G06F 16/287: {Visualization; Browsing}
- G06F 16/9024: {Graphs; Linked lists (G06F16/9027 takes precedence)}
- G06T 15/205: {Image-based rendering}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods that enable blending and aggregating multiple related datasets to a blended data model (BDM), manipulation of the resulting data model, and the representation of multiple parameters in a single visualization. The BDM and each visualization can be iteratively manipulated, in real-time, using a user-directed question-answer-question response so patterns can be revealed that are not obvious.

## Claims

### Claim 1

A method for blending and aggregating multiple related datasets and rapidly generating a user-directed series of interactive three-dimensional landscape visualizations, comprising:
a) transforming multiple related datasets into a blended data model (BDM) using a computer processor; the BDM comprising a plurality of Scopes, a plurality of Metrics and a plurality of Values, wherein each Scope includes a plurality of Entities, and wherein transforming the multiple datasets into the BDM comprises: determining a Target Scope from the plurality of Scopes for each dataset; transforming rows, columns and data values from the multiple datasets to the plurality of Entities, Metrics and Values; determining additional Computed Metrics and Computed Values; determining a Scope Hierarchy; determining Neighbor Entities for each Entity; determining Aggregate Functions for each Metric; and computing Aggregate Values for the plurality of Metrics using the Scope Hierarchy, the additional Computed Metrics, the plurality of Values, the additional Computed Values, the plurality of Entities and the Neighbor Entities;
b) selecting a Data View from the BDM, wherein the Data View is comprised of one or more of the plurality of Entities and one or more of the plurality of Metrics; and
c) transforming the Data View to the three-dimensional landscape visualization.

### Claim 2 (depends on 1)

The method of claim 1, further comprising manipulating the BDM by at least one of the following:
modifying one or more of the plurality of Metrics that are Computed Metrics, and modifying Aggregate Functions for one or more of the plurality of Metrics.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
interacting with the three-dimensional landscape visualization; formulating a new question based on a display of the three-dimensional landscape visualization; and
repeating the following steps:
manipulating the BDM by at least one of the following: modifying one or more of the plurality of Metrics that are Computed Metrics, and modifying Aggregate Functions for one or more of the plurality of Metrics;
selecting a Data View from the BDM, wherein the Data View is comprised of one or more of the plurality of Entities and one or more of the plurality of Metrics; and
transforming the Data View to the three-dimensional landscape visualization.

### Claim 4 (depends on 1)

The method of claim 1, wherein selecting the Data View from the BDM comprises:
selecting a Scope from the plurality of Scopes;
selecting a plurality of Entities from the selected Scope; and
selecting one or more of the plurality of Metrics and associating each of the one or more of the plurality of Metrics with a different graphical attribute used in the three-dimensional landscape visualization to represent a respective Configuration Metric.

### Claim 5 (depends on 4)

The method of claim 4, wherein transforming the Data View to the three-dimensional landscape visualization comprises:
determining a plurality of graphical elements using the plurality of Entities in the selected Data View;
determining a plurality of graphical attributes using each Configuration Metric in the selected Data View; and
constructing the three-dimensional landscape visualization using the plurality of graphical elements, the plurality of graphical attributes and the selected Data View.

### Claim 6 (depends on 3)

The method of claim 3, wherein interacting with the three-dimensional landscape visualization comprises:
manipulating at least one of a camera orientation and camera position for the three-dimensional landscape visualization; and
re-rendering the three-dimensional landscape visualization.

### Claim 7 (depends on 3)

The method of claim 3, wherein interacting with the three-dimensional landscape visualization comprises:
selecting a graphical element of the three-dimensional landscape visualization;
determining a matching Entity for the selected graphical element using the Data View; and
selecting one or more of the plurality of Metrics for observing each Value for the matching Entity.

### Claim 8 (depends on 7)

The method of claim 7, further comprising re-rendering the three-dimensional landscape visualization and repeating the steps in claim 7.

### Claim 9 (depends on 1)

The method of claim 1, wherein each dataset comprises a plurality of rows and columns with one data value for each respective row and column.

### Claim 10

A non-transitory program carrier device tangibly carrying computer-executable instructions for blending and aggregating multiple related datasets and rapidly generating a user-directed series of interactive three-dimensional landscape visualizations, the instructions being executable to implement:
a) transforming the multiple datasets into a blended data model (BDM) comprising a plurality of Scopes, a plurality of Metrics and a plurality of Values, wherein each Scope includes a plurality of Entities;
b) manipulating the BDM by at least one of modifying one or more of the plurality of Metrics that are Computed Metrics; and modifying Aggregate Functions for one or more of the plurality of Metrics;
c) selecting a Data View from the BDM, wherein the Data View includes one or more of the plurality of Entities and a one or more of the plurality of Metrics; and
d) transforming the Data View to the three-dimensional landscape visualization;
e) interacting with the three-dimensional landscape visualization;
f) formulating a new question based on a display of the three-dimensional landscape visualization; and
g) repeating steps b-d.

### Claim 11 (depends on 10)

The program carrier device of claim 10, wherein transforming the multiple datasets into the BDM comprises:
determining a Target Scope from the plurality of Scopes for each dataset;
transforming rows, columns and data values from the multiple datasets to the plurality of Entities, Metrics and Values;
determining additional Computed Metrics and Computed Values;
determining a Scope Hierarchy;
determining Neighbor Entities for each Entity; and
determining Aggregate Functions for each Metric; and
computing Aggregate Values for the plurality of Metrics using the Scope Hierarchy, the additional Computed Metrics, the plurality of Values, the additional Computed Values, the plurality of Entities and the Neighbor Entities.

### Claim 12 (depends on 10)

The program carrier device of claim 10, wherein selecting the data view from the BDM comprises:
selecting a Scope from the plurality of Scopes;
selecting a plurality of Entities from the selected Scope; and
selecting one or more of the plurality of Metrics and associating each of the one or more of the plurality of Metrics with a different graphical attribute used in the three-dimensional landscape visualization to represent a respective Configuration Metric.

### Claim 13 (depends on 12)

The program carrier device of claim 12, wherein transforming the data view to the three-dimensional landscape visualization comprises:
determining a plurality of graphical elements using the one or more of the plurality of Entities in the selected data view;
determining a plurality of graphical attributes using each Configuration Metric in the selected Data View; and
constructing the three-dimensional landscape visualization using the plurality of graphical elements, the plurality of graphical attributes and the selected Data View.

### Claim 14 (depends on 10)

The program carrier device of claim 10, wherein interacting with the three-dimensional landscape visualization comprises:
manipulating at least one of a camera orientation and camera position for the three-dimensional landscape visualization; and
re-rendering the three-dimensional landscape visualization.

### Claim 15 (depends on 10)

The program carrier device of claim 10, wherein interacting with the three-dimensional landscape visualization comprises:
selecting a graphical element of the three-dimensional landscape visualization;
determining a matching Entity for the selected graphical element using the Data View; and
selecting one or more of the plurality of Metrics for observing each Value for the matching Entity.

### Claim 16 (depends on 15)

The program carrier device of claim 15, further comprising re-rendering the three-dimensional landscape visualization and repeating the steps in claim 15.

### Claim 17 (depends on 10)

The program carrier device of claim 10, wherein each dataset comprises a plurality of rows and columns with one data value for each respective row and column.