US 11,030,207 B1Granted

Updating displayed data visualizations according to identified conversation centers in natural language commands

AssigneeTableau Software, Inc.

InventorsVidya R. Setlur, Sarah E. Battersby, Melanie K. Tory, Richard C. Gossweiler, III, Angel Xuan Chang, Isaac J. Dykeman, MD Enamul Hoque Prince

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

A method uses natural language for visual analysis of a dataset. The method displays a data visualization based on a first dataset. The method then extracts analytic phrases from a first natural language command related to the data visualization. The method computes conversation centers associated with the first natural language command based on the analytic phrases and computes analytical functions for the conversation centers, thereby creating functional phrases. The method updates the data visualization based on the functional phrases. The method extracts new analytic phrases from a second natural language command related to the updated data visualization and computes a temporary conversation centers associated with the second natural language command based on the new analytic phrases. The method derives new conversation centers from the original conversation centers and the temporary conversation centers using transitional rules. The method then updates the data visualization based on the new conversation centers.

Claims23

Dependent claims

A method of using natural language for visual analysis of a dataset, comprising:

at computer having a display, one or more processors, and memory storing one or more programs configured for execution by the one or more processors:
displaying a data visualization based on a first dataset retrieved from a database using a first set of one or more queries;
receiving a first user input to specify a first natural language command related to the data visualization;
extracting a first set of one or more independent analytic phrases from the first natural language command;
computing a first set of one or more conversation centers associated with the first natural language command based on the first set of one or more analytic phrases;
creating a first set of one or more functional phrases by computing a first set of analytical functions associated with the first set of one or more conversation centers;
updating the data visualization based on the first set of one or more functional phrases;
receiving a second user input to specify a second natural language command related to the updated data visualization;
extracting a second set of one or more independent analytic phrases from the second natural language command;
computing a temporary set of one or more conversation centers associated with the second natural language command based on the second set of one or more analytic phrases;
deriving a second set of one or more conversation centers from the first set of one or more conversation centers and the temporary set of one or more conversation centers using one or more transitional rules;
and
updating the data visualization based on the second set of one or more conversation centers, including highlighting or filtering data marks whose characteristics correspond to a data attribute corresponding to the second set of one or more conversation centers.

10 more elements

An electronic device, comprising:

a display;
one or more hardware processors;
memory;
and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more hardware processors, the one or more programs including instructions for:
displaying a data visualization based on a first dataset retrieved from a database using a first set of one or more queries;
receiving a first user input to specify a first natural language command related to the data visualization;
extracting a first set of one or more independent analytic phrases from the first natural language command;
computing a first set of one or more conversation centers associated with the first natural language command based on the first set of one or more analytic phrases;
creating a first set of one or more functional phrases by computing a first set of analytical functions associated with the first set of one or more conversation centers;
updating the data visualization based on the first set of one or more functional phrases;
receiving a second user input to specify a second natural language command related to the updated data visualization;
extracting a second set of one or more independent analytic phrases from the second natural language command;
computing a temporary set of one or more conversation centers associated with the second natural language command based on the second set of one or more analytic phrases;
deriving a second set of one or more conversation centers from the first set of one or more conversation centers and the temporary set of one or more conversation centers using one or more transitional rules;
and
updating the data visualization based on the second set of one or more conversation centers, wherein the updating comprises:
determining one or more data attributes corresponding to the second set of one or more conversation centers;
scanning displayed data visualizations to identify one or more of the displayed data visualizations that contain data marks whose characteristics correspond to a first data attribute in the one or more data attributes;
and
highlighting the data marks whose characteristics correspond to the first data attribute.

18 more elements

A non-transitory computer readable storage medium storing one or more programs configured for execution by an electronic device with a display, the one or more programs comprising instructions for:

displaying a data visualization based on a first dataset retrieved from a database using a first set of one or more queries;
receiving a first user input to specify a first natural language command related to the data visualization;
extracting a first set of one or more independent analytic phrases from the first natural language command;
computing a first set of one or more conversation centers associated with the first natural language command based on the first set of one or more analytic phrases;
creating a first set of one or more functional phrases by computing a first set of analytical functions associated with the first set of one or more conversation centers;
updating the data visualization based on the first set of one or more functional phrases;
receiving a second user input to specify a second natural language command related to the updated data visualization;
extracting a second set of one or more independent analytic phrases from the second natural language command;
computing a temporary set of one or more conversation centers associated with the second natural language command based on the second set of one or more analytic phrases;
deriving a second set of one or more conversation centers from the first set of one or more conversation centers and the temporary set of one or more conversation centers using one or more transitional rules;
and
updating the data visualization based on the second set of one or more conversation centers, wherein the updating comprises:
determining one or more data attributes corresponding to the second set of one or more conversation centers;
scanning displayed data visualizations to identify one or more of the displayed data visualizations that contain data marks whose characteristics correspond to a first data attribute in the one or more data attributes;
and
highlighting the data marks whose characteristics correspond to the first data attribute.

13 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/978,067Filed 11 May 2018 · continuation in part
Priority: 12 Apr 2016
Granted: 8 Jun 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification14 codes

G06F 16/90332
Query formulation: natural language query formulation or dialogue systems
G06F 3/04847
For the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a…:…
G06F 16/243
Query formulation: natural language query formulation
G06F 16/24522
Query translation: translation of natural language queries to structured queries

Family

Application62/321,695Us provisional application · filed 12 Apr 2016
Application62/418,052Us provisional application · filed 4 Nov 2016
Application15/486,265Parent of this continuation-in-part · filed 12 Apr 2017
Application62/500,999Us provisional application · filed 3 May 2017
Application15/804,991Parent of this continuation-in-part · filed 6 Nov 2017
Application62/598,399Us provisional application · filed 13 Dec 2017
US 10,817,527 B1Parent of this continuation-in-part
US 10,515,121 B1Parent of this continuation-in-part
US 11,030,207 B1This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key