US 12,322,385 B2Granted

Systems and methods for disambiguating a voice search query based on gestures

AssigneeAdeia Guides Inc.

InventorsAnkur Anil Aher, Nishchit Mahajan, Narendra Purushothama, Sai Durga Venkat Reddy Pulikunta

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods are described herein for disambiguating a voice search query by determining whether the user made a gesture while speaking a quotation from a content item and whether the user mimicked or approximated a gesture made by a character in the content item when the character spoke the words quoted by the user. If so, a search result comprising an identifier of the content item is generated. A search result representing the content item from which the quotation comes may be ranked highest among other search results returned and therefore presented first in a list of search results. If the user did not mimic or approximate a gesture made by a character in the content item when the quotation is spoken in the content item, then a search result may not be generated for the content item or may be ranked lowest among other search results.

Claims23

Dependent claims

A method for disambiguating a voice search query, the method comprising:

capturing, concurrently with the voice search query, an image of a pose of a user, the image comprising a plurality of pixels of at least a portion of a body of the user;
generating a first set of pixel coordinates describing a location of the at least a portion of the body of the user;
receiving a plurality of search results from a database in response to a text search query based at least in part on the voice search query, each search result of the plurality of search results received from the database having associated metadata including image data related to the respective search result;
identifying for each search result of the plurality of search results, based at least in part on the image data of the respective search result, a second set of pixel coordinates;
comparing the first set of pixel coordinates with the second set of pixel coordinates of each search result of the plurality of search results by comparing a first distance between pixel coordinates of the first set of pixel coordinates with a second distance between pixel coordinates of the second set of pixel coordinates;
determining, based on the comparing, whether the captured image of the pose of the user matches the image data of the respective search result of the plurality of search results;
and
in response to determining that the captured image of the pose of the user matches the image data of the respective search result of the plurality of search results, generating for display the respective search result.

5 more elements

A system for disambiguating a voice search query, the system comprising:

input circuitry configured to:
receive the voice search query;
and
capture, concurrently with the voice search query, an image of a pose of a user, the image comprising a plurality of pixels of at least a portion of a body of the user;
and
control circuitry configured to:
generate a first set of pixel coordinates describing a location of the at least a portion of the body of the user;
receive a plurality of search results from a database in response to a text search query based at least in part on the voice search query, each search result of the plurality of search results received from the database having associated metadata including image data related to the respective search result;
identify for each search result of the plurality of search results, based at least in part on the image data of the respective search result, a second set of pixel coordinates;
compare the first set of pixel coordinates with the second set of pixel coordinates of each search result of the plurality of search results by comparing a first distance between pixel coordinates of the first set of pixel coordinates with a second distance between pixel coordinates of the second set of pixel coordinates;
determine, based on the comparing, whether the captured image of the pose of the user matches the image data of the respective search result of the plurality of search results;
and
in response to the determining that the captured image of the pose of the user matches the image data of the respective search result of the plurality of search results, generate for display the respective search result.

10 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/547,615Filed 10 Dec 2021 · continuation
Priority: 28 Jun 2019
Published: US 2022/0319510 A16 Oct 2022
Granted: 3 Jun 2025
Term ends: Not estimatedThe source records don’t support an estimate.

Classification14 codes

G10L 15/22
Speech recognition: procedures used during a speech recognition process, e.g. man-machine dialogue
G06F 3/017
Input arrangements or combined input and output arrangements for interaction between user and computer: gesture based interaction, e.g. based on a…
G06F 3/0346
Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor: with detection of the…
G06F 16/243
Query formulation: natural language query formulation

Family

Application16/456,275Parent of this continuation · filed 28 Jun 2019
US 2022/0319510 A1Pre-grant publication · published 6 Oct 2022
US 11,227,593 B2Parent of this continuation
US 2020/0410995 A1Published application
US 12,322,385 B2This patent

From the US filing history. Foreign family members aren’t listed.