# US 2024/0201940 A1 · Systems and methods for displaying subjects of an audio portion of content and searching for content related to a subject of the audio portion

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0201940 A1
- Document ID: US20240201940A1
- Status: Published application
- Kind: A1
- Application number: 18/535,695
- Filed: 2023-12-11
- Published: 2024-06-20
- Earliest claimed: 2019-08-28
- Assignees: Rovi Guides, Inc.
- Applicants: Rovi Guides, Inc.
- Inventors: Charishma Chundi; Gabriel Dalbec; Nicholas Lovell; Lance G. O'Connor; Susanto Sen
- Web page: https://patentgrep.com/patent/US20240201940A1

## CPC

- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 16/61: Indexing; Data structures therefor; Storage structures
- G06F 16/635: Filtering based on additional data, e.g. user or group profiles
- G06F 16/683: using metadata automatically derived from the content
- G10L 25/51: for comparison or discrimination
- G06F 16/953: Querying, e.g. by the use of web search engines
- G10L 25/57: for processing of video signals
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems and methods are described herein for displaying subjects of a portion of content and searching for content related to a particular subject in the content. Media data of content is analyzed during playback, and a number of audio signatures are identified. Each audio signature is associated, based on audio characteristics, with a particular subject within the content. The audio signature is stored, along with a timestamp corresponding to a playback position at which the audio signature begins, in association with an identifier of the particular subject. Upon receiving a command, icons representing each of a number of audio signatures at or near the current playback position are displayed. Upon receiving user selection of an icon corresponding to a particular signature, a portion of the content corresponding to the audio signature is played back or a search is performed for content related to the signature represented by the selected icon.

## Claims

### Claim at position 1

-50. (canceled)

### Claim 51

A method comprising:
identifying a subject within a media content item;
determining a parameter related to the subject;
storing the parameter as a subject signature;
providing for display an icon representing the subject signature;
receiving a swipe gesture passing through the icon;
identifying a direction of the swipe gesture;
determining a type of a search based on the direction of the swipe gesture; and
performing the type of the search for content related to the subject signature.

### Claim 52 (depends on 51)

The method of claim 51, wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content containing the subject signature, and
the swipe gesture in the second direction results in the second type of the search for content having a signature similar to the subject signature.

### Claim 53 (depends on 51)

The method of claim 51, wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content containing the subject signature, and
the swipe gesture in the second direction results in the second type of the search for content published by a subject corresponding to the subject signature.

### Claim 54 (depends on 51)

The method of claim 51, wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content having a signature similar to the subject signature, and
the swipe gesture in the second direction results in the second type of the search for content published by a subject corresponding to the subject signature.

### Claim 55 (depends on 51)

The method of claim 51, wherein:
the direction includes a first direction, a second direction, and a third direction,
the type of the search includes a first type, a second type, and a third type,
the swipe gesture in the first direction results in the first type of the search for content containing the subject signature,
the swipe gesture in the second direction results in the second type of the search for content having a signature similar to the subject signature, and
the swipe gesture in the third direction results in the third type of the search for content published by a subject corresponding to the subject signature.

### Claim 56 (depends on 51)

The method of claim 51, wherein the identifying the direction of the swipe gesture includes factoring out fluctuations in coordinates representing movement along one axis of the swipe gesture.

### Claim 57 (depends on 51)

The method of claim 51, comprising:
receiving a tap gesture of the icon;
identifying a duration of the tap gesture;
determining the type of the search based on the duration of the swipe gesture; and
performing the type of the search for content related to the subject signature.

### Claim 58 (depends on 57)

The method of claim 57, comprising:
determining that the duration of the tap gesture is below a threshold duration; and
performing the type of the search for content related to the subject signature based on the determining that the duration of the tap gesture is below the threshold duration.

### Claim 59 (depends on 51)

The method of claim 51, comprising:
receiving a tap gesture of the icon;
identifying an intensity of the tap gesture;
determining the type of the search based on the intensity of the swipe gesture; and
performing the type of the search for content related to the subject signature.

### Claim 60 (depends on 59)

The method of claim 59, comprising:
determining that the intensity of the tap gesture is below a threshold intensity; and
performing the type of the search for content related to the subject signature based on the determining that the intensity of the tap gesture is below the intensity duration.

### Claim 61

A system comprising:
control circuitry configured to:
identify a subject within a media content item;
determine a parameter related to the subject;
store the parameter as a subject signature; and
provide for display an icon representing the subject signature; and
input circuitry configured to:
receive a swipe gesture passing through the icon,
wherein the control circuitry is further configured to:
identify a direction of the swipe gesture;
determine a type of a search based on the direction of the swipe gesture; and
perform the type of the search for content related to the subject signature.

### Claim 62 (depends on 61)

The system of claim 61, wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content containing the subject signature, and
the swipe gesture in the second direction results in the second type of the search for content having a signature similar to the subject signature.

### Claim 63 (depends on 61)

The system of claim 61, wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content containing the subject signature, and
the swipe gesture in the second direction results in the second type of the search for content published by a subject corresponding to the subject signature.

### Claim 64 (depends on 61)

The system of claim 61, wherein:
the direction includes a first direction and a second direction,
the type of the search includes a first type and a second type,
the swipe gesture in the first direction results in the first type of the search for content having a signature similar to the subject signature, and
the swipe gesture in the second direction results in the second type of the search for content published by a subject corresponding to the subject signature.

### Claim 65 (depends on 61)

The system of claim 61, wherein:
the direction includes a first direction, a second direction, and a third direction,
the type of the search includes a first type, a second type, and a third type,
the swipe gesture in the first direction results in the first type of the search for content containing the subject signature,
the swipe gesture in the second direction results in the second type of the search for content having a signature similar to the subject signature, and
the swipe gesture in the third direction results in the third type of the search for content published by a subject corresponding to the subject signature.

### Claim 66 (depends on 61)

The system of claim 61, wherein the control circuitry configured to identify the direction of the swipe gesture is further configured to factor out fluctuations in coordinates representing movement along one axis of the swipe gesture.

### Claim 67 (depends on 61)

The system of claim 61,
wherein the input circuitry is configured to:
receive a tap gesture of the icon, and
wherein the control circuitry is configured to:
identify a duration of the tap gesture;
determine the type of the search based on the duration of the swipe gesture; and
perform the type of the search for content related to the subject signature.

### Claim 68 (depends on 67)

The system of claim 67, wherein the control circuitry is configured to:
determine that the duration of the tap gesture is below a threshold duration; and
perform the type of the search for content related to the subject signature based on the determining that the duration of the tap gesture is below the threshold duration.

### Claim 69 (depends on 61)

The system of claim 61,
wherein the input circuitry is configured to:
receive a tap gesture of the icon, and
wherein the control circuitry is configured to:
identify an intensity of the tap gesture;
determine the type of the search based on the intensity of the swipe gesture; and
perform the type of the search for content related to the subject signature.

### Claim 70 (depends on 69)

The system of claim 69, wherein the control circuitry is configured to:
determine that the intensity of the tap gesture is below a threshold intensity; and
perform the type of the search for content related to the subject signature based on the determining that the intensity of the tap gesture is below the intensity duration.
