# US 2022/0021942 A1 · Systems and methods for displaying subjects of a video portion of content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0021942 A1
- Document ID: US20220021942A1
- Status: Published application
- Kind: A1
- Application number: 17/491,153
- Filed: 2021-09-30
- Published: 2022-01-20
- Earliest claimed: 2018-12-20
- Assignees: Rovi Guides, Inc.
- Applicants: Rovi Guides, Inc.
- Inventors: Gabriel C. Dalbec; Nicholas Lovell; Lance G. O'Connor
- Web page: https://patentgrep.com/patent/US20220021942A1

## CPC

- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)}
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 20/49: {Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes}
- G06V 40/164: {using holistic features}
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/440236: {by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text}
- H04N 21/8153: {comprising still images, e.g. texture, background image}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N 21/8547: involving timestamps for synchronizing content
- G06V 20/44: {Event detection}
- G06V 40/161: {Detection; Localisation; Normalisation}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and methods are described herein for displaying subjects of a portion of content. Media data of content is analyzed during playback, and a number of action signatures are identified. Each action signature is associated with a particular subject within the content. The action signature is stored, along with a timestamp corresponding to a playback position at which the action signature begins, in association with an identifier of the particular subject. Upon receiving a command, icons representing each of a number of action signatures at or near the current playback position are displayed. Upon receiving user selection of an icon corresponding to a particular signature, a portion of the content corresponding to the action signature is played back.

## Claims

### Claim at position 1

1-115. (canceled)

### Claim 116

A method comprising:
detecting a plurality of motions in a media content item;
identifying an action signature and a subject signature corresponding to each motion of the plurality of motions in the video;
storing each action signature and subject signature corresponding to the respective motion in the media content, a start timestamp at which the respective motion corresponding to the respective action signature and subject signature begins, and an identifier of the action signature;
generating for display a plurality of icons, each of which representing a unique combination of subject signature and action signature;
receiving an input command comprising a selection of a particular icon of the plurality of icons;
causing playing back a portion of the media content item corresponding to the unique combination of subject signature and action signature of the particular icon.

### Claim 117 (depends on 116)

The method of claim 116, wherein causing playing back the portion of the content corresponding to the unique combination of subject signature and action signature of the particular icon comprises:
retrieving the stored start timestamp of the action signature and subject signature represented by the particular icon; and
causing playing back the portion of the content beginning at the retrieved start timestamp.

### Claim 118 (depends on 116)

The method of claim 116, further comprising:
capturing an image of the subject of each identified motion; and
wherein the plurality of icons representing unique combinations of subject signature and action signature each comprise a captured image of the subject of the motion performing the motion.

### Claim 119 (depends on 116)

The method of claim 116, wherein identifying the action signature comprises:
identifying a subject of motion displayed in video of the content;
storing an identifier of the subject of motion;
detecting, at a first timestamp, a threshold level of motion of a respective subject of motion;
detecting, at a subsequent timestamp, that the motion of the respective subject of motion is below the threshold level; and
identifying as a first action signature the portion of the content between the first timestamp and the subsequent timestamp;
wherein the stored start timestamp corresponds to the first timestamp and the stored end timestamp corresponds to the subsequent timestamp.

### Claim 120 (depends on 119)

The method of claim 119, wherein identifying a subject of motion displayed in the video of the content comprises:
detecting a face in a frame of the media content item;
assigning an identifier to each detected face; and
storing, for each detected face, a set of parameters corresponding to the respective detected face;
wherein the stored identifier of a respective subject of motion is the assigned identifier of the respective detected face associated with the respective subject of motion.

### Claim 121 (depends on 119)

The method of claim 119, wherein detecting a threshold level of motion of a respective subject of motion comprises:
analyzing a plurality of consecutive frames of the media content item; and
determining, based on the analyzing, that the respective subject of motion has moved more than a threshold distance in less than a threshold number of frames.

### Claim 122 (depends on 116)

The method of claim 116, further comprising storing action signatures in a metadata file for distribution with the content.

### Claim 123 (depends on 116)

The method of claim 116, further comprising:
determining whether a time between the start timestamp and a stored end timestamp is below a minimum threshold amount of time;
wherein, in response to determining that the time between the start timestamp and the end timestamp is below the minimum threshold amount of time, playback of the content is performed in slow motion.

### Claim 124 (depends on 116)

The method of claim 116, further comprising:
determining whether a time between the start timestamp and a stored end timestamp is between a minimum threshold amount of time and a maximum threshold amount of time;
wherein, in response to determining that the time between the start timestamp and the end timestamp is between the minimum threshold amount of time and the maximum threshold amount of time, playback of the content is looped.

### Claim 125 (depends on 116)

The method of claim 116, wherein identifying the action signature and the subjection signature and generating for display the plurality of icons is performed during playback of the media content item.

### Claim 126

A system comprising:
a memory;
control circuitry configured to:
detect a plurality of motions in a media content item;
identify an action signature and a subject signature corresponding to each motion of the plurality of motions in the video;
store, in the memory, each action signature and subject signature corresponding to the respective motion in the media content, a start timestamp at which the respective motion corresponding to the respective action signature and subject signature begins, and an identifier of the action signature;
generate for display a plurality of icons, each of which representing a unique combination of subject signature and action signature;
input/output circuitry configured to:
receive an input command comprising a selection of a particular icon of the plurality of icons;
cause playing back a portion of the media content item corresponding to the unique combination of subject signature and action signature of the particular icon.

### Claim 127 (depends on 126)

The system of claim 126, wherein the control circuitry is further configured to, when playing back the portion of the content corresponding to the unique combination of subject signature and action signature of the particular icon:
retrieve the stored start timestamp of the action signature and subject signature represented by the particular icon; and
cause playing back the portion of the content beginning at the retrieved start timestamp.

### Claim 128 (depends on 126)

The system of claim 126, wherein the control circuitry is further configured to:
capture an image of the subject of each identified motion; and
wherein the plurality of icons representing unique combinations of subject signature and action signature each comprise a captured image of the subject of the motion performing the motion.

### Claim 129 (depends on 126)

The system of claim 126, wherein the control circuitry is further configured to, when identifying the action signature:
identify a subject of motion displayed in video of the content;
store an identifier of the subject of motion;
detect, at a first timestamp, a threshold level of motion of a respective subject of motion;
detect, at a subsequent timestamp, that the motion of the respective subject of motion is below the threshold level; and
identify as a first action signature the portion of the content between the first timestamp and the subsequent timestamp;
wherein the stored start timestamp corresponds to the first timestamp and the stored end timestamp corresponds to the subsequent timestamp.

### Claim 130 (depends on 129)

The system of claim 129, wherein the control circuitry is further configured to, when identifying a subject of motion displayed in the video of the content:
detect a face in a frame of the media content item;
assign an identifier to each detected face; and
store, for each detected face, a set of parameters corresponding to the respective detected face;
wherein the stored identifier of a respective subject of motion is the assigned identifier of the respective detected face associated with the respective subject of motion.

### Claim 131 (depends on 129)

The system of claim 129, wherein the control circuitry is further configured to, when detecting a threshold level of motion of a respective subject of motion:
analyze a plurality of consecutive frames of the media content item; and
determine, based on the analyzing, that the respective subject of motion has moved more than a threshold distance in less than a threshold number of frames.

### Claim 132 (depends on 126)

The system of claim 126, wherein the control circuitry is further configured to store action signatures in a metadata file for distribution with the content.

### Claim 133 (depends on 126)

The system of claim 126, wherein the control circuitry is further configured to:
determine whether a time between the start timestamp and a stored end timestamp is below a minimum threshold amount of time;
wherein, in response to determining that the time between the start timestamp and the end timestamp is below the minimum threshold amount of time, playback of the content is performed in slow motion.

### Claim 134 (depends on 126)

The system of claim 126, wherein the control circuitry is further configured to:
determining whether a time between the start timestamp and a stored end timestamp is between a minimum threshold amount of time and a maximum threshold amount of time;
wherein, in response to determining that the time between the start timestamp and the end timestamp is between the minimum threshold amount of time and the maximum threshold amount of time, playback of the content is looped.

### Claim 135 (depends on 126)

The system of claim 126, wherein the control circuitry is further configured to identify the action signature and the subjection signature and generate for display the plurality of icons during playback of the media content item.
