# US 12,015,827 B2 · Systems and methods for detecting a reaction by a user to a media asset to which the user previously reacted at an earlier time, and recommending a second media asset to the user consumed during a range of times adjacent to the earlier time

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,015,827 B2
- Document ID: US12015827B2
- Status: Granted
- Kind: B2
- Application number: 17/968,023
- Filed: 2022-10-18
- Published: 2023-05-11
- Granted: 2024-06-18
- Earliest claimed: 2017-02-24
- Assignees: Rovi Guides, Inc.
- Applicants: Rovi Guides, Inc.
- Inventors: James Matthew Wilkinson
- Web page: https://patentgrep.com/patent/US12015827B2

## CPC

- H04N 21/4668: {for recommending content, e.g. movies}
- H04L 67/306: User profiles
- H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)}
- H04N 21/251: {Learning process for intelligent management, e.g. learning user preferences for recommending movies (details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08)}
- H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)}
- H04N 21/422: Input-only peripherals {, i.e. input devices connected to specially adapted client devices}, e.g. global positioning system [GPS] {(input devices also receiving signals from specially adapted client devices H04N21/4104)}
- H04N 21/42201: {biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user (input arrangements for interaction with the human body based on nervous system activity detection G06F3/015)}
- H04N 21/42203: {sound input device, e.g. microphone}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/44204: {Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched (monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31)}
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/44226: {on social networks}
- H04N 21/4667: {Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections}
- H04N 21/4826: {using recommendation lists, e.g. of programmes or channels sorted out according to their score}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Systems and methods are disclosed herein for detecting a first reaction by a user when consuming a media asset at a first time, where a first magnitude of the first reaction exceeds a first threshold. The systems and methods may determine whether a second reaction by the user occurred when the user consumed the media asset at a second time that is prior to the first time, where a second magnitude of the second reaction exceeds a second threshold, and may recommend the second media asset to the user.

## Claims

### Claim 1

A computer-implemented method comprising:
identifying a first media asset currently being consumed by a particular user at a first time during a current consumption session;
detecting, using a biometric sensor, a first reaction by the particular user to the first media asset during the current consumption session;
identifying a type of the first reaction and a magnitude of the first reaction;
determining, based on historical user data for the particular user, whether the particular user had, during a previous consumption session occurring at a second time prior to the first time, a second reaction to the first media asset that is of a similar type and a similar magnitude as the first reaction;
in response to determining, based on the historical user data for the particular user, that the particular user had, during the previous consumption session, the second reaction to the first media asset that is of the similar type and the similar magnitude as the first reaction:
identifying a second media asset that was consumed by the particular user during a predetermined range of time before or after the second time corresponding to the previous consumption session during which the particular user had the second reaction to the first media asset;
retrieving an identifier of the identified second media asset; and
generating, for output to the particular user, a recommendation of the second media asset.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining, based on the historical user data, that the particular user consumed the first media asset at a third time that is later than the first time;
detecting a third reaction by the particular user to the first media asset;
in response to detecting the third reaction:
determining a type of the third reaction and a magnitude of the third reaction;
determining whether the third reaction is of a similar type as the second reaction;
in response to determining that the third reaction is of a different type as the second reaction, determining whether the magnitude of the third reaction is greater than a threshold magnitude associated with the different type; and
in response to determining that the magnitude of the third reaction is greater than the threshold magnitude associated with the different type, generating, for output to the particular user, a recommendation of a third media asset.

### Claim 3 (depends on 1)

The method of claim 1, wherein detecting the first reaction by the particular user to the first media asset comprises:
receiving a communication, by the particular user, that corresponds to the first media asset at a third time that is later than the first time;
decomposing the communication into a plurality of segments; and
detecting the first reaction based on a segment from the plurality of segments.

### Claim 4 (depends on 1)

The method of claim 1, wherein identifying the type of the first reaction comprises:
determining a sensor type based on a sensor used to detect the first reaction;
determining whether the sensor type corresponds to one reaction type, or to a plurality of candidate reaction types; and
in response to determining that the sensor corresponds to one reaction type, determining the type of the first reaction based on the sensor type.

### Claim 5 (depends on 4)

The method of claim 4, further comprising, in response to determining that the sensor type corresponds to the plurality of candidate reaction types:
retrieving respective characteristics that correspond to each candidate reaction type of the plurality of candidate reaction types;
comparing characteristics of the first reaction to each respective characteristic of each candidate reaction type to determine a respective amount of matching characteristics for each respective candidate reaction type; and
determining the type of the first reaction to be the respective candidate reaction type that had the respective amount of matching characteristics that was a highest respective amount.

### Claim 6 (depends on 4)

The method of claim 4, further comprising, in response to determining that the sensor type corresponds to the plurality of candidate reaction types:
detecting, using a different sensor from the sensor used to detect the first reaction, a third reaction by the particular user to the first media asset while the first media asset was consumed by the particular user at the first time;
determining a sensor type of the different sensor; and
determining the type of the first reaction based on the sensor type of the different sensor.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
converting the magnitude of the first reaction to a converted magnitude on a scale that corresponds to the type; and
determining whether the converted magnitude is greater than a threshold value on the scale that corresponds to the type;
wherein determining, based on the historical user data, whether the particular user had the second reaction to the first media asset at the second time prior to the first time occurs in response to determining that the converted magnitude is greater than the threshold value.

### Claim 8 (depends on 7)

The method of claim 7, wherein converting the magnitude of the first reaction to the converted magnitude comprises:
retrieving the scale that corresponds to the type;
determining whether a third reaction by the particular user to the first media asset at a third time that is earlier than the first time and different from the second time, where the third reaction had a respective converted magnitude exceed a respective threshold, occurred; and
in response to determining that the third reaction occurred, adjusting the scale based on the third reaction and determining the converted magnitude of the first reaction based on the first reaction and the adjusted scale.

### Claim 9 (depends on 1)

The method of claim 1, further comprising generating, for output to the particular user, a recommendation of a third media asset based on the identity of the first media asset and an identity of the second media asset, the type of the first reaction, and the type of the second reaction.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
retrieving a plurality of media assets that correspond to the identity of the first media asset and an identity of the second media asset;
generating a playlist of media asset using the plurality of media assets; and
playing back the plurality of media assets in the playlist.

### Claim 11

A system comprising:
memory; and
control circuitry configured to:
identify a first media asset currently being consumed by a particular user at a first time during a current consumption session;
detect, using a biometric sensor, a first reaction by the particular user to the first media asset during the current consumption session;
identify a type of the first reaction and a magnitude of the first reaction;
determine, based on historical user data for the particular user stored in the memory, whether the particular user had, during a previous consumption session occurring at a second time prior to the first time, a second reaction to the first media asset that is of a similar type and a similar magnitude as the first reaction;
in response to determining, based on the historical user data for the particular user, that the particular user had, during the previous consumption session, the second reaction to the first media asset that is of the similar type and the similar magnitude as the first reaction:
identify a second media asset that was consumed by the particular user during a predetermined range of time before or after the second time corresponding to the previous consumption session during which the particular user had the second reaction to the first media asset;
retrieve an identifier of the identified second media asset; and
generate, for output to the particular user, a recommendation of the second media asset.

### Claim 12 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
determine, based on the historical user data, that the particular user consumed the first media asset at a third time that is later than the first time;
detect a third reaction by the particular user to the first media asset;
in response to detecting the third reaction:
determine a type of the third reaction and a magnitude of the third reaction;
determine whether the third reaction is of a similar type as the second reaction;
in response to determining that the third reaction is of a different type as the second reaction, determine whether the magnitude of the third reaction is greater than a threshold magnitude associated with the different type; and
in response to determining that the magnitude of the third reaction is greater than the threshold magnitude associated with the different type, generate, for output to the particular user, a recommendation of a third media asset.

### Claim 13 (depends on 11)

The system of claim 11, wherein the control circuitry configured to detect the first reaction by the particular user to the first media asset is further configured to:
receive a communication, by the particular user, that corresponds to the first media asset at a third time that is later than the first time;
decompose the communication into a plurality of segments; and
detect the first reaction based on a segment from the plurality of segments.

### Claim 14 (depends on 11)

The system of claim 11, wherein the control circuitry configured to identify the type of the first reaction is further configured to:
determine a sensor type based on a sensor used to detect the first reaction;
determine whether the sensor type corresponds to one reaction type, or to a plurality of candidate reaction types; and
in response to determining that the sensor corresponds to one reaction type, determine the type of the first reaction based on the sensor type.

### Claim 15 (depends on 14)

The system of claim 14, wherein the control circuitry is further configured to, in response to determining that the sensor type corresponds to the plurality of candidate reaction types:
retrieve respective characteristics that correspond to each candidate reaction type of the plurality of candidate reaction types;
compare characteristics of the first reaction to each respective characteristic of each candidate reaction type to determine a respective amount of matching characteristics for each respective candidate reaction type; and
determine the type of the first reaction to be the respective candidate reaction type that had the respective amount of matching characteristics that was a highest respective amount.

### Claim 16 (depends on 14)

The system of claim 14, wherein the control circuitry is further configured to, in response to determining that the sensor type corresponds to the plurality of candidate reaction types:
detect, using a different sensor from the sensor used to detect the first reaction, a third reaction by the particular user to the first media asset while the first media asset was consumed by the particular user at the first time;
determine a sensor type of the different sensor; and
determine the type of the first reaction based on the sensor type of the different sensor.

### Claim 17 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
convert the magnitude of the first reaction to a converted magnitude on a scale that corresponds to the type; and
determine whether the converted magnitude is greater than a threshold value on the scale that corresponds to the type;
wherein the control circuitry configured to determine, based on the historical user data, whether the particular user had the second reaction to the first media asset at the second time prior to the first time is configured to do so in response to determining that the converted magnitude is greater than the threshold value.

### Claim 18 (depends on 17)

The system of claim 17, wherein the control circuitry configured to convert the magnitude of the first reaction to the converted magnitude is further configured to:
retrieve the scale that corresponds to the type;
determine whether a third reaction by the particular user to the first media asset at a third time that is earlier than the first time and different from the second time, where the third reaction had a respective converted magnitude exceed a respective threshold, occurred; and
in response to determining that the third reaction occurred, adjust the scale based on the third reaction and determining the converted magnitude of the first reaction based on the first reaction and the adjusted scale.

### Claim 19 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to generate, for output to the particular user, a recommendation of a third media asset based on the identity of the first media asset and an identity of the second media asset, the type of the first reaction, and the type of the second reaction.

### Claim 20 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
retrieve a plurality of media assets that correspond to the identity of the first media asset and an identity of the second media asset;
generate a playlist of media asset using the plurality of media assets; and
play back the plurality of media assets in the playlist.