# US 2024/0267589 A1 · Viewer Reaction Detection and Content Control

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0267589 A1
- Document ID: US20240267589A1
- Status: Published application
- Kind: A1
- Application number: 18/166,057
- Filed: 2023-02-08
- Published: 2024-08-08
- Earliest claimed: 2023-02-08
- Assignees: Comcast Cable Communications, LLC
- Applicants: Comcast Cable Communications, LLC.
- Inventors: Mary Cyriac; Christopher Day
- Web page: https://patentgrep.com/patent/US20240267589A1

## CPC

- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/42201: {biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user (input arrangements for interaction with the human body based on nervous system activity detection G06F3/015)}
- H04N 21/42203: {sound input device, e.g. microphone}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/462: Content or additional data management e.g. creating a master electronic programme guide from data received from the Internet and a Head-end or controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N 21/4663: {involving probabilistic networks, e.g. Bayesian networks}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems, apparatuses, and methods for detecting the reactions of primary and secondary viewers of content are described. Reactions of a primary or secondary viewer of content may be detected through use of a sensor and machine learning model. Based on the reaction of the primary or secondary viewer satisfying some criteria, outputting of the content may be modified and/or alternative content may be provided. Furthermore, metadata may be generated based on the detection of adverse reactions to intrusions by a viewer of content that is associated with an indication that the outputted content is associated with certain predefined types.

## Claims

### Claim 1

A method comprising:
outputting, by a computing device, content;
detecting, during the outputting of the content, based on data received from one or more sensors, a presence of a primary viewer of the content being outputted;
determining a reaction of the primary viewer to one or more secondary viewers, wherein the secondary viewers were not present during the detecting the presence of the primary viewer;
determining, during the outputting of the content, using a machine learning model, and based on the reaction of the primary viewer, a reaction of the one or more secondary viewers, different from the primary viewer, to a portion of the content being outputted; and
modifying, based on the determined reaction of the one or more secondary viewers satisfying one or more criteria, the outputting of the content.

### Claim 2 (depends on 1)

The method of claim 1, wherein the machine learning model used to perform the detecting and the machine learning model used to perform the determining comprise the same machine learning model.

### Claim 3 (depends on 1)

The method of claim 1, wherein the modifying the outputting of the content comprises one or more of:
stopping the outputting of audio of the content;
reducing a volume of audio of the content;
stopping the outputting of video of the content; or
outputting alternative content that is different from the content.

### Claim 4 (depends on 1)

The method of claim 1, wherein the determined reaction of the one or more secondary viewers comprises one or more of:
the one or more secondary viewers viewing the content,
the one or more secondary viewers looking at the primary viewer, or
one or more of a surprised facial expression, an embarrassed facial expression, or a disgusted facial expression.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
determining a first portion of the content associated with one or more of predefined types of content, and wherein the modifying the outputting of the content comprises:
outputting, instead of the first portion, a second portion of the content.

### Claim 6 (depends on 1)

The method of claim 1, wherein the content is associated with metadata that indicates one or more portions of content that are associated with one or more predefined types of content, and the determined reaction of the one or more secondary viewers comprises a reaction at a time that a portion of content, associated with the metadata, is being outputted.

### Claim 7 (depends on 1)

The method of claim 1, wherein the determining the reaction of the one or more secondary viewers comprises using a machine learning model that comprises a Bayesian hierarchical model and is configured to determine the reaction of the one or more secondary viewers.

### Claim 8 (depends on 1)

The method of claim 1, wherein the determining the reaction of the one or more secondary viewers comprises using a machine learning model configured to determine a reaction based on an amplitude of an utterance of the one or more secondary viewers.

### Claim 9 (depends on 1)

The method of claim 1, wherein the determining the reaction of the one or more secondary viewers comprises using a machine learning model configured to determine a reaction based on recognition of words spoken by the one or more secondary viewers.

### Claim 10 (depends on 1)

The method of claim 1, wherein the detecting the presence of the primary viewer comprises:
determining that a viewer that initiated the outputting of the content is the primary viewer.

### Claim 11 (depends on 1)

The method of claim 1, wherein one or more portions of the content are associated with metadata comprising one or more key words, and wherein the determined reaction of the one or more secondary viewers comprises a reaction determined to occur at a time that a portion of the content associated with the one or more key words is being outputted.

### Claim 12 (depends on 1)

The method of claim 1, wherein the modifying the outputting of the content comprises stopping the outputting of at least a portion of the content and outputting alternative content comprising an advertisement.

### Claim 13 (depends on 1)

The method of claim 1, wherein the modifying the outputting comprises outputting alternative content that comprises an advertisement, the method further comprising:
determining, using a machine learning model, one or more estimated ages of the one or more secondary viewers; and
determining the advertisement based on a lowest of the one or more estimated ages.

### Claim 14 (depends on 1)

The method of claim 1, further comprising:
detecting, during outputting of the content to the primary viewer, an intrusion into an environment associated with the primary viewer;
determining a reaction of the primary viewer to the intrusion; and
based on the reaction of the primary viewer, and based on determining that metadata associated with the content comprises one or more key words associated with one or more predefined types of content, generating additional metadata indicating that the content is provocative and a time associated with the reaction.

### Claim 15

A method comprising:
detecting, during outputting of content to a primary viewer and based on first data received from one or more sensors, an intrusion into an environment associated with the primary viewer;
determining, based on second data received from one or more sensors, a reaction of the primary viewer to the intrusion; and
based on the reaction of the primary viewer, and based on determining that metadata associated with the content comprises one or more key words associated with one or more predefined types of content, modifying the outputting of the content.

### Claim 16 (depends on 15)

The method of claim 15, wherein the metadata comprises one or more of:
a transcript corresponding to speech in the content or
a description of one or more non-speech portions of the content.

### Claim 17 (depends on 15)

The method of claim 15, wherein the intrusion comprises one or more of:
another person coming within a predefined distance of the primary viewer,
a door opening, or
a light being turned on or off.

### Claim 18

A method comprising:
determining, during outputting of content, based on data received from one or more sensors, a reaction of a primary viewer that indicates a presence of one or more secondary viewers of the content; and
modifying, based on the determined reaction satisfying one or more criteria, the outputting of the content.

### Claim 19 (depends on 18)

The method of claim 18, wherein the one or more sensors comprise a heart-rate sensor configured to detect a heart-rate of the primary viewer, and wherein the reaction of the primary viewer that indicates the presence of one or more secondary viewers is based on fluctuations of the heart-rate of the primary viewer.

### Claim 20 (depends on 18)

The method of claim 18, wherein the one or more sensors comprise a camera, and wherein the reaction of the primary viewer that indicates the presence of one or more secondary viewers comprises the primary viewer gazing away from the content being outputted for greater than a threshold amount of time.
