# US 2021/0243495 A1 · Automatic transition of content based on facial recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243495 A1
- Document ID: US20210243495A1
- Status: Published application
- Kind: A1
- Application number: 17/238,559
- Filed: 2021-04-23
- Published: 2021-08-05
- Earliest claimed: 2012-09-04
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Robert Benea; Andrej Cedilnik
- Web page: https://patentgrep.com/patent/US20210243495A1

## CPC

- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- G06V 40/168: {Feature extraction; Face representation}
- G06V 40/172: {Classification, e.g. identification}
- H04H 60/33: Arrangements for monitoring the users' behaviour or opinions
- H04H 60/40: for identifying broadcast time
- H04H 60/45: for identifying users
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/4415: using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning {(cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861)}
- H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 21/458: Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules {; time-related management operations (arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10)}
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N)

## Abstract

Methods and systems for automatically transitioning content based on facial recognition, wherein the method may include receiving a signal from a camera, identifying a face of a viewer within an area, retrieving a user identifier associated with the face of the viewer, selecting a program, and displaying the program.

## Claims

### Claim 1

A device for transitioning content, the device comprising:
a memory;
one or more user interface devices configured to provide an output to a user;
a transceiver configured to wirelessly communicate with a communication network;
one or more sensors; and
a hardware processor that, when executing computer executable instructions stored in the memory, is configured to:
receive, at a first time point, from the one or more sensors associated with the device, first sensor data;
inhibit presentation of content on the one or more user interface devices of the device based on a determination that the first sensor data does not uniquely identify the user from a plurality of users associated with the device;
receive, at a second time point, from the one or more sensors associated with the device, second sensor data;
determine that the second sensor data uniquely identifies the user from the plurality of users associated with the device; and
cause the content to be presented on the one or more user interface devices of the device based on a determination that the second sensor data uniquely identifies the user.

### Claim 2 (depends on 1)

The device of claim 1, wherein the one or more sensors include a camera, wherein the second sensor data is image data, and wherein the image data includes a face of the user that is used to uniquely identify the user.

### Claim 3 (depends on 1)

The device of claim 1, wherein a plurality of faces are stored in the memory of the device and wherein the face of the user is compared against the plurality of faces to determine whether to present the content.

### Claim 4 (depends on 1)

The device of claim 1, wherein the one or more sensors include a camera, wherein the first sensor data is image data, and wherein the image data does not include a face of the user.

### Claim 5 (depends on 1)

The device of claim 1, wherein the one or more sensors include a microphone that receives sensor information from the user and wherein the first sensor data and the second sensor data is speech input from the user.

### Claim 6 (depends on 1)

The device of claim 1, wherein the hardware processor is further configured to determine a user identifier that uniquely identifies the user from the plurality of users associated with the device based on the second sensor data.

### Claim 7 (depends on 6)

The device of claim 6, wherein the hardware processor is further configured to select a content item associated with the user identifier.

### Claim 8 (depends on 6)

The device of claim 6, wherein the hardware processor is further configured to determine the user identifier that uniquely identifies the user prior to selecting a content item for presenting on the one or more user interface devices.

### Claim 9 (depends on 1)

The device of claim 1, wherein a plurality of user identifiers are stored in the memory of the device and wherein the first sensor data and the second sensor data are compared against the plurality of user identifiers to determine whether to present the content.

### Claim 10 (depends on 1)

The device of claim 1, wherein the content includes a plurality of available options, wherein each of the plurality of available options is selectable.

### Claim 11 (depends on 1)

The device of claim 1, wherein the content is selected based on a time of day corresponding to the second time point.

### Claim 12 (depends on 1)

The device of claim 1, wherein the one or more user interface devices includes a display.

### Claim 13 (depends on 1)

The device of claim 1, wherein the one or more user interface devices includes a touchscreen.

### Claim 14 (depends on 1)

The device of claim 1, wherein the one or more user interface devices includes a speaker.

### Claim 15 (depends on 1)

The device of claim 1, wherein the device is voice-operated.

### Claim 16

A method for transitioning content, comprising:
using a device comprising a memory, one or more user interface devices configured to provide an output to a user, a transceiver configured to wirelessly communicate with a communication network, one or more sensors, and a hardware processor that, when executing computer executable instructions stored in the memory, is configured to:
receive, at a first time point, from the one or more sensors associated with the device, first sensor data;
inhibit presentation of content on the one or more user interface devices of the device based on a determination that the first sensor data does not uniquely identify the user from a plurality of users associated with the device;
receive, at a second time point, from the one or more sensors associated with the device, second sensor data;
determine that the second sensor data uniquely identifies the user from the plurality of users associated with the device; and
cause the content to be presented on the one or more user interface devices of the device based on a determination that the second sensor data uniquely identifies the user.

### Claim 17 (depends on 16)

The method of claim 16, further comprising determining a user identifier that uniquely identifies the user from the plurality of users associated with the device based on the second sensor data.

### Claim 18 (depends on 17)

The method of claim 17, further comprising selecting a content item associated with the user identifier.

### Claim 19 (depends on 17)

The method of claim 17, further comprising determining the user identifier that uniquely identifies the user prior to selecting a content item for presenting on the one or more user interface devices.

### Claim 20 (depends on 16)

The method of claim 16, further comprising storing a plurality of user identifiers in the memory of the device and comparing the first sensor data and the second sensor data against the plurality of user identifiers to determine whether to present the content.
