# US 2022/0279247 A1 · Methods and apparatus to determine engagement levels of audience members

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0279247 A1
- Document ID: US20220279247A1
- Status: Published application
- Kind: A1
- Application number: 17/750,157
- Filed: 2022-05-20
- Published: 2022-09-01
- Earliest claimed: 2012-12-27
- Assignees: The Nielsen Company (US), LLC
- Applicants: The Nielsen Company (US), LLC
- Inventors: Alejandro Terrazas
- Web page: https://patentgrep.com/patent/US20220279247A1

## CPC

- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/44231: {Monitoring of peripheral device or external card, e.g. to detect processing problems in a handheld device or the failure of an external recording device (configuring of peripheral devices in general G06F9/4411; reporting information sensed by appliance or service execution status of appliance services in a home automation network H04L12/2823; monitoring the status of connected device in data switched networks H04L43/0817)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and apparatus to determine engagement levels of audience members are disclosed. An example apparatus includes means for detecting whether an environment associated with a first device includes a second device with a display that is illuminated. The example apparatus also includes means for calculating an engagement of a user with respect to the first device based on a proximity between the user and the illuminated display.

## Claims

### Claim 1

An audience measurement system to obtain exposure data for a media exposure environment using audio signatures, the audience measurement system comprising:
a camera;
machine readable instructions; and
processor circuitry to execute the machine readable instructions to:
generate an audio signature of media presented by a television within the media exposure environment;
obtain media identification data corresponding to the media based on the audio signature;
determine an eye gaze direction of an audience member based on an image of the media exposure environment, the image captured by the camera while the media corresponding to the media identification data is presented,
determine an engagement level of the audience member based on the eye gaze direction, and
determine the audience member matches a panelist associated with the media exposure environment;
obtain audience identification information based on the match; and
network interface circuitry to provide the media identification data, the engagement level, and the audience identification information to a data collection facility via a network.

### Claim 2 (depends on 1)

The audience measurement system of claim 1, wherein the audio signature is a representation of a frequency spectrum of an audio signal of the media.

### Claim 3 (depends on 2)

The audience measurement system of claim 2, wherein:
the data collection facility is managed by an audience measurement entity,
the panelist is a registered panelist of the audience measurement entity,
the media exposure environment is a room in a household of the panelist, and
the processor circuitry is to determine the audience identification information based on facial recognition on the image and a facial signature associated with the panelist.

### Claim 4 (depends on 3)

The audience measurement system of claim 3, wherein the processor circuitry is to:
access a facial signature of the panelist;
access data identifying the panelist; and
cause storage of the facial signature in association with the data identifying the panelist in a database.

### Claim 5 (depends on 3)

The audience measurement system of claim 3, wherein:
the camera is above the television,
the processor circuitry is a component of a housing that is separate from the camera, and
the processor circuitry is to communicate with the camera via a wired connection.

### Claim 6 (depends on 3)

The audience measurement system of claim 3, wherein the audience identification information includes an identifier associated with the panelist.

### Claim 7 (depends on 3)

The audience measurement system of claim 3, wherein the engagement level is an attentiveness metric indicative of a level of attention paid by the audience member to the media.

### Claim 8 (depends on 1)

The audience measurement system of claim 1, wherein the processor circuitry is to analyze the image to determine a people tally, the people tally to indicate a count of people in the media exposure environment while the media corresponding to the media identification data is presented.

### Claim 9 (depends on 1)

The audience measurement system of claim 1, wherein the processor circuitry is to determine the engagement level for the audience member by:
determining eye position information of the audience member based on the image;
determining the eye gaze direction of the audience member by computing a line of sight of the audience member based on the eye position information; and
determining whether the audience member is looking at the television based on the eye gaze direction, the engagement level based on the determination of whether the audience member is looking at the television.

### Claim 10 (depends on 1)

The audience measurement system of claim 1, wherein:
the processor circuitry is to access data identifying a portion of the image known to include a person, and the processor circuitry is to determine the eye gaze direction by analyzing the portion of the image.

### Claim 11

An audience measurement system comprising:
a camera;
memory including media detection software and audience detection software,
processor circuitry to execute the media detection software to:
generate an audio signature of media presented by a television within a media exposure environment;
identify media identification data based on the audio signature, the media identification data corresponding to the media;
the processor circuitry to execute the audience detection software to:
determine an eye gaze direction of an audience member appearing in an image of the media exposure environment, the image obtained by the camera while the media corresponding to the media identification data is presented by the television;
determine an engagement level of the audience member with the media based on the eye gaze direction;
determine the audience member matches a panelist associated with the audience measurement system; and
access audience identification information for the panelist; and
network interface circuitry to transmit the media identification data, the engagement level, and the audience identification information to a data collection facility via a network.

### Claim 12 (depends on 11)

The audience measurement system of claim 11, wherein the audio signature is a representation of a frequency spectrum of an audio signal of the media.

### Claim 13 (depends on 12)

The audience measurement system of claim 12, wherein:
the data collection facility is managed by an audience measurement entity,
the panelist is a registered panelist of the audience measurement entity,
the media exposure environment is a room in a household of the panelist, and
the processor circuitry is to determine the audience identification information based on facial recognition analysis of the image and a facial signature associated with the panelist.

### Claim 14 (depends on 13)

The audience measurement system of claim 13, wherein the processor circuitry is to:
access a facial signature of the panelist;
access panelist identifying data obtained via a registration process; and
cause storage of the facial signature in a database in association with the panelist identifying data.

### Claim 15 (depends on 13)

The audience measurement system of claim 13, wherein:
the camera is above the television,
the processor circuitry is resident in a meter, the meter is separate from the camera, and
the meter is to communicate with the camera via a wired connection.

### Claim 16 (depends on 13)

The audience measurement system of claim 13, wherein the audience identification information includes an identifier associated with the panelist.

### Claim 17 (depends on 13)

The audience measurement system of claim 13, wherein the engagement level is associated with an amount of attention the audience member gives to the media.

### Claim 18 (depends on 11)

The audience measurement system of claim 11, wherein the processor circuitry is to:
determine eye position information of the audience member based on the image;
determine the eye gaze direction of the audience member by computing a line of sight of the audience member based on the determined eye position information; and
determine the audience member is looking at the television based on the eye gaze direction, the engagement level based on whether the audience member is looking at the television.

### Claim 19 (depends on 11)

The audience measurement system of claim 11, wherein the processor circuitry is to analyze the image to determine a people tally, the people tally corresponding to a count of people in the media exposure environment while the media corresponding to the media identification data is presented.

### Claim 20 (depends on 11)

The audience measurement system of claim 11, wherein the processor circuitry is to determine a number of people in the image of the media exposure environment.

### Claim 21

A method for obtaining exposure data for a media exposure environment using audio signatures, the method comprising:
generating an audio signature of media presented by a television within a media exposure environment;
obtaining, based on the audio signature, media identification data corresponding to the media;
determining, by executing instructions with processor circuitry, an eye gaze direction of an audience member based on an image, the image captured by a camera while the media corresponding to the media identification data is presented;
determining an engagement level for the audience member based on the determined eye gaze direction;
determining audience identification information including an indication that the audience member matches a panelist associated with an audience measurement system; and
providing the media identification data, the engagement level, and the audience identification information to a data collection facility via a network.

### Claim 22 (depends on 21)

The method of claim 21, wherein the audio signature is a representation of a frequency spectrum of an audio signal of the media.

### Claim 23 (depends on 21)

The method of claim 21, further comprising:
determining eye position information of the audience member using the image;
determining the eye gaze direction of the audience member by computing a line of sight of the audience member using the determined eye position information; and
determining whether the audience member is looking at the television based on the eye gaze direction, wherein the engagement level is based on the determination of whether the audience member is looking at the television.

### Claim 24

An audience measurement system to obtain exposure data for a media exposure environment, the audience measurement system comprising:
media detector software to cause an electronic device to:
generate an audio signature of media presented by a television within the media exposure environment; and
obtain media identification data corresponding to the media, the media identification data obtained based on the audio signature;
audience detector software to cause the electronic device to:
determine eye position information of an audience member appearing in an image, the image captured by a camera while the media corresponding to the media identification data is presented;
determine an eye gaze direction of the audience member by computing a line of sight of the audience member based on the eye position information;
determine an engagement level based on the eye gaze direction, the engagement level corresponding to a level of attention of the audience member with respect to the media;
determine the audience member matches a panelist; and
access audience identification information corresponding to the panelist; and
network interface circuitry to transfer the media identification data, the engagement level, and the audience identification information to a data collection facility via a network.

### Claim 25 (depends on 24)

The audience measurement system of claim 24, wherein the audience detector software is to:
cause the electronic device to obtain data indicative of a portion of the image known to include a person; and
analyze the portion of the image indicated by the obtained data to determine the eye position information.
