# US 2022/0279245 A1 · Methods and apparatus to determine engagement levels of audience members

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0279245 A1
- Document ID: US20220279245A1
- Status: Published application
- Kind: A1
- Application number: 17/750,141
- Filed: 2022-05-20
- Published: 2022-09-01
- Earliest claimed: 2012-12-27
- Assignees: The Nielsen Company (US), LLC
- Applicants: The Nielsen Company (US), LLC
- Inventors: Alejandro Terrazas
- Web page: https://patentgrep.com/patent/US20220279245A1

## CPC

- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/44231: {Monitoring of peripheral device or external card, e.g. to detect processing problems in a handheld device or the failure of an external recording device (configuring of peripheral devices in general G06F9/4411; reporting information sensed by appliance or service execution status of appliance services in a home automation network H04L12/2823; monitoring the status of connected device in data switched networks H04L43/0817)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and apparatus to determine engagement levels of audience members are disclosed. An example apparatus includes means for detecting whether an environment associated with a first device includes a second device with a display that is illuminated. The example apparatus also includes means for calculating an engagement of a user with respect to the first device based on a proximity between the user and the illuminated display.

## Claims

### Claim 1

An audience measurement system to obtain exposure data for a media exposure environment, the audience measurement system comprising:
a camera;
memory;
machine readable instructions;
processor circuitry to execute the machine readable instructions to:
generate an audio signature of media presented by a television within the media exposure environment,
obtain, based on the audio signature, media identification data corresponding to the media;
determine, based on an image of an audience member obtained by the camera while the media corresponding to the media identification data is presented, whether the audience member appearing in the image is facing toward the television,
determine an engagement level for the audience member based on whether the audience member is facing toward the television, and
determine audience identification information based on a match between the audience member and a panelist associated with the media exposure environment; and
network interface circuitry to output the media identification data, the engagement level, and the audience identification information to a data collection facility via a network.

### Claim 2 (depends on 1)

The audience measurement system of claim 1, wherein the audio signature is a representation of a frequency spectrum of an audio signal of the media.

### Claim 3 (depends on 2)

The audience measurement system of claim 2, wherein:
the data collection facility is managed by an audience measurement entity,
the panelist is registered with the audience measurement entity,
the media exposure environment is a room in a household of the panelist, and
the processor circuitry is to determine the audience identification information by performing facial recognition based on the image of the audience member and a facial signature associated with the panelist.

### Claim 4 (depends on 3)

The audience measurement system of claim 3, wherein the audience measurement entity is to:
obtain the facial signature of the panelist based on an image of the panelist;
obtain panelist identification data from the panelist; and
cause storage of the facial signature in a database in association with the panelist identification data.

### Claim 5 (depends on 3)

The audience measurement system of claim 3, wherein:
the camera is above the television,
the processor circuitry is a component of a meter that is separate from the camera, and
the meter and the camera communicate via a wired connection.

### Claim 6 (depends on 3)

The audience measurement system of claim 3, wherein the audience identification information includes an identifier associated with the panelist.

### Claim 7 (depends on 3)

The audience measurement system of claim 3, wherein the engagement level is an attentiveness metric indicative of how attentive the audience member is to the television.

### Claim 8 (depends on 1)

The audience measurement system of claim 1, wherein the processor circuitry is to determine whether the audience member is facing toward the television by: (i) obtaining a skeletal framework corresponding to a body of the audience member based on the image, (ii) identifying a head pose of the audience member based on the skeletal framework, and (iii) using the identified head pose to determine whether the audience member is facing toward the television.

### Claim 9 (depends on 8)

The audience measurement system of claim 8, wherein the processor circuitry is to identify an emotional state of the audience member based on the identified head pose.

### Claim 10 (depends on 1)

The audience measurement system of claim 1, wherein the processor circuitry is to analyze the image to determine a people tally, the people tally indicative of a count of people in the media exposure environment while the media corresponding to the media identification data is presented.

### Claim 11 (depends on 1)

The audience measurement system of claim 1, wherein:
the processor circuitry is to obtain data indicative of a portion of the image known to include a person, and
determine whether the audience member is facing toward the television by analyzing the portion of the image indicated by the obtained data.

### Claim 12

An audience measurement system comprising:
a camera;
machine readable instructions;
processor circuitry to execute the machine readable instructions to:
generate an audio signature of media presented by a television within a media exposure environment;
obtain media identification data based on the audio signature, the media identification data corresponding to the media;
analyze an image of the media exposure environment to determine whether an audience member is facing toward the television in the media exposure environment, the image captured by the camera while the media corresponding to the media identification data is presented on the television;
determine an engagement level of the audience member based on whether the audience member is facing toward the television;
determine audience identification information indicative of demographics that matches the audience member; and
cause the media identification data, the engagement level, and the audience identification information to be provided to a data collection facility via a network.

### Claim 13 (depends on 12)

The audience measurement system of claim 12, wherein the audio signature is a representation of a frequency spectrum of an audio signal of the media.

### Claim 14 (depends on 13)

The audience measurement system of claim 13, wherein the data collection facility is associated with an audience measurement entity, the audience member is a panelist registered with the audience measurement entity, the media exposure environment is in a household of the panelist, and the processor circuitry is to determine the audience identification information by performing facial recognition based on the image and a facial signature associated with the panelist.

### Claim 15 (depends on 14)

The audience measurement system of claim 14, wherein the audience measurement entity is to:
obtain a facial signature of the panelist;
obtain panelist identifying data from the panelist; and
cause storage of the facial signature and the panelist identifying data in a database.

### Claim 16 (depends on 12)

The audience measurement system of claim 12, wherein the camera is adjacent the television, the processor circuitry is separate from the camera, and the processor circuitry is to communicate with the camera via a wired connection.

### Claim 17 (depends on 12)

The audience measurement system of claim 12, wherein the audience identification information includes an identifier associated with the audience member.

### Claim 18 (depends on 12)

The audience measurement system of claim 12, wherein the engagement level is indicative of a degree of attentiveness of the audience member to the media.

### Claim 19 (depends on 12)

The audience measurement system of claim 12, wherein the processor circuitry is to determine whether the audience member is facing toward the television using the image based on a head pose of the audience member in the image.

### Claim 20 (depends on 12)

The audience measurement system of claim 12, wherein the processor circuitry is to analyze the image to determine a people tally indicative of a number of people in the media exposure environment.

### Claim 21 (depends on 12)

The audience measurement system of claim 12, wherein the processor circuitry is to analyze the image to determine a number of people exposed to the media in the media exposure environment.

### Claim 22

A method for obtaining exposure data for a media exposure environment using audio signatures, the method comprising:
generating an audio signature of media presented by a television within a media exposure environment;
obtaining, based on the audio signature, media identification data corresponding to the media;
determining, using an image obtained while the media corresponding to the media identification data is presented, whether an audience member is facing toward the television;
determining an engagement level for the audience member based on whether the audience member is facing toward the television;
determining audience identification information of a panelist associated with an audience measurement system, the panelist corresponding to the audience member; and
providing the media identification data, the engagement level, and the audience identification information to a data collection facility via a network.

### Claim 23 (depends on 22)

The method of claim 22, wherein the audio signature is a representation of a frequency spectrum of an audio signal of the media.

### Claim 24 (depends on 23)

The method of claim 23, wherein:
the data collection facility is managed by an audience measurement entity, the media exposure environment is a room in a home of the panelist, and further including registering the panelist with the audience measurement entity.

### Claim 25 (depends on 24)

The method of claim 24, wherein the registering of the panelist further includes:
obtaining a facial signature of the panelist;
obtaining, from the panelist, data identifying the panelist; and
storing the facial signature and the data identifying the panelist in a database.

### Claim 26 (depends on 22)

The method of claim 22, wherein the determining of whether the audience member is facing toward the television using the image includes:
obtaining a skeletal framework corresponding to a body of the audience member, the skeletal framework based on the image;
identifying a head pose of the audience member based on the skeletal framework; and
using the identified head pose to determine whether the audience member is facing toward the television.

### Claim 27 (depends on 22)

The method of claim 22, further including:
obtaining data indicative of a portion of the image known to include a person; and
wherein the determining of whether the audience member is facing toward the television is based on the portion of the image known to include the person.

### Claim 28

An audience measurement system to obtain exposure data for a media exposure environment, the audience measurement system comprising:
a camera;
an electronic device including (1) at least one of media detector instructions or media detector circuitry, and (2) at least one of audience detector instructions or audience detector circuitry;
the at least one of media detector instructions or media detector circuitry to:
generate an audio signature of media presented by a television within the media exposure environment, and
obtain media identification data based on the audio signature, the media identification data corresponding to the media;
the at least one of audience detector instructions or audience detector circuitry to:
obtain a skeletal framework corresponding to a body of an audience member, the skeletal framework based on an image captured by the camera, the image captured by the camera while the media corresponding to the media identification data is presented on the television,
identify a head pose of the audience member based on the skeletal framework,
identify an emotional state of the audience member based on the identified head pose,
determine an engagement level for the audience member based on the emotional state, and
determine audience identification information of a panelist associated with the audience detector, the panelist corresponding to the audience member; and
network interface circuitry to provide the media identification data, the engagement level, and the audience identification information to a data collection facility via a network.

### Claim 29 (depends on 28)

The audience measurement system of claim 28, wherein:
the at least one of audience detector instructions or audience detector circuitry is to obtain data indicative of a portion of the image known to include a person, and
identify the head pose based on the portion of the image.
