# US 2016/0366203 A1 · Capturing a user reaction to media content based on a trigger signal and using the user reaction to determine an interest level associated with a segment of the media content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0366203 A1
- Document ID: US20160366203A1
- Status: Published application
- Kind: A1
- Application number: 14/737,772
- Filed: 2015-06-12
- Published: 2016-12-15
- Earliest claimed: 2015-06-12
- Assignees: Verizon Patent and Licensing Inc.
- Applicants: Verizon Patent and Licensing Inc.
- Inventors: Devin BLONG; Tina CHOU; I-Han CHEN; Tushar CHAUDHARY; Paresh VAKHARIYA; Annu YADAV; Mat MEJIA; Jason GOLDSMITH; Manish SHARMA
- Web page: https://patentgrep.com/patent/US20160366203A1

## CPC

- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- G06Q 30/0201: Market modelling; Market analysis; Collecting market data
- H04H 60/33: Arrangements for monitoring the users' behaviour or opinions
- H04H 60/37: for identifying segments of broadcast information, e.g. scenes or extracting programme ID
- H04L 51/10: Multimedia information
- H04L 51/52: for supporting social networking services
- H04L 65/1086: {session scope modification}
- H04L 65/4015: {where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference}
- H04L 65/612: for unicast
- H04N 21/42203: {sound input device, e.g. microphone}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/44213: {Monitoring of end-user related data (arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33)}
- H04N 21/4586: {Content update operation triggered locally, e.g. by comparing the version of software modules in a DVB carousel to the version stored locally (deployment, distribution, installation, update of software G06F8/65; error detection or correction of the data by redundancy during software upgrading G06F11/1433; arrangements for updating broadcast information or broadcast-related information H04H60/25)}
- H04H 60/46: for recognising users' preferences
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A device may receive an indication of a playback of media content. The device may receive a trigger signal associated with the playback of the media content. The trigger signal may indicate a point, within the playback of the media content, to capture user reaction information associated with the media content. The device may determine, based on the trigger signal, that the user reaction information is to be captured. The device may capture the user reaction information, to form captured user reaction information, based on determining that the user reaction information is to be captured. The captured user reaction information may include an audio recording or a video recording captured by the device. The device may cause the captured user reaction information and the media content to be linked.

## Claims

### Claim 1

A device, comprising:
one or more processors to:
receive an indication of a playback of media content;
receive one or more trigger signals associated with the playback of the media content,
the one or more trigger signals indicating a point, within the playback of the media content, to capture user reaction information associated with the media content;
determine, based on the one or more trigger signals, that the user reaction information is to be captured;
capture the user reaction information, to form captured user reaction information, based on determining that the user reaction information is to be captured,
the captured user reaction information including an audio recording or a video recording captured by the device; and
cause the captured user reaction information to be linked with the media content.

### Claim 2 (depends on 1)

The device of claim 1, where the one or more processors are to:
determine a segment of the media content being played at the point when the user reaction information is being captured; and
where the one or more processors, when causing the captured user reaction information to be linked with the media content, are to:
cause the captured user reaction information to be linked with the segment of the media content.

### Claim 3 (depends on 1)

The device of claim 1, where the one or more processors, when causing the captured user reaction information to be linked with the media content, are to:
cause the captured user reaction information to be linked with the media content to form linked content,
the linked content permitting synchronized playback of the media content and the captured user reaction information.

### Claim 4 (depends on 1)

The device of claim 1, where the one or more processors, when receiving the one or more trigger signals, are to:
detect the one or more trigger signals via one or more components of the device; or
receive information that identifies the one or more trigger signals from another device.

### Claim 5 (depends on 1)

The device of claim 1, where the one or more processors, when receiving the one or more trigger signals, are to:
receive information that identifies a segment of the media content during which the user reaction information is to be captured;
determine that the segment of the media content has begun playing; and
where the one or more processors, when determining that the user reaction information is to be captured, are to:
determine that the user reaction information is to be captured based on determining that the segment of the media content has begun playing.

### Claim 6 (depends on 1)

The device of claim 1, where the one or more processors, when receiving the one or more trigger signals, are to:
process the media content to determine at least one of:
a volume level associated with the media content,
a frequency of sound included in the media content, or
a rate of change of content across frames of the media content; and
where the one or more processors, when determining that the user reaction information is to be captured are to:
determine that the user reaction information is to be captured based on processing the media content to determine the at least one of:
the volume level
the frequency, or
the rate of change.

### Claim 7 (depends on 1)

The device of claim 1, where the one or more processors, when receiving the one or more trigger signals, are to:
receive information that identifies a type of the media content;
determine that the media content is of a particular type based on receiving the information that identifies the type of the media content; and
where the one or more processors, when determining that the user reaction information is to be captured, are to:
determine that the user reaction information is to be captured based on determining that the media content is of the particular type.

### Claim 8

A computer-readable medium storing instructions, the instructions comprising:
one or more instructions that, when executed by one or more processors, cause the one or more processors to:
receive an indication that media content is being presented;
detect one or more trigger signals that indicate a point, within the media content, to capture user reaction information associated with the media content;
determine, based on the one or more trigger signals, that the user reaction information is to be captured;
capture the user reaction information, to form captured user reaction information, based on determining that the user reaction information is to be captured,
the captured user reaction information including an audio recording or a video recording; and
store the captured user reaction information.

### Claim 9 (depends on 8)

The computer-readable medium of claim 8, where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
identify a segment of the media content being presented at the point when the user reaction information is being captured; and
where the one or more instructions, that cause the one or more processors to store the captured user reaction information, cause the one or processors to:
store the captured user reaction information in association with information that identifies the segment of the media content.

### Claim 10 (depends on 8)

The computer-readable medium of claim 8, where the one or more instructions, when executed by the one or more processors, cause the one or more processors to:
link the captured user reaction information and the media content to form linked content,
the linked content permitting concurrent playback of the media content and the captured user reaction information.

### Claim 11 (depends on 8)

The computer-readable medium of claim 8, where the one or more instructions, that cause the one or more processors to detect the one or more trigger signals, cause the one or more processors to:
process captured information,
the captured information being recorded by a device that includes the one or more processors;
determine based on processing the captured information, at least one of:
a volume level associated with the captured information
a frequency of sound included in the captured information, or
a rate of change of content across frame of the captured information; and
where the one or more instructions, that cause the one or more processors to determine that the user reaction is to be captured, cause the one or more processors to:
determine that the user reaction information is to be captured based on determining the at least one of:
the volume level,
the frequency, or
the rate of change.

### Claim 12 (depends on 8)

The computer-readable medium of claim 8, where the one or more instructions, that cause the one or more processors to detect the one or more trigger signals, cause the one or more processors to:
capture facial recognition information; and
where the one or more instructions, that cause the one or more processors to determine that the user reaction information is to be captured, cause the one or more processors to:
determine that the user reaction information is to be captured based on the facial recognition information.

### Claim 13 (depends on 8)

The computer-readable medium of claim 8, where the one or more instructions, that cause the one or more processors to detect the one or more trigger signals, cause the one or more processors to:
detect an environmental factor independent of the media content and the captured user reaction information; and
where the one or more instructions, that cause the one or more processors to determine that the user reaction information is to be captured, cause the one or more processors to:
determine that the user reaction information is to be captured based on the environmental factor.

### Claim 14 (depends on 8)

The computer-readable medium of claim 8, where the one or more instructions, that cause the one or more processors to detect the one or more trigger signals, cause the one or more processors to:
detect a plurality of trigger signals that indicate the point to capture the user reaction information; and
where the one or more instructions, that cause the one or more processors to determine that the user reaction information is to be captured, cause the one or more processors to:
determine, based on the plurality of trigger signals, that the user reaction information is to be captured.

### Claim 15

A method, comprising:
receiving, by a device, an indication that media content is being presented;
detecting, by the device, one or more trigger signals that indicate a point, within the media content, to capture user reaction information to be associated with a segment of the media content,
the user reaction information including a recording captured by the device during a time period when the segment of the media content is being presented;
recording, by the device and based on detecting the one or more trigger signals and without user input, the user reaction information;
identifying, by the device, the segment of the media content associated with the user reaction information; and
associating, by the device, the user reaction information and the segment of the media content.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
analyzing the one or more trigger signals to determine that the user reaction information is to be recorded; and
where recording the user reaction information compromises:
recording the user reaction information based on analyzing the one or more trigger signals.

### Claim 17 (depends on 15)

The method of claim 15, where associating the user reaction information and the segment of the media content comprises:
associating the user reaction information and the segment of the media content to form linked content,
the linked content permitting the user reaction information to be presented concurrently with the segment of media content.

### Claim 18 (depends on 15)

The method of claim 15, compromising:
receiving an interest level indicator that indicates an interest level associated with the segment of media content,
the interest level being determined based on the user reaction information; and
providing information that identifies the interest level in association with presentation of the media content.

### Claim 19 (depends on 18)

The method of claim 18, where providing the information that identifies the interest level comprises:
providing the information that identifies the interest level via visual information associated with the media content.

### Claim 20 (depends on 19)

The method of claim 19, where providing the information that identifies the interest level via the visual information comprises:
providing the information that identifies the interest level in association with a portion of the visual information that corresponds to the segment of the media content.