# US 11,910,061 B2 · Leveraging emotional transitions in media to modulate emotional impact of secondary content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,910,061 B2 - Document ID: US11910061B2 - Status: Granted - Kind: B2 - Application number: 17/750,666 - Filed: 2022-05-23 - Published: 2023-11-23 - Granted: 2024-02-20 - Earliest claimed: 2022-05-23 - Assignees: Rovi Guides, Inc. - Applicants: Rovi Guides, Inc. - Inventors: Mona Singh - Web page: https://patentgrep.com/patent/US11910061B2 ## CPC - H04N 21/4667: {Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections} - H04N 21/42201: {biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user (input arrangements for interaction with the human body based on nervous system activity detection G06F3/015)} - H04N 21/44016: {involving splicing one content stream with another content stream, e.g. for substituting a video clip} - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Systems and methods for determining emotional responses to videos, generating emotional arc based on the responses and reactions, and determining the type and/or point of insertion of secondary content based on the determined emotional responses are disclosed. The methods display primary content to a plurality of users and determine their emotional response as they consume the primary content. An average emotional arc is generated based on the determined emotional response and it is compared to a current emotional arc generated based on emotional response from a current user. When values of the current emotional are within a predefined range of the average emotional arc at a particular play position in the timeline of the primary content, a secondary content that is designated for the value of the current emotional arc is inserted in the primary content at the particular play position. ## Claims ### Claim 1 A method comprising: causing a display on a media device, at a first play position in primary content, of a first part of a multiple part secondary content; determining an emotional reaction of a user that has consumed the displayed first part of the secondary content, which is contextually related to a second part of the secondary content, based on biometric data obtained through one or more devices that monitor the user; and comparing the determined emotional reaction of the user to an estimated emotional reaction for the first part of the multiple part secondary content to determine whether the user's emotional reaction to the first part of the secondary content is within a range of the estimated emotional reaction, wherein the estimated emotional reaction for the first part of the multiple part secondary content is based on the biometric data obtained via the one or more devices monitoring each user from a plurality of users. ### Claim 2 (depends on 1) The method of claim 1, further comprising: determining that the user's emotional reaction to the first part of the secondary content is within the range of the estimated emotional reaction; and in response to the determination that the user's emotional reaction to the first part of the secondary content is within the range of the estimated emotional reaction, causing display of the second part of the secondary content that has been designated for the estimated emotional reaction. ### Claim 3 (depends on 1) The method of claim 1, further comprising: determining that the user's emotional reaction to the first part of the secondary content is not within the range of the estimated emotional reaction; and in response to the determination that the user's emotional reaction to the first part of the secondary content is not within the range of the estimated emotional reaction: determining an emotional value associated with the user's emotional reaction to the first part of the secondary content; and causing displaying of a third part of the secondary content that has been designated for the determined emotional value associated with the user's emotional reaction, wherein the second part and the third part are alternate versions of the multiple part secondary content. ### Claim 4 (depends on 1) The method of claim 1, wherein the user's emotional reaction to the display of the first part of the secondary content is determined in real-time. ### Claim 5 (depends on 1) The method of claim 1, further comprising: determining that the user's emotional reaction to the first part of the secondary content is within the range of the estimated emotional reaction; and in response to the determination that the user's emotional reaction to the first part of the secondary content is within the range of the estimated emotional reaction: determining whether the second part of the secondary content that is associated with a value of the estimated emotional reaction is available for display; and in response to determining that the second part of the secondary content that is associated with the value of the estimated emotional reaction is not available for display, displaying a third part of the secondary content, wherein the third part is an alternate version of the second part and is associated with a value of an emotional reaction that is a next closest to the value of the estimated emotional reaction. ### Claim 6 (depends on 1) The method of claim 1, wherein the biometric data obtained via the one or more devices monitoring each user from the plurality of users relates to an emotional reaction by the plurality of users that have previously consumed the first part of the secondary content. ### Claim 7 (depends on 6) The method of claim 6, wherein the biometric data obtained through the one or more devices that monitor the user is related to the user's gaze. ### Claim 8 (depends on 6) The method of claim 6, wherein the biometric data is generated using electronic devices that include components selected from a group consisting of camera, sensor, gyroscope, accelerometer, motion sensor, heartbeat or pulse monitor, skin sensor, and lidar. ### Claim 9 (depends on 1) The method of claim 1, further comprising, generating an estimated emotional arc, wherein the estimated emotional arc is generated based on estimated emotional reaction data that is either gathered from the plurality of users or provided by a creator or producer of the first part of the secondary content. ### Claim 10 (depends on 1) The method of claim 1, wherein the second part of the secondary content is displayed after a segment of the primary content has been displayed that follows the first part of the secondary content. ### Claim 11 A system comprising: communications circuitry to access primary content; and control circuitry to: transmit, using the communications circuitry, a first part of a multiple part secondary content and cause a display of the transmitted first part at a first play position in the primary content; determine an emotional reaction of a user that has consumed the displayed first part of the secondary content, which is contextually related to a second part of the secondary content, based on biometric data obtained through one or more devices that monitor the user; and compare the determined emotional reaction of the user to an estimated emotional reaction for the first part of the multiple part secondary content to determine whether the user's emotional reaction to the first part of the secondary content is within a range of the estimated emotional reaction, wherein the estimated emotional reaction for the first part of the multiple part secondary content is based on the biometric data obtained via the one or more devices monitoring each user from a plurality of users. ### Claim 12 (depends on 11) The system of claim 11, further comprising, the control circuitry configured to: determine that the user's emotional reaction to the first part of the secondary content is within the range of the estimated emotional reaction; and in response to the determination that the user's emotional reaction to the first part of the secondary content is within the range of the estimated emotional reaction, cause display of the second part of the secondary content that has been designated for the estimated emotional reaction. ### Claim 13 (depends on 11) The system of claim 11, further comprising, the control circuitry configured to: determine that the user's emotional reaction to the first part of the secondary content is not within the range of the estimated emotional reaction; and in response to the determination that the user's emotional reaction to the first part of the secondary content is not within the range of the estimated emotional reaction: determine an emotional value associated with the user's emotional reaction to the first part of the secondary content; and cause displaying of a third part of the secondary content that has been designated for the determined emotional value associated with the user's emotional reaction, wherein the second part and the third part are alternate versions of the multiple part secondary content. ### Claim 14 (depends on 11) The system of claim 11, wherein the user's emotional reaction to the display of the first part of the secondary content is determined by the control circuitry in real-time. ### Claim 15 (depends on 11) The system of claim 11, further comprising, the control circuitry configured to: determine that the user's emotional reaction to the first part of the secondary content is within the range of the estimated emotional reaction; and in response to the determination that the user's emotional reaction to the first part of the secondary content is within the range of the estimated emotional reaction: determine whether the second part of the secondary content that is associated with a value of the estimated emotional reaction is available for display; and in response to determining that the second part of the secondary content that is associated with the value of the estimated emotional reaction is not available for display, display a third part of the secondary content, wherein the third part is an alternate version of the second part and is associated with a value of an emotional reaction that is a next closest to the value of the estimated emotional reaction. ### Claim 16 (depends on 11) The system of claim 11, wherein the biometric data obtained via the one or more devices monitoring each user from the plurality of users relates to an emotional reaction by the plurality of users that have previously consumed the first part of the secondary content. ### Claim 17 (depends on 16) The system of claim 16, wherein the biometric data obtained through the one or more devices that monitor the user is related to the user's gaze. ### Claim 18 (depends on 16) The system of claim 16, wherein the biometric data is generated by the control circuitry using electronic devices that include components selected from a group consisting of camera, sensor, gyroscope, accelerometer, motion sensor, heartbeat or pulse monitor, skin sensor, and lidar. ### Claim 19 (depends on 11) The system of claim 11, further comprising, the control circuitry configured to generate an estimated emotional arc, wherein the estimated emotional arc is generated based on estimated emotional reaction data that is either gathered by the control circuitry from the plurality of users or provided by a creator or producer of the first part of the secondary content. ### Claim 20 (depends on 11) The system of claim 11, wherein the second part of the secondary content is displayed by the control circuitry after a segment of the primary content has been displayed that follows the first part of the secondary content.