# US 12,192,584 B2 · Leveraging emotional transitions in media to modulate emotional impact of secondary content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,192,584 B2 - Document ID: US12192584B2 - Status: Granted - Kind: B2 - Application number: 18/521,071 - Filed: 2023-11-28 - Published: 2024-03-21 - Granted: 2025-01-07 - Earliest claimed: 2022-05-23 - Assignees: Adeia Guides Inc. - Applicants: Adeia Guides Inc. - Inventors: Mona Singh - Web page: https://patentgrep.com/patent/US12192584B2 ## CPC - H04N 21/4667: {Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections} - H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement} - H04N 21/42201: {biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user (input arrangements for interaction with the human body based on nervous system activity detection G06F3/015)} - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Systems and methods for determining emotional responses to videos, generating emotional arc based on the responses and reactions, and determining the type and/or point of insertion of secondary content based on the determined emotional responses are disclosed. The methods display primary content to a plurality of users and determine their emotional response as they consume the primary content. An average emotional arc is generated based on the determined emotional response and it is compared to a current emotional arc generated based on emotional response from a current user. When values of the current emotional are within a predefined range of the average emotional arc at a particular play position in the timeline of the primary content, a secondary content that is designated for the value of the current emotional arc is inserted in the primary content at the particular play position. ## Claims ### Claim 1 A method comprising: generating a primary emotional arc and a secondary emotional arc, wherein the primary emotional arc is generated based on emotional reaction data from a first plurality of users that have previously consumed a primary video and the secondary emotional arc is generated based on emotional reaction data from a second plurality of users that have previously consumed a secondary video; determining points of intersection between the primary emotional arc and the secondary emotional arc, wherein each point of intersection is associated with an impact score; selecting a point of intersection, from the determined points of intersection, based on the impact score; and inserting in the primary video displayed on a display of an electronic device, the secondary video at the selected point of intersection. ### Claim 2 (depends on 1) The method of claim 1 further comprising: monitoring a current user's emotional response to the secondary video that was inserted at the selected point of intersection, wherein the current user's emotional response is based on the current user's consumption of the secondary video; and comparing the current user's emotional response to an expected emotional response, wherein the expected emotional response is based on the emotional reaction data from the second plurality of users that have previously consumed the secondary video. ### Claim 3 (depends on 2) The method of claim 2, further comprising: determining, based on the comparing, that the current user's emotional response is not within a predetermined threshold of the expected emotional response that is based on the emotional reaction data from the second plurality of users that have previously consumed the secondary video; and in response to determining that the current user's emotional response is not within the predetermined threshold of the expected emotional response, identifying another secondary video and a point of insertion for inserting the identified secondary video into the primary video. ### Claim 4 (depends on 1) The method of claim 1, wherein the selected point of intersection, from the determined points of intersection, is associated with a highest impact score. ### Claim 5 (depends on 4) The method of claim 4, wherein the highest impact score is associated with a highest impact on a current user's emotional state if the secondary video is inserted at the selected point of insertion. ### Claim 6 (depends on 1) The method of claim 1, wherein the first plurality of users are same users as the second plurality of users. ### Claim 7 (depends on 1) The method of claim 1, wherein inserting the secondary video at the selected point of intersection further comprises: determining a play position in the primary video at the selected point of intersection; and inserting in the secondary video at the determined play position in the primary video. ### Claim 8 (depends on 1) The method of claim 1, wherein the selected point of intersection is associated with the primary emotional arc and the secondary emotional arc having an emotional value that is within a predetermined threshold of each other. ### Claim 9 (depends on 1) The method of claim 1, wherein generating the primary emotional arc comprises: displaying the primary video to the first plurality of users; obtaining emotional response data from the first plurality of users based on their consumption of the primary video; and generating the primary emotional arc based on an average of the received emotional response data from the first plurality of users. ### Claim 10 (depends on 9) The method of claim 9, further comprising using devices capable of collecting biometric data that are communicatively connected with a media device used by each user, from the first plurality of users, to obtain the emotional response data, wherein the devices used to collect the biometric means include any one or more of a motion sensor, a heartbeat or pulse monitor, a skin sensor, a gyroscope, and an accelerometer. ### Claim 11 A system comprising: communications circuitry for transmitting a video stream to a media device; and control circuitry to: generate a primary emotional arc and a secondary emotional arc, wherein the primary emotional arc is generated based on emotional reaction data from a first plurality of users that have previously consumed a primary video and the secondary emotional arc is generated based on emotional reaction data from a second plurality of users that have previously consumed a secondary video; determine points of intersection between the primary emotional arc and the secondary emotional arc, wherein each point of intersection is associated with an impact score; select a point of intersection, from the determined points of intersection, based on the impact score; and insert in the primary video displayed on a display of an electronic device, the secondary video at the selected point of intersection. ### Claim 12 (depends on 11) The system of claim 11, further comprising, the control circuitry configured to: monitor a current user's emotional response to the secondary video that was inserted at the selected point of intersection, wherein the current user's emotional response is based on the current user's consumption of the secondary video; and compare the current user's emotional response to an expected emotional response, wherein the expected emotional response is based on the emotional reaction data from the second plurality of users that have previously consumed the secondary video. ### Claim 13 (depends on 12) The system of claim 12, further comprising, the control circuitry configured to: determine, based on the comparing, that the current user's emotional response is not within a predetermined threshold of the expected emotional response that is based on the emotional reaction data from the second plurality of users that have previously consumed the secondary video; and in response to determining that the current user's emotional response is not within the predetermined threshold of the expected emotional response, identify another secondary video and a point of insertion for inserting the identified secondary video into the primary video. ### Claim 14 (depends on 11) The system of claim 11, wherein the selected point of intersection, from the determined points of intersection, is associated with a highest impact score. ### Claim 15 (depends on 14) The system of claim 14, wherein the highest impact score is associated with a highest impact on a current user's emotional state if the secondary video is inserted at the selected point of insertion. ### Claim 16 (depends on 11) The system of claim 11, wherein the first plurality of users are same users as the second plurality of users. ### Claim 17 (depends on 11) The system of claim 11, wherein inserting the secondary video at the selected point of intersection further comprises, the control circuitry configured to: determining a play position in the primary video at the selected point of intersection; and inserting in the secondary video at the determined play position in the primary video. ### Claim 18 (depends on 11) The system of claim 11, wherein the selected point of intersection is associated with the primary emotional arc and the secondary emotional arc having an emotional value that is within a predetermined threshold of each other. ### Claim 19 (depends on 11) The system of claim 11, wherein generating the primary emotional arc further comprises, the control circuitry configured to: display the primary video to the first plurality of users; obtain emotional response data from the first plurality of users based on their consumption of the primary video; and generate the primary emotional arc based on an average of the received emotional response data from the first plurality of users. ### Claim 20 (depends on 19) The system of claim 19, further comprising, the control circuitry configured to use devices capable of collecting biometric data that are communicatively connected with the media device used by each user, from the first plurality of users, to obtain the emotional response data, wherein the devices used to collect the biometric means include any one or more of a motion sensor, a heartbeat or pulse monitor, a skin sensor, a gyroscope, and an accelerometer.