# US 2018/0324491 A1 · Recommending content of streaming media by a cognitive system in an infrastructure > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0324491 A1 - Document ID: US20180324491A1 - Status: Published application - Kind: A1 - Application number: 15/840,406 - Filed: 2017-12-13 - Published: 2018-11-08 - Earliest claimed: 2017-05-02 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Evelyn R. Anderson; Natalie N. Brooks Powell; Kristen N. Conley; Martin G. Keen - Web page: https://patentgrep.com/patent/US20180324491A1 ## CPC - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - G06V 40/166: {using acquisition arrangements} - G06V 40/174: {Facial expression recognition} - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - G06V 40/23: {Recognition of whole body movements, e.g. for sport training} - H04L 9/3231: {Biological data, e.g. fingerprint, voice or retina (network architectures or network communication protocols for supporting authentication of entities using biometrical features in a packet data network H04L63/0861)} - H04L 63/0861: {using biometrical features, e.g. fingerprint, retina-scan (cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231)} - H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)} - H04N 21/42201: {biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user (input arrangements for interaction with the human body based on nervous system activity detection G06F3/015)} - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/4415: using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning {(cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861)} - H04N 21/4668: {for recommending content, e.g. movies} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract A computer program product and a computer system for using emotional analysis to recommend streaming media content by a cognitive system in an infrastructure. The cognitive system receives, from at least one of a mobile device and a camera, information of at least one of biometrics, movement, body language, and facial expression of a user. The cognitive system derives a current emotional state of the user, based on the information of the at least one of the biometrics, the movement, the body language, and the facial expression. The cognitive system matches the current emotional state to user's one of previous emotional states stored in a repository in the infrastructure. The cognitive system sends to a streaming media service a recommendation on streaming media content to be consumed by the user, based on streaming media content that has been consumed by the user in the one of the previous emotional states. ## Claims ### Claim 1 A computer program product for using emotional analysis to recommend streaming media content by a cognitive system in an infrastructure, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code executable to: receive from at least one of a mobile device and a camera, by the cognitive system in the infrastructure, information of at least one of biometrics, movement, body language, and facial expression of a user, wherein the at least one of the biometrics, the movement, the body language, and the facial expression is captured by the at least one of the mobile device and the camera while the user is consuming current streaming media content provided by a streaming media service; derive, by the cognitive system, a current emotional state of the user, based on the information of the at least one of the biometrics, the movement, the body language, and the facial expression; match, by the cognitive system, the current emotional state to one of previous emotional states of the user, wherein information of the previous emotional states is stored in a repository in the infrastructure; and send to the streaming media service, by the cognitive system, a recommendation on streaming media content to be consumed by the user, wherein the cognitive system provides the recommendation to the streaming media service based on streaming media content that has been consumed by the user in the one of the previous emotional states, wherein information of the streaming media content that has been consumed by the user is stored in the repository in the infrastructure. ### Claim 2 (depends on 1) The computer program product of claim 1, further comprising the program code executable to: receive from the streaming media service, by the cognitive system, information of the current streaming media content. ### Claim 3 (depends on 1) The computer program product of claim 1, further comprising the program code executable to: store in the repository in the infrastructure, by the cognitive system, the current emotional state in the repository in the infrastructure and information of the current streaming media content, wherein the information of the current streaming media content is received from the streaming media service. ### Claim 4 (depends on 1) The computer program product of claim 1, further comprising the program code executable to: capture, by the mobile device, at least one of the biometrics and the movement of the user while the user is consuming the current streaming media content provided by the streaming media service; and send to the cognitive system in the infrastructure, by the mobile device, information of the at least one of the biometrics and the movement of the user, through built-in connectivity of the mobile device to the cognitive system in the infrastructure. ### Claim 5 (depends on 1) The computer program product of claim 1, further comprising the program code executable to: capture, by the mobile device, at least one of the biometrics and the movement of the user while the user is consuming the current streaming media content provided by the streaming media service; and send to an intermediary mobile device, by the mobile device, information of the at least one of the biometrics and the movement of the user; and send to the cognitive system in the infrastructure, by the intermediary mobile device, the information of the at least one of the biometrics and the movement of the user, through built-in connectivity of the intermediary mobile device to the cognitive system in the infrastructure. ### Claim 6 (depends on 1) The computer program product of claim 1, wherein the mobile device is a smartwatch comprising one or more sensors for capturing the biometrics of the user. ### Claim 7 (depends on 1) The computer program product of claim 1, wherein the mobile device is a smartwatch comprising an accelerometer and a gyroscope for capturing the movement of the user. ### Claim 8 (depends on 1) The computer program product of claim 1, further comprising the program code executable to: capture, by the camera, at least one of the body language and the facial expression of the user while the user is consuming the current streaming media content provided by the streaming media service; and send to the cognitive system in the infrastructure, by the camera, information of the at least one of the body language and the facial expression, through built-in connectivity of the camera to the cognitive system in the infrastructure. ### Claim 9 (depends on 1) The computer program product of claim 1, further comprising the program code executable to: capture, by the camera, at least one of the body language and the facial expression of the user while the user is consuming the current streaming media content provided by the streaming media service; and send to an intermediary mobile device, by the camera, information of the at least one of the body language and the facial expression, through built-in connectivity of the camera to the cognitive system in the infrastructure; and send to the cognitive system in the infrastructure, by the intermediary mobile device, the information of the at least one of the body language and the facial expression of the user, through built-in connectivity of the camera to the cognitive system in the infrastructure. ### Claim 10 (depends on 1) The computer program product of claim 1, wherein the camera is mounted on or built in a streaming media player. ### Claim 11 A computer system for using emotional analysis to recommend streaming media content by a cognitive system in an infrastructure, the computer system comprising: one or more processors, one or more computer readable tangible storage devices, and program instructions stored on at least one of the one or more computer readable tangible storage devices for execution by at least one of the one or more processors, the program instructions executable to: receive from at least one of a mobile device and a camera, by the cognitive system in the infrastructure, information of at least one of biometrics, movement, body language, and facial expression of a user, wherein the at least one of the biometrics, the movement, the body language, and the facial expression is captured by the at least one of the mobile device and the camera while the user is consuming current streaming media content provided by a streaming media service; derive, by the cognitive system, a current emotional state of the user, based on the information of the at least one of the biometrics, the movement, the body language, and the facial expression; match, by the cognitive system, the current emotional state to one of previous emotional states of the user, wherein information of the previous emotional states is stored in a repository in the infrastructure; and send to the streaming media service, by the cognitive system, a recommendation on streaming media content to be consumed by the user, wherein the cognitive system provides the recommendation to the streaming media service based on streaming media content that has been consumed by the user in the one of the previous emotional states, wherein information of the streaming media content that has been consumed by the user is stored in the repository in the infrastructure. ### Claim 12 (depends on 11) The computer system of claim 11, further comprising the program instructions executable to: receive from the streaming media service, by the cognitive system, information of the current streaming media content. ### Claim 13 (depends on 11) The computer system of claim 11, further comprising the program instructions executable to: store in the repository in the infrastructure, by the cognitive system, the current emotional state in the repository in the infrastructure and information of the current streaming media content, wherein the information of the current streaming media content is received from the streaming media service. ### Claim 14 (depends on 11) The computer system of claim 11, further comprising the program instructions executable to: capture, by the mobile device, at least one of the biometrics and the movement of the user while the user is consuming the current streaming media content provided by the streaming media service; and send to the cognitive system in the infrastructure, by the mobile device, information of the at least one of the biometrics and the movement of the user, through built-in connectivity of the mobile device to the cognitive system in the infrastructure. ### Claim 15 (depends on 11) The computer system of claim 11, further comprising the program instructions executable to: capture, by the mobile device, at least one of the biometrics and the movement of the user while the user is consuming the current streaming media content provided by the streaming media service; and send to an intermediary mobile device, by the mobile device, information of the at least one of the biometrics and the movement of the user; and send to the cognitive system in the infrastructure, by the intermediary mobile device, the information of the at least one of the biometrics and the movement of the user, through built-in connectivity of the intermediary mobile device to the cognitive system in the infrastructure. ### Claim 16 (depends on 11) The computer system of claim 11, wherein the mobile device is a smartwatch comprising one or more sensors for capturing the biometrics of the user. ### Claim 17 (depends on 11) The computer system of claim 11, wherein the mobile device is a smartwatch comprising an accelerometer and a gyroscope for capturing the movement of the user. ### Claim 18 (depends on 11) The computer system of claim 11, further comprising the program instructions executable to: capture, by the camera, at least one of the body language and the facial expression of the user while the user is consuming the current streaming media content provided by the streaming media service; and send to the cognitive system in the infrastructure, by the camera, information of the at least one of the body language and the facial expression, through built-in connectivity of the camera to the cognitive system in the infrastructure. ### Claim 19 (depends on 11) The computer system of claim 11, further comprising the program instructions executable to: capture, by the camera, at least one of the body language and the facial expression of the user while the user is consuming the current streaming media content provided by the streaming media service; and send to an intermediary mobile device, by the camera, information of the at least one of the body language and the facial expression, through built-in connectivity of the camera to the cognitive system in the infrastructure; and send to the cognitive system in the infrastructure, by the intermediary mobile device, the information of the at least one of the body language and the facial expression of the user, through built-in connectivity of the camera to the cognitive system in the infrastructure. ### Claim 20 (depends on 11) The computer system of claim 11, wherein the camera is mounted on or built in a streaming media player.