# US 2018/0025221 A1 · Video sentiment analysis tool for video messaging

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025221 A1
- Document ID: US20180025221A1
- Status: Published application
- Kind: A1
- Application number: 15/215,557
- Filed: 2016-07-20
- Published: 2018-01-25
- Earliest claimed: 2016-07-20
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Liam Harpur; Erik H. Katzen; Sumit Patel; John Rice
- Web page: https://patentgrep.com/patent/US20180025221A1

## CPC

- G06V 40/176: {Dynamic expression}
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 30/268: {Lexical context}
- H04L 51/10: Multimedia information
- H04L 51/52: for supporting social networking services
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- G06V 40/179: {metadata assisted face recognition}
- G10L 25/00: Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 (muting semiconductor-based amplifiers when some special characteristics of a signal are sensed by a speech detector, e.g. sensing when no signal is present, H03G3/34)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Embodiments of the invention provide a method, system and computer program product for video sentiment analysis in video messaging. In an embodiment of the invention, a method for video sentiment analysis in video messaging includes receiving different video contributions to a thread in a social system executing in memory of a computer and sensing from a plurality of the video contributions a contributor sentiment. Thereafter, a sentiment value for the different video contributions is computed and a sentiment value for a selected one of the video contributions is displayed in a user interface to the thread for an end user contributing a new video contribution to the thread.

## Claims

### Claim 1

A method for video sentiment analysis in video messaging, the method comprising:
receiving different video contributions to a thread in a social system executing in memory of a computer;
sensing from a plurality of the video contributions a contributor sentiment;
computing a sentiment value for the sensed contributor sentiment of the different video contributions; and,
displaying a sentiment value computed for a selected one of the video contributions in a user interface to the thread for an end user contributing a new video contribution to the thread.

### Claim 2 (depends on 1)

The method of claim 1, wherein the sensing is facial recognition in order to determine an emotion of a contributor of a corresponding one of the video contributions.

### Claim 3 (depends on 1)

The method of claim 1, wherein the sensing is a sound analysis in order to determine a tone of a contributor of a corresponding one of the video contributions.

### Claim 4 (depends on 1)

The method of claim 1, wherein the sensing is a textual parsing of content of each of the video contributions in order to determine a level of jargon of a corresponding one of the video contributions.

### Claim 5 (depends on 1)

The method of claim 1,
wherein the sensing is each of facial recognition in order to determine an emotion of a contributor of each of the video contributions, a sound analysis in order to determine a tone of a contributor of each of the video contributions, and a textual parsing of content of each of the video contributions in order to determine a level of jargon of a corresponding one of the video contributions, and
wherein the computed sentiment for the selected one of the video contributions is a combination of a numerical value computed for a sensed emotion for the selected one of the video contributions, a numerical value computed for a level of jargon for the selected one of the video contributions and a numerical value computed for a level of sarcasm for the selected one of the video contributions.

### Claim 6 (depends on 1)

The method of claim 1, further comprising displaying in the user interface to the thread an aggregate sentiment for all of the video contributions.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
receiving from a contributor a reply video contribution to the thread;
sensing from the reply video contribution a contributor sentiment;
computing a sentiment value for the reply video contribution; and,
prompting the contributor to provide a different video contributor responsive or edit video response to a determination of a threshold inconsistency between the sentiment value computed for the reply video contribution and the sentiment value computed for the different video contributions.

### Claim 8

A data processing system configured for video sentiment analysis in video messaging, the system comprising:
a computer with memory and at least one processor;
a social system executing in the memory of the computer; and,
a video sentiment analysis module comprising program code executing in the memory of the computer, the program code sensing a contributor sentiment from a plurality of several different video contributions to a thread in the social system, computing a sentiment for the different video contributions, and displaying a sentiment for a selected one of the different video contributions in a user interface to the thread for an end user contributing a new video contribution to the thread.

### Claim 9 (depends on 8)

The system of claim 8, wherein the sensing is facial recognition in order to determine an emotion of a contributor of a corresponding one of the video contributions.

### Claim 10 (depends on 8)

The system of claim 8, wherein the sensing is a sound analysis in order to determine a tone of a contributor of a corresponding one of the video contributions.

### Claim 11 (depends on 8)

The system of claim 8, wherein the sensing is a textual parsing of content of each of the video contributions in order to determine a level of jargon of a corresponding one of the video contributions.

### Claim 12 (depends on 8)

The system of claim 8,
wherein the sensing is each of facial recognition in order to determine an emotion of a contributor of each of the video contributions, a sound analysis in order to determine a tone of a contributor of each of the video contributions, and a textual parsing of content of each of the video contributions in order to determine a level of jargon of a corresponding one of the video contributions, and
wherein the computed sentiment for the selected one of the video contributions is a combination of a numerical value computed for a sensed emotion for the selected one of the video contributions, a numerical value computed for a level of jargon for the selected one of the video contributions and a numerical value computed for a level of sarcasm for the selected one of the video contributions.

### Claim 13 (depends on 8)

The system of claim 8, wherein the program code further displays in the user interface to the thread an aggregate sentiment for all of the video contributions.

### Claim 14

A computer program product for video sentiment analysis in video messaging, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a device to cause the device to perform a method comprising:
receiving different video contributions to a thread in a social system executing in memory of a computer;
sensing from a plurality of the video contributions a contributor sentiment;
computing a sentiment for the different video contributions; and,
displaying a sentiment for a selected one of the video contributions in a user interface to the thread for an end user contributing a new video contribution to the thread.

### Claim 15 (depends on 14)

The computer program product of claim 14, wherein the sensing is facial recognition in order to determine an emotion of a contributor of a corresponding one of the video contributions.

### Claim 16 (depends on 14)

The computer program product of claim 14, wherein the sensing is a sound analysis in order to determine a tone of a contributor of a corresponding one of the video contributions.

### Claim 17 (depends on 14)

The computer program product of claim 14, wherein the sensing is a textual parsing of content of each of the video contributions in order to determine a level of jargon of a corresponding one of the video contributions.

### Claim 18 (depends on 14)

The computer program product of claim 14,
wherein the sensing is each of facial recognition in order to determine an emotion of a contributor of each of the video contributions, a sound analysis in order to determine a tone of a contributor of each of the video contributions, and a textual parsing of content of each of the video contributions in order to determine a level of jargon of a corresponding one of the video contributions, and
wherein the computed sentiment for the selected one of the video contributions is a combination of a numerical value computed for a sensed emotion for the selected one of the video contributions, a numerical value computed for a level of jargon for the selected one of the video contributions and a numerical value computed for a level of sarcasm for the selected one of the video contributions.

### Claim 19 (depends on 14)

The computer program product of claim 14, wherein the method further includes displaying in the user interface to the thread an aggregate sentiment for all of the video contributions.

### Claim 20 (depends on 14)

The computer program product of claim 14, wherein the method further includes:
receiving from a contributor a reply video contribution to the thread;
sensing from the reply video contribution a contributor sentiment;
computing a sentiment value for the reply video contribution; and,
prompting the contributor to provide a different video contribution responsive to a determination of a threshold inconsistency between the sentiment value computed for the reply video contribution and the sentiment value computed for the different video contributions.
