# US 2023/0410506 A1 · Analysis apparatus, system, method, and non-transitory computer readable medium storing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410506 A1
- Document ID: US20230410506A1
- Status: Published application
- Kind: A1
- Application number: 18/030,422
- Filed: 2020-10-12
- Published: 2023-12-21
- Earliest claimed: 2020-10-12
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Shin NORIEDA; Yoshiyuki TANAKA; Shogo AKASAKI; Haruki Yokota; Masami SAKAGUCHI
- Web page: https://patentgrep.com/patent/US20230410506A1

## CPC

- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 20/49: {Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes}
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06V 40/174: {Facial expression recognition}
- H04N 21/21: Server components or server architectures
- H04N 21/24: Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests {(monitoring of server performance or load G06F11/34; arrangements for observation, testing or troubleshooting for broadcast or for distribution combined with broadcast H04H20/12)}
- H04N 21/83: Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N 21/858: Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An analysis apparatus (100) includes: emotion data acquisition means (111) for acquiring emotion data that includes time data, the emotion data being generated based on face image data of participants in an online meeting; meeting data acquisition means (112) for acquiring meeting data including image data that includes time data in the meeting; analysis data generation means (113) for generating analysis data regarding the meeting based on the emotion data; screen generation means (114) for generating a playback screen including a seek bar for specifying a time, the analysis data that corresponds to the specified time, and the image data; and output means (115) for outputting the playback screen.

## Claims

### Claim 1

An analysis apparatus comprising:
at least one memory acquiring storing instructions and
at least one processor configured to execute the instructions to:
acquire emotion data that includes time data, the emotion data being generated based on face image data of participants in an online meeting;
acquire meeting data including image data that includes time data in the meeting;
generate analysis data regarding the meeting based on the emotion data;
generate a playback screen including a seek bar for specifying a time, the analysis data that corresponds to the specified time, and the image data; and
output the playback screen.

### Claim 2 (depends on 1)

The analysis apparatus according to claim 1, wherein the at least one processor is further configured to execute the instructions to acquire a first index in which a state of an emotion based on the face image data is indicated by at least one numerical value as the emotion data.

### Claim 3 (depends on 1)

The analysis apparatus according to claim 1, wherein the at least one processor is further configured to execute the instructions to:
indicate at least one second index indicating reactions of the participants to the meeting by a numerical value based on the emotion data, and
generate a time-series graph showing a temporal transition of the second index as the analysis data.

### Claim 4 (depends on 3)

The analysis apparatus according to claim 3, wherein the at least one processor is further configured to execute the instructions to generate the playback screen in which a display indicating the second index that corresponds to the time specified by the seek bar is included in the time-series graph.

### Claim 5 (depends on 4)

The analysis apparatus according to claim 4, wherein the at least one processor is further configured to execute the instructions to generate the playback screen in which an axis for identifying the numerical value in the second index that corresponds to the time specified by the seek bar is included in the time-series graph.

### Claim 6 (depends on 5)

The analysis apparatus according to claim 5, wherein
the at least one processor is further configured to execute the instructions to generate a slider for specifying a time based on a relative position in the seek bar, and
the slider is associated with a relative position of the axis on the time-series graph.

### Claim 7 (depends on 3)

The analysis apparatus according to claim 3, wherein the at least one processor is further configured to execute the instructions to generate the playback screen including the seek bar indicating a time when the second index has been changed within a predetermined range and a predetermined period.

### Claim 8 (depends on 3)

The analysis apparatus according to claim 3, wherein the at least one processor is further configured to execute the instructions to generate the analysis data by calculating a statistical value of a numerical value in the second index in a predetermined period.

### Claim 9 (depends on 1)

The analysis apparatus according to claim 1, further comprising the at least one processor is further configured to execute the instructions to generate chapters for the meeting based on the meeting data, wherein
the at least one processor is further configured to execute the instructions to generate the playback screen including the seek bar indicating a time when the chapter is switched.

### Claim 10 (depends on 1)

The analysis apparatus according to claim 1, further comprising the at least one processor is further configured to execute the instructions to generate chapters for the meeting based on the meeting data, wherein
the at least one processor is further configured to execute the instructions to generate the analysis data based on the emotion data for each of the chapters.

### Claim 11 (depends on 9)

The analysis apparatus according to claim 9, wherein the at least one processor is further configured to execute the instructions to:
acquire meeting data including data regarding screen sharing in the meeting, and
generate the chapters based on the data regarding the screen sharing.

### Claim 12 (depends on 11)

The analysis apparatus according to claim 11, wherein the at least one processor is further configured to execute the instructions to generate the chapter based on a timing when the screen sharing is switched.

### Claim 13 (depends on 11)

The analysis apparatus according to claim 11, wherein the at least one processor is further configured to execute the instructions to generate the chapter in accordance with a time when the owner of the shared screen in the screen sharing is switched.

### Claim 14 (depends on 1)

The analysis apparatus according to claim 1, further comprising the at least one processor is further configured to execute the instructions to identify a person based on face image data, wherein
the at least one processor is further configured to execute the instructions to:
acquire face image data of the participants,
identify segmentation to which the participant belongs from the face image data, and
generate the analysis data in view of the segmentation.

### Claim 15 (depends on 1)

The analysis apparatus according to claim 1, further comprising the at least one processor is further configured to execute the instructions to identify a person based on face image data, wherein
the at least one processor is further configured to execute the instructions to:
acquire face image data of the participants,
identify the participants from the face image data, and
generate the analysis data of the participants regarding the identification.

### Claim 16

(canceled)

### Claim 17

A method comprising:
acquiring emotion data that includes time data, the emotion data being generated based on face image data of participants in an online meeting;
acquiring meeting data including image data that includes time data in the meeting;
generating analysis data regarding the meeting based on the emotion data;
generating a playback screen including a seek bar for specifying a time, the analysis data that corresponds to the specified time, and the image data; and
outputting the playback screen.

### Claim 18

A non-transitory computer readable medium storing a program for causing a computer to execute the following processing of:
acquiring emotion data that includes time data, the emotion data being generated based on face image data of participants in an online meeting;
acquiring meeting data including image data that includes time data in the meeting;
generating analysis data regarding the meeting based on the emotion data;
generating a playback screen including a seek bar for specifying a time, the analysis data that corresponds to the specified time, and the image data; and
outputting the playback screen.
