# US 2024/0404322 A1 · Information processing apparatus and information processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0404322 A1
- Document ID: US20240404322A1
- Status: Published application
- Kind: A1
- Application number: 18/692,510
- Filed: 2022-03-17
- Published: 2024-12-05
- Earliest claimed: 2021-09-22
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Akira Matsui; Masaya Kinoshita; Akihiko Utsugi; Hiroaki Ebi
- Web page: https://patentgrep.com/patent/US20240404322A1

## CPC

- G06V 40/174: {Facial expression recognition}
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 20/47: {Detecting features for summarising video content}
- G11B 20/10: Digital recording or reproducing
- G11B 27/02: Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- H04N 5/91: Television signal processing therefor
- H04N 5/92: Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N 5/93: Regeneration of the television signal or of selected parts thereof
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Information processing that effectively uses emotion data indicating a user emotion for each scene of a moving image content is disclosed. In one example, an extraction unit extracts an emotion representative scene on the basis of emotion metadata having user emotion information for each scene of the moving image content. Reproduction of a part of the moving image content and editing of extracting a part of the moving image content can be effectively performed on the basis of the extracted emotion representative scene. For example, the extraction unit extracts the emotion representative scene on the basis of a type of the user emotion or a degree of the user emotion.

## Claims

### Claim 1

An information processing apparatus comprising
an extraction unit that extracts an emotion representative scene on a basis of emotion data having a user emotion for each scene of a moving image content.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the extraction unit extracts the emotion representative scene on a basis of a type of the user emotion.

### Claim 3 (depends on 1)

The information processing apparatus according to claim 1, wherein
the extraction unit extracts the emotion representative scene on a basis of a degree of the user emotion.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein
the extraction unit extracts, as the emotion representative scene, a scene in which the degree of the user emotion exceeds a threshold.

### Claim 5 (depends on 3)

The information processing apparatus according to claim 3, wherein
the extraction unit extracts the emotion representative scene on a basis of a statistical value of the degree of the user emotion of the entire moving image content.

### Claim 6 (depends on 5)

The information processing apparatus according to claim 5, wherein
the statistical value includes a maximum value, a sorting result, an average value, or a standard deviation value.

### Claim 7 (depends on 1)

The information processing apparatus according to claim 1, further comprising
a reproduction control unit that reproduces the extracted emotion representative scene out of the moving image content.

### Claim 8 (depends on 1)

The information processing apparatus according to claim 1, further comprising
an editing control unit that extracts the extracted emotion representative scene out of the moving image content to generate a new moving image content.

### Claim 9 (depends on 1)

The information processing apparatus according to claim 1, further comprising
a display control unit that displays which time position of the extracted emotion representative scene with respect to the entire moving image content.

### Claim 10 (depends on 9)

The information processing apparatus according to claim 9, wherein
the display control unit displays a type and a degree of the user emotion in the extracted emotion representative scene at a time position corresponding to the extracted emotion representative scene on a time-axis slide bar corresponding to the entire moving image content.

### Claim 11 (depends on 10)

The information processing apparatus according to claim 10, wherein
the display control unit displays the type of the user emotion with a mark.

### Claim 12

An information processing method comprising
a procedure of extracting an emotion representative scene on a basis of emotion data having a user emotion for each scene of a moving image content.
