# US 2019/0320143 A1 · Information processing device, information processing method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0320143 A1
- Document ID: US20190320143A1
- Status: Published application
- Kind: A1
- Application number: 16/315,449
- Filed: 2017-04-26
- Published: 2019-10-17
- Earliest claimed: 2016-07-28
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Atsushi IZUMIHARA; Yusuke SAKAI
- Web page: https://patentgrep.com/patent/US20190320143A1

## CPC

- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- H04N 7/157: {defining a virtual conference space and using avatars or agents (computer conference optimisation or adaptation H04L12/1827)}
- G10L 25/63: for estimating an emotional state
- H04N 7/144: {camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

[Object] To provide an information processing device, an information processing method, and a program that can enable more comfortable communication by rendering distances to multiple communication partners by using three-dimensional expression for connection between spaces. [Solution] An information processing device including: a reception unit configured to receive data from a communication destination; a generation unit configured to generate spatial image information placed at a predetermined position in a three-dimensional space by using captured images of a plurality of the communication destinations; and a display control unit configured to perform control so as to display the generated spatial image information on a display unit.

## Claims

### Claim 1

An information processing device comprising:
a reception unit configured to receive data from a communication destination;
a generation unit configured to generate spatial image information placed at a predetermined position in a three-dimensional space by using captured images of a plurality of the communication destinations; and
a display control unit configured to perform control so as to display the generated spatial image information on a display unit.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein the generation unit visualizes communication that has occurred between the plurality of communication destinations in the three-dimensional space.

### Claim 3 (depends on 2)

The information processing device according to claim 2, wherein the generation unit visualizes a state of the communication.

### Claim 4 (depends on 3)

The information processing device according to claim 3, wherein the generation unit calculates activity of conversation in the communication, and performs visualization display corresponding to the activity.

### Claim 5 (depends on 4)

The information processing device according to claim 4, wherein the generation unit calculates the activity on a basis of at least one of conversation voice or video during conversation.

### Claim 6 (depends on 3)

The information processing device according to claim 3, wherein the generation unit estimates a mood of conversation in the communication, and performs visualization display corresponding to the mood.

### Claim 7 (depends on 6)

The information processing device according to claim 6, wherein the generation unit estimates the mood on a basis of at least one of conversation voice or video during conversation.

### Claim 8 (depends on 3)

The information processing device according to claim 3, wherein the generation unit calculates activity of conversation and estimates a mood of conversation in the communication, and performs visualization display corresponding to the activity and the mood.

### Claim 9 (depends on 1)

The information processing device according to claim 1, wherein the generation unit fits the captured image of the communication destination into an opening of a virtual object, and places the virtual object at the predetermined position in the three-dimensional space.

### Claim 10 (depends on 9)

The information processing device according to claim 9, wherein the generation unit controls a distance to each virtual object placed in the three-dimensional space in accordance with a degree of exposure.

### Claim 11

An information processing method comprising, by a processor:
receiving data from a communication destination;
generating spatial image information placed at a predetermined position in a three-dimensional space by using captured images of a plurality of the communication destinations; and
performing control so as to display the generated spatial image information on a display unit.

### Claim 12

A program causing a computer to function as:
a reception unit configured to receive data from a communication destination;
a generation unit configured to generate spatial image information placed at a predetermined position in a three-dimensional space by using captured images of a plurality of the communication destinations; and
a display control unit configured to perform control so as to display the generated spatial image information on a display unit.