# US 2019/0244326 A1 · Information processing apparatus, information processing system, data generation method, and recording medium storing program code

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244326 A1
- Document ID: US20190244326A1
- Status: Published application
- Kind: A1
- Application number: 16/237,790
- Filed: 2019-01-02
- Published: 2019-08-08
- Earliest claimed: 2018-02-07
- Assignees: Ricoh Company, Ltd.
- Applicants: Ricoh Company, Ltd.
- Inventors: Keitaro SHIMIZU
- Web page: https://patentgrep.com/patent/US20190244326A1

## CPC

- G06T 3/12: Panospheric to cylindrical image transformations
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04R 1/028: {associated with devices performing functions other than acoustics, e.g. electric candles}
- H04R 1/326: {for microphones (H04R1/34 and H04R1/40 take precedence)}
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04R 2430/20: Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic (H04R2203/12 takes precedence)
- H04S 7/303: {Tracking of listener position or orientation}
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S 2420/11: Application of ambisonics in stereophonic audio systems
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- H04S: STEREOPHONIC SYSTEMS

## Abstract

An information processing apparatus, an information processing system, a data generation method, and a recording medium storing program code. The information processing apparatus and data generation method include displaying a spherical image obtained by an imaging apparatus, reproducing three-dimensional audio data obtained by the imaging apparatus in association with the spherical image, accepting designation of a displaying direction on the spherical image, generating two-dimensional image data that corresponds to the displaying direction, based on data of the spherical image, and generating two-dimensional audio data that corresponds to the displaying direction, from the three-dimensional audio data. The information processing system includes the information processing, and an image processing server connected to the information processing apparatus through a communication network. The image processing server generates two-dimensional audio data that corresponds to the displaying direction, based on the three-dimensional audio data.

## Claims

### Claim 1

An information processing apparatus comprising circuitry configured to
display a spherical image obtained by an imaging apparatus,
reproduce three-dimensional audio data obtained by the imaging apparatus in association with the spherical image,
accept designation of a displaying direction on the spherical image,
generate two-dimensional image data that corresponds to the displaying direction, based on data of the spherical image, and
generate two-dimensional audio data that corresponds to the displaying direction, based on the three-dimensional audio data.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, further comprising:
a memory configured to store the two-dimensional image data and the two-dimensional audio data,
wherein the circuitry reproduces the two-dimensional image data and the two-dimensional audio data stored in the memory.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2,
wherein the circuitry generates two-dimensional video based on the two-dimensional audio data and the two-dimensional image data,
wherein the memory stores the two-dimensional video, and
wherein the circuitry reproduces the two-dimensional video stored in the memory.

### Claim 4 (depends on 1)

The information processing apparatus according to claim 1,
wherein the circuitry specifies the displaying direction;
wherein the circuitry specifies a sound-source direction of the three-dimensional audio data based on the displaying direction, and
wherein the circuitry generates the two-dimensional audio data that corresponds to the displaying direction based on the sound-source direction and the three-dimensional audio data.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4,
wherein the circuitry specifies two directions that are equidistant with reference to the displaying direction as the sound-source direction, and
wherein the circuitry generates the two-dimensional audio data based on the two directions specified as the sound-source direction.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1, wherein the three-dimensional audio data is stereophonic sound data generated based on an Ambisonics B-format.

### Claim 7

An information processing system comprising:
an information processing apparatus comprising first circuitry configured to
display a spherical image obtained by an imaging apparatus, and
reproduce three-dimensional audio data obtained by the imaging apparatus in associated with the spherical image; and
an image processing server connected to the information processing apparatus through a communication network,
wherein the first circuitry of the information processing apparatus is further configured to
accept designation of a displaying direction on the spherical image, and
transmit the three-dimensional audio data and direction information indicating the displaying direction to the image processing server, and
wherein the image processing server includes second circuitry configured to generate two-dimensional audio data that corresponds to the displaying direction, based on the three-dimensional audio data.

### Claim 8 (depends on 7)

The information processing system according to claim 7,
wherein the first circuitry of the information processing apparatus transmits the three-dimensional audio data, the direction information, and data of the spherical image to the image processing server, and
wherein the second circuitry of the image processing server generates two-dimensional image data that corresponds to the displaying direction, based on the data of the spherical image, and generates two-dimensional audio data that corresponds to the displaying direction, from the three-dimensional audio data.

### Claim 9

A method of generating data, the method comprising:
displaying a spherical image obtained by an imaging apparatus;
reproducing three-dimensional audio data obtained by the imaging apparatus in association with the spherical image;
accepting designation of a displaying direction on the spherical image;
generating two-dimensional image data that corresponds to the displaying direction, based on data of the spherical image; and
generating two-dimensional audio data that corresponds to the displaying direction, from the three-dimensional audio data.

### Claim 10 (depends on 9)

A computer-readable non-transitory recording medium storing a program for causing a computer to execute the method according to claim 9.
