# US 2021/0345058 A1 · Information processing device, information processing method, program, and information processing system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0345058 A1
- Document ID: US20210345058A1
- Status: Published application
- Kind: A1
- Application number: 17/274,693
- Filed: 2019-09-12
- Published: 2021-11-04
- Earliest claimed: 2018-09-26
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Eisaburo ITAKURA; Takeshi YAMAGUCHI
- Web page: https://patentgrep.com/patent/US20210345058A1

## CPC

- H04R 27/00: Public address systems (circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; {monitoring or testing arrangements for public address systems H04R29/007}; amplifiers H03F)
- H04S 7/303: {Tracking of listener position or orientation}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06Q 30/0269: {based on user profile or attribute}
- G01C 21/206: {specially adapted for indoor navigation}
- G06Q 30/0261: {based on user location}
- G06Q 30/0271: {Personalized advertisement}
- H04R 1/403: {loud-speakers}
- H04R 2430/01: Aspects of volume control, not necessarily automatic, in sound systems
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/13: Aspects of volume control, not necessarily automatic, in stereophonic sound systems
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- H04S 2420/13: Application of wave-field synthesis in stereophonic audio systems
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- H04S: STEREOPHONIC SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)

## Abstract

An information processing device includes circuitry that detects a change in a position of a person. The circuitry also changes a position of a virtual sound source in accordance with the change in the position of the person and outputs a sound through wave field synthesis so that a spatial sound field is transmitted via a plurality of speakers.

## Claims

### Claim 1

An information processing device, comprising:
circuitry that:
detects a change in a position of a person; and
changes a position of a virtual sound source in accordance with the change in the position of the person and outputs a sound through wave field synthesis so that a spatial sound field is transmitted via a plurality of speakers.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein the circuitry causes the virtual sound source to track the position of the person.

### Claim 3 (depends on 2)

The information processing device according to claim 2, wherein the position of the person changes continuously and the circuitry changes the position of the virtual sound source continuously as the position of the person continuously changes.

### Claim 4 (depends on 1)

The information processing device according to claim 1, wherein the position of the virtual sound source is changed while the position of the person is changing.

### Claim 5 (depends on 1)

The information processing device according to claim 1, wherein the circuitry
generates a schedule for outputting the sound by the wave field synthesis in accordance with the change in the position of the person, and
outputs the sound by the wave field synthesis in accordance with the change in the position of the person detected on a basis of the schedule.

### Claim 6 (depends on 5)

The information processing device according to claim 5, wherein the circuitry:
generates a sound field synthesis parameter for synthesizing a sound field on a basis of the schedule,
synthesizes the sound field by synthesizing the sound field synthesis parameter and audio data of a plurality of channels for each channel through a convolutional operation, and
outputs the sound through the wave field synthesis by outputting a sound with which the sound field is synthesized for each channel.

### Claim 7 (depends on 5)

The information processing device according to claim 5, wherein the person is a listener, and the circuitry:
detects a change in a position of the listener, and
generates a schedule for outputting the sound through the wave field synthesis in accordance with the change in the position of the listener.

### Claim 8 (depends on 7)

The information processing device according to claim 7, wherein a listening area in which the sound is heard by the listener is set as a plurality of divisional areas which are divided, and
the circuitry generates the schedule for outputting the sound through the wave field synthesis in an area in which the listener is located among the divisional areas in accordance with the change in the position of the listener.

### Claim 9 (depends on 8)

The information processing device according to claim 8, wherein the circuitry selects content of a reproduction time length corresponding to a time in which the listener passes the divisional area among a plurality of pieces of content having different reproduction time lengths in accordance with the change in the position of the listener, and generates the schedule for outputting the sound through the wave field synthesis.

### Claim 10 (depends on 8)

The information processing device according to claim 8, wherein the circuitry
stores a table including a wave field synthesis filter in a case where the listener is located at each position in the divisional area,
reads the wave field synthesis filter corresponding to the position in the divisional area from the table in accordance with the change in the position of the listener,
performs the wave field synthesis, and
outputs the sound.

### Claim 11 (depends on 8)

The information processing device according to claim 8, wherein the circuitry:
estimates an attribute of the listener,
selects content corresponding to the attribute of the listener, and
generates the schedule for outputting the sound through the wave field synthesis in the divisional area in which the listener is located among the divisional areas in accordance with the change in the position of the listener.

### Claim 12 (depends on 8)

The information processing device according to claim 8, wherein the circuitry presents visual information corresponding to a type of content to be output to the divisional area.

### Claim 13 (depends on 12)

The information processing device according to claim 12, wherein the circuitry projects a different pattern for each divisional area in accordance with the type of content to be output to the divisional area.

### Claim 14 (depends on 12)

The information processing device according to claim 12, wherein the circuitry emits light to change a color for each divisional area in accordance with the type of content to be output to the divisional area.

### Claim 15 (depends on 11)

The information processing device according to claim 11, wherein, in a case where there is a plurality of attributes of the listener, the circuitry selects a common content for the plurality of attributes, and generates the schedule for outputting the sound through the wave field synthesis in accordance with the change in the position of the listener.

### Claim 16 (depends on 11)

The information processing device according to claim 11, wherein the circuitry
causes a display to reproduce and display an image corresponding to the sound,
reproduces a subtitle corresponding to the sound, and
selects and reproduces a subtitle corresponding to the attribute of the listener.

### Claim 17 (depends on 11)

The information processing device according to claim 11, wherein the attribute includes at least one of individual identification information of the listener, a male, a female, an age, a nationality, a speaking language, one man, one woman, a group of a plurality of men, a group of a plurality of women, a group of mixed men and women, a family, or a state of a behavior.

### Claim 18 (depends on 11)

The information processing device according to claim 11, wherein the circuitry identifies the listener in accordance with the attribute of the listener, selects content corresponding to an identification result, and generates the schedule for outputting the sound through the wave field synthesis for each divisional area in which the listener is located in accordance with the change in the position of the listener.

### Claim 19 (depends on 7)

The information processing device according to claim 7, wherein the circuitry generates the schedule for outputting the sound through the wave field synthesis by controlling a volume using a volume curve corresponding to a distance between the listener and the plurality of speakers in accordance with the change in the position of the listener.

### Claim 20 (depends on 5)

The information processing device according to claim 5, wherein the person is a speaking person, and the circuitry:
detects a change in a position of the speaking person, and generates the schedule for outputting the sound through the wave field synthesis in accordance with the motion of the speaking person.

### Claim 21 (depends on 20)

The information processing device according to claim 20, wherein the speaking person is an artist in a live hall, and the circuitry:
detects a change in a position of the artist in the live hall on a basis of
an image of the artist in the live hall, converts the change in the position of the artist in the live hall into a change in a position of the artist in a reproduction hall on a basis of spatial information of the live hall and the spatial information of the reproduction hall, and detects the change in the position of the artist in the reproduction hall, and
generates the schedule for outputting the sound through the wave field synthesis in the reproduction hall in accordance with the change in the position of the artist in the reproduction hall.

### Claim 22

An information processing method, comprising:
detecting, with circuitry, a change in a position of a person; and
changing, with the circuitry, a position of a virtual sound source in accordance with the change in the position of the person and outputting a sound through wave field synthesis so that a spatial sound field is transmitted via a plurality of speakers.

### Claim 23

A non-transitory computer-readable medium encoded with computer readable instructions that, when executed by a computer, cause the computer to perform a method comprising:
detecting a change in a position of a person; and
changing a position of a virtual sound source in accordance with the change in the position of the person and outputting a sound through wave field synthesis so that a spatial sound field is transmitted via a plurality of speakers.

### Claim 24

An information processing system, comprising:
circuitry that:
detects a change in a position of a person; and
changes a position of a virtual sound source in accordance with the change in the position of the person and outputs a sound through wave field synthesis so that a spatial sound field is transmitted via a plurality of speakers.
