# US 2019/0174247 A1 · Information processing apparatus, information processing method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0174247 A1 - Document ID: US20190174247A1 - Status: Published application - Kind: A1 - Application number: 16/323,591 - Filed: 2017-06-23 - Published: 2019-06-06 - Earliest claimed: 2016-09-20 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Toshiya HAMADA; Nobuaki IZUMI; Yukara IKEMIYA - Web page: https://patentgrep.com/patent/US20190174247A1 ## CPC - H04S 7/303: {Tracking of listener position or orientation} - H04R 5/02: Spatial or constructional arrangements of loudspeakers - H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)} - H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)} - H04S 7/304: {For headphones} - H04S 7/40: {Visual indication of stereophonic sound image} - H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved - H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) - H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction - H04S: STEREOPHONIC SYSTEMS - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract A sound source setting section and a listening setting section are each configured to have a parameter setting section, a display section, and an arrangement relocation section on a placing surface of a placing table in real space, the arrangement relocation section allowing the source setting and listening sections to relocate on the placing surface. A reflecting member to which a reflecting characteristic is assigned is configured to be placeable on the placing table. A mixing process section performs a mixing process and also generates an image at the position, in a virtual space, of the sound source setting section relative to the listening setting section, the image having a texture indicative of a sound source assigned to the sound source setting section. Sound mixing with respect to a free listening point is thus performed easily. ## Claims ### Claim 1 An information processing apparatus comprising: a mixing process section configured to perform a mixing process on the basis of arrangement information regarding a sound source setting section to which a sound source is assigned, setting parameter information from the sound source setting section, and arrangement information regarding a listening setting section to which a listening point is assigned, and by use of data regarding the sound source. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the mixing process section transmits applicable parameter information used in the mixing process regarding the sound source to the sound source setting section corresponding to the sound source. ### Claim 3 (depends on 1) The information processing apparatus according to claim 1, wherein the mixing process section sets parameters for the sound source setting section on the basis of metadata associated with the sound source. ### Claim 4 (depends on 1) The information processing apparatus according to claim 1, wherein the mixing process section stores into an information storage section the arrangement information and the applicable parameter information used in the mixing process together with an elapsed time. ### Claim 5 (depends on 4) The information processing apparatus according to claim 4, wherein, when performing the mixing process using the information stored in the information storage section, the mixing process section transmits either to the sound source setting section or to the listening setting section a relocation signal for relocating the sound source setting section and the listening setting section in a manner reflecting the arrangement information acquired from the information storage section. ### Claim 6 (depends on 4) The information processing apparatus according to claim 4, wherein, using the arrangement information and the applicable parameter information stored in the information storage section, the mixing process section generates arrangement information and applicable parameter information regarding a listening point about which the arrangement information and the applicable parameter information are not stored. ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, wherein, when receiving an operation to change the arrangement of the sound source with respect to the listening point, the mixing process section performs the mixing process on the basis of the arrangement following a changing operation, and transmits either to the sound source setting section or to the listening setting section a relocation signal for relocating the sound source setting section and the listening setting section in a manner reflecting the arrangement following the changing operation. ### Claim 8 (depends on 1) The information processing apparatus according to claim 1, wherein, when a mixed sound generated by the mixing process fails to meet a predetermined admissibility condition, the mixing process section transmits a notification signal indicating the failure to meet the admissibility condition either to the sound source setting section or to the listening setting section. ### Claim 9 (depends on 1) The information processing apparatus according to claim 1, wherein the sound source setting section and the listening setting section are physical devices placed on a placing table provided in real space. ### Claim 10 (depends on 9) The information processing apparatus according to claim 9, wherein either the sound source setting section or the listening setting section has a parameter setting section, a display section, and as arrangement relocation section for relocating on a placing surface of the placing table. ### Claim 11 (depends on 9) The information processing apparatus according to claim 9, wherein either the sound source setting section or the listening setting section is configured to be variable in shape and to generate arrangement information or setting parameter information in accordance with the shape. ### Claim 12 (depends on 9) The information processing apparatus according to claim 9, further comprising: a reflecting member configured to be placeable on the placing table; wherein the mixing process section performs the mixing process using arrangement information regarding the reflecting member and a reflection characteristic assigned to the reflecting member. ### Claim 13 (depends on 1) The information processing apparatus according to claim 1, wherein the mixing process section includes an image generation section configured to discriminate a positional relationship of the sound source setting section with respect to the listening setting section on the basis of arrangement status of the sound source setting section and the listening setting section, the image generation section further displaying an image at the position, in a virtual space, of the sound source setting section relative to the listening setting section on the basis of the result of the discrimination, the image having a texture indicative of the sound source assigned to the sound source setting section. ### Claim 14 (depends on 13) The information processing apparatus according to claim 13, wherein the image generation section generates the image as viewed from a viewpoint represented by the listening point. ### Claim 15 (depends on 13) The information processing apparatus according to claim 13, wherein the image generation section overlays an image visualizing a sound output from the sound source onto a corresponding sound source position in the image having the texture indicative of the sound source. ### Claim 16 (depends on 13) The information processing apparatus according to claim 13, wherein the image generation section overlays an image visualizing a reflected sound of the sound output from the sound source onto a sound-reflecting position set by the mixing process in the image having the texture indicative of the sound source. ### Claim 17 An information processing method comprising: causing a mixing process section to acquire arrangement information and setting parameter information regarding a sound source setting section to which a sound source is assigned; causing the mixing process section to acquire arrangement information regarding a listening setting section to which a listening point is assigned; and causing the mixing process section to perform a mixing process on the basis of the acquired arrangement information and setting parameter information and by use of data regarding the sound source. ### Claim 18 A program causing a computer to implement functions comprising: acquiring arrangement information and setting parameter information regarding a sound source setting section to which a sound source is assigned; acquiring arrangement information regarding a listening setting section to which a listening point is assigned; and performing a mixing process on the basis of the acquired arrangement information and setting parameter information, and by use of data regarding the sound source.