# US 12,002,485 B2 · Information processing device and information processing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,002,485 B2 - Document ID: US12002485B2 - Status: Granted - Kind: B2 - Application number: 17/310,433 - Filed: 2020-01-29 - Published: 2022-06-30 - Granted: 2024-06-04 - Earliest claimed: 2019-02-12 - Assignees: Sony Group Corporation - Applicants: Sony Group Corporation - Inventors: Weihsiang Liao; Keiichi Osako; Yuhki Mitsufuji - Web page: https://patentgrep.com/patent/US12002485B2 ## CPC - G10L 21/14: by displaying frequency domain information - G01H 3/04: Frequency - G06F 1/08: Clock generators with changeable or programmable clock frequency - H04R 29/005: {Microphone arrays} - H04R 29/008: {Visual indication of individual signal levels (visual indication of stereophonic sound image H04S7/40)} - H04S 7/40: {Visual indication of stereophonic sound image} - G10L 21/10: Transforming into visible information - H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G01H: MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - H04S: STEREOPHONIC SYSTEMS ## Abstract The present technology relates to an information processing device, an information processing method, and a program that enable easier visualization of a sound field. The information processing device includes: a calculation unit configured to calculate, on the basis of positional information indicating a plurality of observation positions in a space and an audio signal of sound observed at each of the plurality of observation positions, an amplitude or phase of the sound at each of a plurality of positions in the space at a first time interval; an event detection unit configured to detect an event; and an adjustment unit configured to perform, in a case where the event is detected, control such that the amplitude or the phase is calculated at a second time interval shorter than the first time interval. The present technology can be applied to a sound-field visualization system. ## Claims ### Claim 1 An information processing device, comprising: a calculation unit configured to calculate, based on positional information indicating a plurality of observation positions in a space and an audio signal of sound observed at each of the plurality of observation positions, an amplitude or phase of the sound at each of a plurality of positions in the space at a first time interval; an event detection unit configured to detect an event; and an adjustment unit configured to perform, based on the detection of the event is detected, control such that the amplitude or the phase is calculated at a second time interval shorter than the first time interval. ### Claim 2 (depends on 1) The information processing device according to claim 1, wherein the calculation unit is further configured to transform the audio signal at each of the plurality of observation positions into a spatial-frequency domain signal based on the positional information and calculate the amplitude or the phase based on the spatial-frequency domain signal. ### Claim 3 (depends on 1) The information processing device according to claim 1, wherein the adjustment unit is further configured to perform, based on a termination of the event, control such that the amplitude or the phase is calculated at a third time interval longer than the first time interval. ### Claim 4 (depends on 3) The information processing device according to claim 3, further comprising: a buffer configured to retain the amplitude or the phase calculated, wherein the adjustment unit is further configured to perform, based on occurrence of underflow of the amplitude or underflow of the phase in the buffer during calculation of the amplitude or the phase at the third time interval, control such that the amplitude or the phase is calculated at a fourth time interval that is longer than the second time interval and is shorter than the first time interval. ### Claim 5 (depends on 1) The information processing device according to claim 1, wherein the event detection unit is further configured to determine, in response to an instruction from a user, that the event has been detected. ### Claim 6 (depends on 1) The information processing device according to claim 1, wherein the event detection unit is further configured to determine, based on detection of a specific classification of sound, that the event has been detected. ### Claim 7 (depends on 6) The information processing device according to claim 6, wherein the specific classification of sound has a signal level in a specific level range. ### Claim 8 (depends on 6) The information processing device according to claim 6, wherein the specific classification of sound has a particular frequency at a level in a specific level range. ### Claim 9 (depends on 6) The information processing device according to claim 6, wherein the specific classification of sound has a specific spectral shape. ### Claim 10 (depends on 1) The information processing device according to claim 1, wherein the event detection unit is further configured to determine, at a specific timing, that the event has been detected. ### Claim 11 (depends on 1) The information processing device according to claim 1, further comprising: an image processing unit configured to generate an image of wavefronts of the sound in the space based on the amplitude or the phase calculated. ### Claim 12 (depends on 11) The information processing device according to claim 11, wherein the adjustment unit is further configured to perform, based on calculation of the amplitude or the phase at the second time interval, control such that a display of the image is updated at a time interval longer than the second time interval. ### Claim 13 An information processing method, comprising: in an information processing device: calculating, based on positional information indicating a plurality of observation positions in a space and an audio signal of sound observed at each of the plurality of observation positions, an amplitude or phase of the sound at each of a plurality of positions in the space at a first time interval; detecting an event; and performing, based on the detection of the event, control such that the amplitude or the phase is calculated at a second time interval shorter than the first time interval. ### Claim 14 A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising: calculating, based on positional information indicating a plurality of observation positions in a space and an audio signal of sound observed at each of the plurality of observation positions, an amplitude or phase of the sound at each of a plurality of positions in the space at a first time interval; detecting an event; and performing, based on the detection of the event, control such that the amplitude or the phase is calculated at a second time interval shorter than the first time interval.