# US 12,008,288 B2 · Audio signal processing device based on orientation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,008,288 B2 - Document ID: US12008288B2 - Status: Granted - Kind: B2 - Application number: 17/431,690 - Filed: 2019-11-19 - Published: 2022-05-05 - Granted: 2024-06-11 - Earliest claimed: 2019-02-25 - Assignees: Sony Semiconductor Solutions Corporation - Applicants: Sony Semiconductor Solutions Corporation - Inventors: Naoya Haneda; Mikita Yasuda - Web page: https://patentgrep.com/patent/US12008288B2 ## CPC - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G10H 1/46: Volume control - G10H 1/125: {using a digital filter} - G10H 1/14: during execution {(voice controlled instruments G10H5/005)} - H04S 7/302: {Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence)} - H04S 7/307: {Frequency adjustment, e.g. tone control (H04S7/301 takes precedence)} - G10H 2220/201: for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument - G10H 2220/391: Angle sensing for musical purposes, using data from a gyroscope, gyrometer or other angular velocity or angular movement sensing device - G10H 2220/395: Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing - H04S 2400/13: Aspects of volume control, not necessarily automatic, in stereophonic sound systems - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE - H04S: STEREOPHONIC SYSTEMS ## Abstract An adjustment of an audio signal based on an orientation variation amount is carried out according to a surrounding audio condition. An audio signal processing device includes an audio signal analysis unit, an orientation variation analysis unit, and an audio signal adjustment unit. The audio signal analysis unit acquires an audio signal and sets a target value for an audio adjustment on the basis of the audio signal. The orientation variation analysis unit acquires orientation information and generates an orientation variation amount on the basis of the orientation information. The audio signal adjustment unit adjusts the audio signal toward the target value according to the orientation variation amount. ## Claims ### Claim 1 An audio signal processing device, comprising: an audio signal analysis unit configured to acquire an audio signal, and configured to set a target value for an audio adjustment based on the audio signal; an orientation variation analysis unit configured to acquire orientation information, and configured to generate an orientation variation amount based on the orientation information; and an audio signal adjustment unit configured to adjust the audio signal toward the target value based on the orientation variation amount, wherein the audio signal adjustment unit is configured to adjust the audio signal to lower a volume of the audio signal based on a determination that the orientation variation amount becomes larger than a first threshold value, and based on a determination that the audio signal reaches the target value, and the orientation variation amount becomes smaller than a second threshold value, the audio signal adjustment unit is configured to adjust the audio signal to return the volume of the audio signal. ### Claim 2 (depends on 1) The audio signal processing device according to claim 1, wherein the audio signal adjustment unit is configured to adjust the audio signal to narrow a frequency bandwidth of the audio signal based on a determination that the orientation variation amount becomes larger than a first threshold value, and based on the determination that the audio signal reaches the target value, and the orientation variation amount becomes smaller than a second threshold value, the audio signal adjustment unit is configured to adjust the audio signal to return the frequency bandwidth of the audio signal. ### Claim 3 (depends on 1) The audio signal processing device according to claim 1, wherein the audio signal adjustment unit is configured to adjust the audio signal to lower a gain of a frequency of the audio signal based on the determination that the orientation variation amount becomes larger than the first threshold value, and based on the determination that the audio signal reaches the target value, and the orientation variation amount becomes smaller than the second threshold value, the audio signal adjustment unit is configured to adjust the audio signal to return the gain of the frequency of the audio signal. ### Claim 4 (depends on 1) The audio signal processing device according to claim 1, wherein the audio signal adjustment unit is configured to adjust the audio signal, in a case where one of states continues for a predetermined period of time, the states including a first state in which the orientation variation amount is larger than the first threshold value, and a second state in which the orientation variation amount is smaller than the second threshold value. ### Claim 5 (depends on 1) The audio signal processing device according to claim 1, wherein the audio signal adjustment unit is configured to adjust the audio signal in a stepwise manner with a step size of a fixed amount. ### Claim 6 (depends on 1) The audio signal processing device according to claim 1, further comprising a sensor configured to detect either an acceleration or an angular velocity, and configured to generate the orientation information. ### Claim 7 (depends on 1) The audio signal processing device according to claim 1, further comprising a recording and reproducing unit configured to record and reproduce the audio signal and the orientation information in synchronization, wherein the audio signal analysis unit is configured to set the target value based on the audio signal that has been reproduced, the orientation variation analysis unit is configured to generate the orientation variation amount based on the orientation information that has been reproduced, and the audio signal adjustment unit is configured to adjust the audio signal that has been reproduced according to the orientation variation amount that has been reproduced. ### Claim 8 An audio signal processing device, comprising: an audio signal analysis unit configured to acquire an audio signal, and configured to set a target value for an audio adjustment based on the audio signal; an orientation variation analysis unit configured to acquire orientation information, and configured to generate an orientation variation amount based on the orientation information; an audio signal adjustment unit configured to adjust the audio signal toward the target value based on the orientation variation amount; and an image signal correction unit configured to acquire an image signal that is in synchronization with the audio signal, and configured to correct a blur of the image signal based on the orientation variation amount. ### Claim 9 (depends on 1) The audio signal processing device according to claim 1, wherein the audio signal adjustment unit is configured to adjust the audio signal, based on a correlation between an orientation variation indicated by the orientation variation amount and a variation in the audio signal.