# US 2019/0246231 A1 · Method of improving localization of surround sound

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246231 A1
- Document ID: US20190246231A1
- Status: Published application
- Kind: A1
- Application number: 15/890,072
- Filed: 2018-02-06
- Published: 2019-08-08
- Earliest claimed: 2018-02-06
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment Inc
- Inventors: Scott Wardle; Jeppe Oland; Joshua Isenberg; Robert Pullman, III
- Web page: https://patentgrep.com/patent/US20190246231A1

## CPC

- H04S 7/303: {Tracking of listener position or orientation}
- G06V 20/00: Scenes; Scene-specific elements (control of digital cameras H04N23/60)
- H04S 7/301: {Automatic calibration of stereophonic sound system, e.g. with test microphone}
- H04S 7/304: {For headphones}
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S: STEREOPHONIC SYSTEMS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Aspects of the present disclosure relate to a method and system for processing an audio signal to optimize the localization of sound in a sound system using a head related transfer function HRTF). A location of a user is determined and a speaker is driven with a waveform representing a location specific cue having a desired user response. The location specific cue is associated with a defined HRTF for the determined location of the user. A user response to location specific cue is detected and compared to the location specific cue. The defined HRTF is then updated with information from the comparison of the user response to the location specific cue.

## Claims

### Claim 1

A method for determining an optimal Head-Related Transfer Function the method comprising;
a) determining a location of a user;
b) driving a speaker with a waveform representing a location specific cue having a desired user response wherein the location specific cue is associated with a defined Head-related transfer function (HRTF) for the determined location of the user wherein the defined HRTF includes at least an interpolation between a first and second HRTFs chosen to match an anatomy of the user, wherein the defined HTRF more accurately models the anatomy of the user than the first or second HRTF;
c) detecting a user response to location specific cue;
d) analyzing user response in comparison to location specific cue; and
e) updating the defined HRTF with information from the comparison of the user response and the location specific cue.

### Claim 2 (depends on 1)

The method of claim 1 further comprising repeating steps a) through e) until the detected user response matches the desired user response.

### Claim 3 (depends on 1)

The method of claim 1 wherein a) further comprises determining an inter-aural distance of the user.

### Claim 4 (depends on 3)

The method of claim 3 wherein the defined head-related transfer function of b) is chosen at least based on the determined inter-aural distance of the user.

### Claim 5 (depends on 3)

The method of claim 3 wherein the inter-aural distance is determined from user input.

### Claim 6 (depends on 3)

The method of claim 3 wherein the inter-aural distance is determined from an image of the user's face captured by an image capture unit.

### Claim 7 (depends on 3)

The method of claim 3 wherein the inter-aural distance is determined from a photograph of the user.

### Claim 8 (depends on 1)

The method of claim 1 wherein a) further comprises determining an ear shape and/or size of the user.

### Claim 9 (depends on 8)

The method of claim 8 wherein the ear shape and/or size is determined from an image of the user's ear captured by the image capture unit.

### Claim 10 (depends on 1)

The method of claim 1 wherein location specific cue is a panned sound source and the desired user response is a change in orientation of the user towards a virtual location of the panned sound source.

### Claim 11 (depends on 10)

The method of claim 10 wherein the change in orientation of the user includes pointing at the virtual location of the sound source.

### Claim 12 (depends on 1)

The method of claim 1 wherein the location specific cue is a point source and the desired user response is movement of the user to a virtual location of sound source.

### Claim 13 (depends on 1)

The method of claim 1 wherein the location specific cue is a point source and the desired user response is a pointing action to a virtual location of the sound source.

### Claim 14 (depends on 1)

The method of claim 1 wherein determining a location of a user at a) further comprises playing white noise out of a single speaker while the user is wearing microphones in the user's ear's to track the user's movements and head orientation.

### Claim 15

A non-transitory computer readable medium having embodied thereon instructions, the instructions when executed by a processor cause the processor to carry out the method for determining an optimal Head-Related Transfer Function the method comprising:
a) determining a location of a user;
b) play a location specific cue having a desired user response wherein the location specific cue is associated with a defined Head-related transfer function (HRTF) for the determined location of the user wherein the defined HRTF includes at least an interpolation between a first and second HRTFs chosen to match an anatomy of the user wherein the defined HTRF more accurately models the anatomy of the user than the first or second HRTF;
c) detect a user response to location specific cue;
d) analyze user response in comparison to location specific cue; and
e) update the defined HRTF with the information from the comparison of the user response and the location specific cue.

### Claim 16 (depends on 15)

The method of claim 15 further comprising repeating steps a) through e) until the detected user response matches the desired user response.

### Claim 17 (depends on 15)

The method of claim 15 wherein a) further comprises determining the inter-aural distance of the user.

### Claim 18 (depends on 17)

The method of claim 17 wherein the defined head-related transfer function filter of b) is chosen at least based on the determined inter-aural distance of the user.

### Claim 19 (depends on 15)

The method of claim 15 wherein a) further comprises determining an ear shape and/or size of the user.

### Claim 20 (depends on 19)

The method of claim 19 wherein the defined head-related transfer function of b) is chosen at least based on the determined ear shape and/or size of the user.

### Claim 21

A system, comprising:
a processor;
a memory coupled to the processor, the memory having executable instructions embodied therein, the instructions being configured to cause the processor to carry out a method when executed, the method comprising;
a) determining a location of a user;
b) play a location specific cue having a desired user response wherein the location specific cue is associated with a defined Head-related transfer function (HRTF) for the determined location of the user wherein the defined HRTF includes at least an interpolation between a first and second HRTFs chosen to match an anatomy of the user wherein the defined HTRF more accurately models the anatomy of the user than the first or second HRTF;
c) detect a user response to location specific cue;
d) analyze user response in comparison to location specific cue; and
e) update the defined HRTF with the information from the comparison of the user response and the location specific cue.
