# US 12,225,371 B2 · System and a processing method for customizing audio experience

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,225,371 B2
- Document ID: US12225371B2
- Status: Granted
- Kind: B2
- Application number: 18/334,096
- Filed: 2023-06-13
- Published: 2023-10-12
- Granted: 2025-02-11
- Earliest claimed: 2018-01-05
- Assignees: Creative Technology Ltd
- Applicants: Creative Technology Ltd
- Inventors: Teck Chee Lee; Christopher Hummersone; Toh Onn Desmond Hii
- Web page: https://patentgrep.com/patent/US12225371B2

## CPC

- H04S 7/305: {Electronic adaptation of stereophonic audio signals to reverberation of the listening space (H04S7/301 takes precedence)}
- G06F 16/636: {by using biological or physiological data}
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- H04S 7/301: {Automatic calibration of stereophonic sound system, e.g. with test microphone}
- H04S 7/40: {Visual indication of stereophonic sound image}
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S: STEREOPHONIC SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

The present disclosure relates to a system and a processing method in association with the system for customizing audio experience. Customization of audio experience can be based on derivation of at least one customized audio response characteristic which can be applied to an audio device used by a person. The customized audio response characteristic(s) can be unique to the person.

## Claims

### Claim 1

A method comprising:
generating, by one or more processors, image-related input audio signals from processing a captured image of a subject;
applying, by the one or more processors, an output signal to the image-related input audio signals; and
generating, by the one or more processors and based on the applying, output audio signals audibly perceivable by the subject.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
processing, by the one or more processors, the image-related input audio signal based on a database signal; and
generating, by the one or more processors, a plurality of intermediate processor datasets based on the processing.

### Claim 3 (depends on 2)

The method of claim 2, wherein the plurality of intermediate processor datasets corresponds to biometric data for at least two different biometric feature types.

### Claim 4 (depends on 1)

The method of claim 1, wherein the processing the captured image of the subject further comprises implementing at least one of a multiple-match processing based strategy, a multiple-recognizer based processing strategy, or a cluster based processing strategy.

### Claim 5 (depends on 1)

The method of claim 1, wherein the output audio signals provide the subject with a customized audio experience.

### Claim 6 (depends on 1)

The method of claim 1, further comprising combining, by the one or more processors, a plurality of intermediate processor datasets to produce the output signal.

### Claim 7 (depends on 6)

The method of claim 6, wherein the plurality of intermediate processor datasets includes at least one of a binaural room impulse response (BRIR) dataset, a binaural room transfer function (BRTF) dataset, a head related impulse response (HRIR) dataset or a head related transfer function (HRTF) dataset.

### Claim 8 (depends on 6)

The method of claim 6, further comprising generating, by the one or more processors, a plurality of intermediate processor datasets by processing an image-related input audio signal based on a database signal.

### Claim 9 (depends on 1)

The method of claim 1, wherein the output signal corresponds to an audio response characteristic associated with the subject.

### Claim 10 (depends on 9)

The method of claim 9, wherein the audio response characteristic is unique to the subject under a given environment and is one of an HRIR or BRIR.

### Claim 11 (depends on 1)

The method of claim 1, further comprising operating, by the one or more processors, as at least one of a type of recognizer of a plurality of recognizers or a multi-recognizer corresponding to a first type recognizer and a second type recognizer.

### Claim 12 (depends on 1)

The method of claim 1,
wherein the image-related input audio signals correspond to biometric data associated with the subject, and
wherein the biometric data comprises a first biometric feature type and a second biometric feature type.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
generating, by the one or more processors as a first type recognizer, a first set of intermediate processor datasets based on the first biometric feature type, and
generating, by the one or more processors as a second type recognizer, a second set of intermediate processor datasets based on the second biometric feature type.

### Claim 14 (depends on 13)

The method of claim 13, further comprising combining, by the one or more processors using weighted sums, the first set of intermediate processor datasets and the second set of intermediate processor datasets.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
grouping, by the one or more processors, a plurality of datasets of a database into a plurality of cluster groups, each cluster group corresponding to a cluster comprising a dataset, and
associating, by the one or more processors, a biometric feature type retrieved from the captured image with the cluster.

### Claim 16 (depends on 1)

The method of claim 1, further comprising:
operating, by the one or more processors, as a multi-recognizer corresponding to a first type recognizer and a second type recognizer,
wherein the image-related input audio signals correspond to biometric data associated with the subject, and
wherein the biometric data comprises a first biometric feature type and a second biometric feature type;
associating, by the one or more processors, the second biometric feature type that is the biometric feature type with a cluster;
generating, by the one or more processors as the first type recognizer, a first set of intermediate processor datasets based on the first biometric feature type, and
generating, by the one or more processors as the second type recognizer, a second set of intermediate processor datasets based on the second biometric feature type.

### Claim 17

A system comprising:
one or more processors; and
one or more tangible, non-transitory memories memory configured to communicate with the one or more processors;
the one or more tangible, non-transitory memories having instructions stored thereon that, in response to execution by the one or more processors, cause the one or more processors to perform operations comprising:
generating, by the one or more processors, image-related input audio signals from processing a captured image of a subject;
applying, by the one or more processors, an output signal to the image-related input audio signals; and
generating, by the one or more processors and based on the applying, output audio signals audibly perceivable by the subject.

### Claim 18 (depends on 17)

The system of claim 17, further comprising:
processing, by the one or more processors, the image-related input audio signal based on a database signal; and
generating, by the one or more processors, a plurality of intermediate processor datasets based on the processing.

### Claim 19 (depends on 18)

The system of claim 18, wherein the plurality of intermediate processor datasets corresponds to biometric data for at least two different biometric feature types.

### Claim 20

An article of manufacture including one or more non-transitory, tangible computer readable storage mediums having instructions stored thereon that, in response to execution by one or more processors, cause the one or more processors to perform operations comprising:
generating, by the one or more processors, image-related input audio signals from processing a captured image of a subject;
applying, by the one or more processors, an output signal to the image-related input audio signals; and
generating, by the one or more processors and based on the applying, output audio signals audibly perceivable by the subject.
