# US 11,445,289 B2 · Audio processing device and audio processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,445,289 B2
- Document ID: US11445289B2
- Status: Granted
- Kind: B2
- Application number: 16/644,287
- Filed: 2018-06-22
- Published: 2020-07-30
- Granted: 2022-09-13
- Earliest claimed: 2017-09-13
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Go Igarashi; Shigetoshi Hayashi; Naoki Shinmen; Kohei Asada
- Web page: https://patentgrep.com/patent/US11445289B2

## CPC

- H04R 1/1016: {Earpieces of the intra-aural type}
- H04R 1/1083: {Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06)}
- A61B 5/7203: {for noise prevention, reduction or removal}
- G10K 11/17837: {by retaining part of the ambient acoustic environment, e.g. speech or alarm signals that the user needs to hear}
- G10K 11/17857: {Geometric disposition, e.g. placement of microphones}
- G10K 11/17881: {the reference signal being an acoustic signal, e.g. recorded with a microphone}
- G10L 21/0208: Noise filtering
- G10L 21/0272: Voice signal separating
- H04R 1/1008: {Earpieces of the supra-aural or circum-aural type}
- H04R 1/105: {Earpiece supports, e.g. ear hooks (for stereophonic headphones H04R5/0335)}
- H04R 3/04: for correcting frequency response
- H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)}
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- A61B 5/6817: {Ear canal}
- G10K 2210/1081: Earphones, e.g. for telephones, ear protectors or headsets
- H04R 1/1033: {Cables or cables storage, e.g. cable reels (cord reels per se H02G11/02; arrangements for storing and repeatedly paying-out and re-storing lengths of conductors or cables B65H75/34; extensible conductors or cables, e.g. self-coiling cords H01B7/06)}
- H04R 1/1041: {Mechanical or electronic switches, or control elements (switches in general H01H)}
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04R 23/008: {using optical signals for detecting or generating sound}
- H04R 2201/107: Monophonic and stereophonic headphones with microphone for two-way hands free communication
- H04R 2420/07: Applications of wireless loudspeakers or wireless microphones
- H04R 2460/01: Hearing devices using active noise cancellation
- H04R 2460/09: Non-occlusive ear tips, i.e. leaving the ear canal open, for both custom and non-custom tips (H04R2460/11 takes precedence)
- H04R 2460/17: Hearing device specific tools used for storing or handling hearing devices or parts thereof, e.g. placement in the ear, replacement of cerumen barriers, repair, cleaning hearing devices
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G10K: SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

[Problem] To propose a mechanism capable of performing a noise cancellation process in an ear hole opening type audio processing device. [Solution] An audio processing device including: an audio information acquisition unit that acquires audio information; a holding unit that abuts on a cavum concha or an inner wall of an ear canal and holds the audio information acquisition unit in a space closer to an eardrum side than a tragus, in a state of being worn by a user; an opening portion that opens an ear hole to an outside; and a signal processing unit that generates a noise cancellation signal based on the audio information acquired by the audio information acquisition unit.

## Claims

### Claim 1

An audio processing device, comprising:
a first audio information acquisition unit configured to:
acquire first audio information; and
transmit a transmission wave to one of an ear canal or an eardrum, wherein
the first audio information includes a distance between the first audio information acquisition unit and a reflection point, and
the reflection point is a point at which the transmission wave is reflected in one of the ear canal or the eardrum;
a holding unit configured to:
hold the first audio information acquisition unit in a space closer to the eardrum than a tragus;
hold the first audio information acquisition unit in a wearable state; and
abut one of a cavum concha or an inner wall of the ear canal;
an opening portion configured to open an ear hole to an outside;
a signal processing unit configured to generate a noise cancellation signal based on the first audio information; and
an operation control unit configured to:
determine whether the audio processing device is worn by a user based on the distance between the first audio information acquisition unit and the reflection point; and
control an operation of the audio processing device based on the determination.

### Claim 2 (depends on 1)

The audio processing device according to claim 1, wherein the holding unit holds the audio information acquisition unit in a space up to 15 mm away from a boundary between the cavum concha and the ear canal to the eardrum side or in a space up to 15 mm away from the boundary between the cavum concha and the ear canal on an opposite side of the eardrum.

### Claim 3 (depends on 1)

The audio processing device according to claim 1, further comprising
an audio output unit that outputs audio based on an output signal generated based on the noise cancellation signal,
wherein the holding unit maintains a relative positional relationship between the audio information acquisition unit and an output hole of the audio output from the audio output unit.

### Claim 4 (depends on 1)

The audio processing device according to claim 1, wherein the holding unit holds the audio information acquisition unit at a position where the inner wall of the ear canal is not present on a straight line between the audio information acquisition unit and the eardrum.

### Claim 5 (depends on 1)

The audio processing device according to claim 1, wherein the first audio information acquisition unit is further configured to:
acquire vibration information of one of the ear canal or the eardrum; and
acquire sound pressure information of a cancellation point based on the acquired vibration information.

### Claim 6 (depends on 5)

The audio processing device according to claim 5, wherein the cancellation point is one point of the eardrum.

### Claim 7 (depends on 5)

The audio processing device according to claim 5, wherein the audio information acquisition unit estimates the sound pressure information of the cancellation point based on the vibration information of two or more points on the inner wall of the ear canal.

### Claim 8 (depends on 5)

The audio processing device according to claim 5, wherein the audio information acquisition unit acquires a reflection wave which is the reflected transmission wave, and acquires the vibration information indicating displacement or a speed at the reflection point.

### Claim 9 (depends on 8)

The audio processing device according to claim 8, wherein the audio information acquisition unit estimates the sound pressure information of the cancellation point based on information indicating a three-dimensional shape of the ear canal.

### Claim 10 (depends on 9)

The audio processing device according to claim 9, wherein the audio information acquisition unit acquires the information indicating the three-dimensional shape of the ear canal by scanning the ear canal while changing a transmission direction of the transmission wave.

### Claim 11 (depends on 10)

The audio processing device according to claim 10, further comprising an authentication unit that authenticates the user based on the information indicating the three-dimensional shape of the ear canal.

### Claim 12 (depends on 5)

The audio processing device according to claim 5, further comprising
an audio output unit that outputs audio based on an output signal generated based on the noise cancellation signal,
wherein the signal processing unit adjusts a sound quality of the output signal based on information indicating a three-dimensional shape of the ear canal.

### Claim 13 (depends on 1)

The audio processing device according to claim 1, wherein the signal processing unit is further configured to:
extract a voice of the user based on the first audio information acquired by the first audio information acquisition unit corresponding to each ear of the user, and
synthesize the extracted voice with the noise cancellation signal.

### Claim 14 (depends on 1)

The audio processing device according to claim 1, further comprising a second audio information acquisition unit configured to collect second audio information that includes a voice of the user, wherein
the signal processing unit is further configured to extract the voice of the user based on the second audio information collected by the second audio information acquisition unit.