# US 2012/0257036 A1 · Directional sound capturing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0257036 A1
- Document ID: US20120257036A1
- Status: Published application
- Kind: A1
- Application number: 13/413,291
- Filed: 2012-03-06
- Published: 2012-10-11
- Earliest claimed: 2011-04-07
- Assignees: Sony Mobile Communications Inc.
- Inventors: Pär Stenberg; Karl Ola Thörn; Magnus Jendbro; Pär-Anders Aronsson; Magnus Landqvist; Martin Ek
- Web page: https://patentgrep.com/patent/US20120257036A1

## CPC

- G03B 31/00: Associated working of cameras or projectors with sound-recording or sound-reproducing means
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)

## Abstract

This disclosure is directed to a sound recording arrangement comprising a sound recording arrangement and a method in the sound recording arrangement for amplifying sounds in a primary gaze direction of the user of the sound recording arrangement. The method comprises the actions of recording sounds arriving at a sound recording unit from objects in the field of view of the user, and recording a first set of images of the head and/or the eyes of the user, and determining a primary gaze direction of the user based on the first set of images, and amplifying sounds arriving in the primary gaze direction compared to sounds arriving from other directions.

## Claims

### Claim 1

A sound recording arrangement comprising:
a sound recording unit (12) capable of operatively record sound arriving at the sound recording unit from objects in the field of view of a user of the sound recording arrangement, wherein:
a first image recording unit is configured to operatively record a first set of images of the head and/or the eyes of the user,
a control unit is configured to operatively determine a primary gaze direction of the user based on the first set of images, and
the control unit is further configured to operatively amplify sounds arriving in the primary gaze direction compared to sounds arriving from other directions.

### Claim 2 (depends on 1)

The sound recording arrangement according to claim 1, wherein:
the control unit is configured to operatively determine a secondary gaze direction of the user based on the first set of images,
the sound recording arrangement comprises a second image recording unit configured to operatively record a second set of images of an object located in the secondary gaze direction, and
the control unit is configured to operatively determine the primary gaze direction of the user based on the first set of images and based on a correlation of the secondary gaze direction and an object tracking of the object in the second set of images.

### Claim 3 (depends on 1)

The sound recording arrangement according to claim 1, wherein:
the sound recording unit comprises a cluster of at least two sound recording devices or at least three sound recording devices each capable of operatively record sounds from objects in the field of view of a user, and
the control unit is configured to operatively amplify sounds in the primary gaze direction in one angular dimension using said at least two sound recording devices, or in two angular dimensions using said at least three sound recording devices.

### Claim 4 (depends on 1)

The sound recording arrangement according to claim 1, comprising a distance measuring unit configured to operatively obtain the distance to an object in the primary gaze direction, wherein:
the control unit is configured to operatively amplify sounds in the primary gaze direction at the distance obtained by the distance measuring unit.

### Claim 5 (depends on 1)

The sound recording arrangement according to claim 1, wherein:
the control unit is configured to operatively reduce the amplification when the time during which the primary gaze direction remains the same drops below a predetermined threshold and/or the frequency at which the same primary gaze direction is repeatedly determined drops below a predetermined threshold.

### Claim 6 (depends on 1)

The sound recording arrangement according to claim 1, wherein:
the control unit is configured to operatively reduce the amplification when no sound is recorded in the primary gaze direction during a predetermined period.

### Claim 7 (depends on 1)

The sound recording arrangement according to claim 1, wherein:
the control unit is configured to operatively raise the amplification when the time during which the primary gaze direction remains the same and/or the frequency at which the primary gaze direction is repeated goes above a predetermined threshold.

### Claim 8 (depends on 7)

The sound recording arrangement according to claim 7, wherein:
the control unit is configured to operatively raise the amplification gradually.

### Claim 9 (depends on 8)

The sound recording arrangement according to claim 8, wherein:
the control unit is configured to operatively raise the amplification immediately when the current primary gaze direction is the same as a previously determined primary gaze direction.

### Claim 10 (depends on 1)

The sound recording arrangement according to claim 1, wherein:
the control unit is configured to operatively amplify sounds in the primary gaze direction even if there is currently no sound arriving at the sound recording unit in the primary gaze direction.

### Claim 11

A method in a sound recording arrangement for amplifying sounds in a primary gaze direction of a user of the sound recording arrangement, which method comprises:
recording sounds arriving at a sound recording unit from objects in the field of view of the user,
recording a first set of images of the head and/or the eyes of the user,
determining a primary gaze direction of the user based on the first set of images, and
amplifying sounds arriving in the primary gaze direction compared to sounds arriving from other directions.

### Claim 12 (depends on 11)

The method according to claim 11, which method comprises:
determining a secondary gaze direction of the user based on the first set of images,
determining the primary gaze direction of the user based on the first set of images and based on a correlation of the secondary gaze direction and an object tracking of the object in the second set of images.

### Claim 13 (depends on 11)

The method according to claim 11, which method comprises:
recording the sounds from objects in the field of view of a user using at least two sound recording devices, or using at least three sound recording devices, and
amplifying sounds in the primary gaze direction in one angular dimension based on sounds recorded from said at least two sound recording devices, or in two angular dimensions based on sounds recorded from said at least three sound recording devices.

### Claim 14 (depends on 11)

The method according to claim 11, which method comprises:
obtaining the distance to an object in the primary gaze direction,
amplifying sounds in the primary gaze direction at the distance obtained by the distance measuring unit.

### Claim 15 (depends on 11)

The method according to claim 11, which method comprises:
reducing the amplification when the time during which the primary gaze direction remains the same drops below a predetermined threshold and/or the frequency at which the same primary gaze direction is repeatedly determined drops below a predetermined threshold.

### Claim 16 (depends on 11)

The method according to claim 11, which method comprises:
reducing the amplification when no sound is recorded in the primary gaze direction during a predetermined period.

### Claim 17 (depends on 11)

The method according to claim 11, which method comprises:
raising the amplification when the time during which the primary gaze direction remains the same and/or the frequency at which the primary gaze direction is repeated goes above predetermined threshold.

### Claim 18 (depends on 17)

The method according to claim 17, which method comprises:
raising the amplification gradually.

### Claim 19 (depends on 11)

The method according to claim 11, which method comprises:
raising the amplification immediately when the current primary gaze direction is the same as a previously determined primary gaze direction.

### Claim 20 (depends on 11)

The method according to claim 11, which method comprises:
amplifying sounds in the primary gaze direction even if there is currently no sound arriving at the sound recording unit in the primary gaze direction.
