# US 9,883,316 B2 · Method of generating multi-channel audio signal and apparatus for carrying out same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,883,316 B2
- Document ID: US9883316B2
- Status: Granted
- Kind: B2
- Application number: 14/515,622
- Filed: 2014-10-16
- Published: 2015-04-30
- Granted: 2018-01-30
- Earliest claimed: 2013-10-24
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Seok-hwan Jo; Do-Hyung Kim; Kang-eun Lee; Si-hwa Lee
- Web page: https://patentgrep.com/patent/US9883316B2

## CPC

- H04S 7/302: {Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence)}
- H04S 5/00: Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation
- H04S 7/30: {Control circuits for electronic adaptation of the sound field}
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S: STEREOPHONIC SYSTEMS

## Abstract

A method of generating a multi-channel audio signal includes: representing locations of a plurality of speakers as a plurality of polygons whose vertices are located at locations of corresponding speakers; acquiring a location of an object sound; calculating distances between the plurality of polygons and the location of the object sound; selecting one of the plurality of polygons on the basis of the calculated distances; and generating a multi-channel audio signal that corresponds to speakers corresponding to the selected polygon by mapping the object sound to the speakers corresponding to the selected polygon.

## Claims

### Claim 1

A method of generating multi-channel control signals, the method comprising:
by a hardware-based processor:
representing locations of a plurality of speakers as a mesh structure including a plurality of polygons whose vertices are corresponding to the locations of the plurality of speakers;
acquiring a location of an object in a current video frame;
calculating a plurality of distances between
the plurality of polygons included in the mesh structure, and the acquired location of the object, respectively;
selecting a polygon among the plurality of polygons included in the mesh structure based on the plurality of distances;
generating the multi-channel control signals corresponding to a plurality of speakers located in the selected polygon; and
transmitting the multi-channel control signals to the plurality of speakers located in the selected polygon, to reproduce a sound corresponding to the object via the plurality of speakers located in the selected polygon, and
wherein the selected polygon corresponds to a shortest distance among the plurality of distances.

### Claim 2 (depends on 1)

The method of claim 1, wherein the calculating of the plurality of distances between the plurality of polygons included in the mesh structure and the location of the object comprises:
selecting a plurality of reference points corresponding to the plurality of polygons included in the mesh structure; and
calculating the plurality of distances between the selected reference points and the location of the object.

### Claim 3 (depends on 2)

The method of claim 2, wherein the selected reference points are center point of gravity of the plurality of polygons included in the mesh structure, respectively.

### Claim 4 (depends on 1)

The method of claim 1, wherein the plurality of polygons included in the mesh structure are triangles, and
the generating of multi-channel control signals comprises:
calculating gains for the plurality of speakers located in the selected polygon on basis of the location of the object; and
mapping the sound corresponding to the object by applying the calculated gains to the plurality of speakers located in the selected polygon.

### Claim 5 (depends on 1)

The method of claim 1, wherein
the selected polygon is an adjacent polygon to a previous polygon selected in a previous video frame.

### Claim 6 (depends on 5)

The method of claim 5, wherein the calculating of the plurality of distances between the plurality of polygons included in the mesh structure and the location of the object comprises:
selecting a plurality of polygons as adjacent polygons existing within a certain range of a previous polygon selected in the previous video frame; and
calculating a plurality of distances from a changed location of the object with respect to the selected adjacent polygons existing within the certain range.

### Claim 7 (depends on 6)

The method of claim 6, wherein the adjacent polygons existing within the certain range has a center point of gravity within a certain distance from a center point of gravity of the previous polygon selected in the previous video frame.

### Claim 8 (depends on 5)

The method of claim 5, wherein the adjacent polygon shares at least one side or vertex with a previous polygon selected in the previous video frame.

### Claim 9 (depends on 1)

A non-transitory computer-readable storage medium having stored therein program instructions, which when executed by a computer, perform the method of claim 1.

### Claim 10

An apparatus for generating multi-channel control signals, the apparatus comprising:
a hardware-based processor to:
represent locations of a plurality of speakers as a mesh structure including a plurality of polygons whose vertices are corresponding to the locations of the plurality of speakers;
acquire a location of an object in a current video frame;
receive a sound corresponding to the object;
calculate a plurality of distances between the acquired location of the object and the plurality of polygons included in the mesh structure, respectively;
select a polygon among the plurality of polygons included in the mesh structure based on the plurality of distances; and
generate the multi-channel control signals corresponding to a plurality of speakers located in the selected polygon, to thereby reproduce the sound corresponding to the object in the current video frame via the plurality of speakers located in the selected polygon.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the correspondence of the vertices of the plurality of polygons to the plurality of speakers are represented by the mesh structure.

### Claim 12 (depends on 11)

The apparatus of claim 11,
wherein when a location of the object is changed in the current video frame after multi-channel audio signals are generated with respect to a previous video frame,
the selected polygon is an adjacent polygon to a previous polygon selected in a previous video frame.

### Claim 13 (depends on 12)

The apparatus of claim 12,
wherein the hardware-based processor is further configured to:
select a plurality of polygons as adjacent polygons existing within a certain range of the previous polygon selected in the previous video frame;
calculate a plurality of distances from a changed location of the object with respect to the selected adjacent polygons existing within the certain range;
select a polygon among the selected adjacent polygons existing within the certain range based on the plurality of distances from a changed location of the object with respect to the selected adjacent polygons existing within the certain range; and
generate multi-channel control signals that corresponds to a plurality of speakers located in the selected polygon among the selected adjacent polygons.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the selected adjacent polygons shares at least one side or vertex with the previous polygon selected in the previous video frame.

### Claim 15 (depends on 10)

The apparatus of claim 10, wherein to calculate the plurality of distances, a plurality of reference points corresponding to the plurality of polygons included in the mesh structure are selected and the plurality of distances between the selected reference points and the location of the object are calculated.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the selected reference points are center points of gravity of the plurality of polygons included in the mesh structure, respectively.

### Claim 17 (depends on 10)

The apparatus of claim 10, wherein the plurality of polygons included in the mesh structure are triangles, and
to generate the multi-channel control signals, gains for the plurality of speakers located in the selected polygon on basis of the location of the object is calculated and the sound is mapped by applying the calculated gains to the plurality of corresponding speakers located in the selected polygon.

### Claim 18

A method of generating multi-channel control signals by representing a plurality of speakers included in a multi-channel speaker system as a mesh structure including a plurality of polygons which vertices are corresponding to locations of each of the plurality of speakers, the method comprising:
by a hardware-based processor:
acquiring a location of an object in a current video frame using location information of the object from a previous video frame;
selecting a plurality of polygons existing within a certain distance of a polygon selected with the location information of the object from the previous video frame;
calculating a plurality of distances between each of the selected polygons existing within the certain distance and the location of the object in the current video frame;
selecting a final polygon, from among the selected polygons existing within the certain distance, which is closest to the location of the object based on the calculated distances;
generating the multi-channel control signals by mapping a sound corresponding to the object to a plurality of speakers, among the plurality of speakers included in the mesh structure, corresponding to the final polygon; and
transmitting the multi-channel control signals to the plurality of speaker located in the final polygon, to thereby reproduce the sound in the current video frame via the plurality of speakers located in the final polygon.

### Claim 19 (depends on 18)

The method of claim 18, wherein the final polygon is selected by calculating a plurality of distances between a center point of gravity of each of the selected polygons and the acquired location of the object.