# US 2021/0176581 A1 · Signal processing apparatus and method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176581 A1
- Document ID: US20210176581A1
- Status: Published application
- Kind: A1
- Application number: 16/762,304
- Filed: 2018-10-31
- Published: 2021-06-10
- Earliest claimed: 2017-11-14
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Minoru Tsuji; Toru Chinen; Mitsuyuki Hatanaka
- Web page: https://patentgrep.com/patent/US20210176581A1

## CPC

- H04S 7/302: {Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence)}
- G10L 19/00: Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis (in musical instruments G10H)
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- H04S 7/00: Indicating arrangements; Control arrangements, e.g. balance control
- H04S 7/308: {Electronic adaptation dependent on speaker or headphone connection}
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S: STEREOPHONIC SYSTEMS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

The present technology relates to a signal processing apparatus and method, and a program that can easily determine a localization position of a sound image. A signal processing apparatus includes: an acquisition unit configured to acquire information associated with a localization position of a sound image of an audio object in a listening space specified in a state where the listening space viewed from a listening position is displayed; and a generation unit configured to generate a bit stream on the basis of the information associated with the localization position. The present technology can be applied to the signal processing apparatus.

## Claims

### Claim 1

A signal processing apparatus comprising:
an acquisition unit configured to acquire information associated with a localization position of a sound image of an audio object in a listening space specified in a state where the listening space viewed from a listening position is displayed; and
a generation unit configured to generate a bit stream on a basis of the information associated with the localization position.

### Claim 2 (depends on 1)

The signal processing apparatus according to claim 1, wherein
the generation unit generates the bit stream by treating the information associated with the localization position as meta information of the audio object.

### Claim 3 (depends on 2)

The signal processing apparatus according to claim 2, wherein
the bit stream includes audio data and the meta information of the audio object.

### Claim 4 (depends on 1)

The signal processing apparatus according to claim 1, wherein
the information associated with the localization position is position information indicating the localization position in the listening space.

### Claim 5 (depends on 4)

The signal processing apparatus according to claim 4, wherein
the position information includes information indicating a distance from the listening position to the localization position.

### Claim 6 (depends on 4)

The signal processing apparatus according to claim 4, wherein
the localization position is a position on a screen that displays a video arranged in the listening space.

### Claim 7 (depends on 4)

The signal processing apparatus according to claim 4, wherein
the acquisition unit acquires, on a basis of the position information at a first time and the position information at a second time, the position information at a third time between the first time and the second time by interpolation processing.

### Claim 8 (depends on 1)

The signal processing apparatus according to claim 1, further comprising
a display control unit configured to control display of an image of the listening space viewed from the listening position or a position near the listening position.

### Claim 9 (depends on 8)

The signal processing apparatus according to claim 8, wherein
the display control unit causes each speaker of a speaker system of a predetermined channel configuration to be displayed on the image in a speaker layout of the predetermined channel configuration.

### Claim 10 (depends on 8)

The signal processing apparatus according to claim 8, wherein
the display control unit causes a localization position mark indicating the localization position to be displayed on the image.

### Claim 11 (depends on 10)

The signal processing apparatus according to claim 10, wherein
the display control unit causes a display position of the localization position mark to be moved in response to an input operation.

### Claim 12 (depends on 8)

The signal processing apparatus according to claim 8, wherein
the display control unit causes a screen on which a video arranged in the listening space and including a subject corresponding to the audio object is displayed to be displayed on the image.

### Claim 13 (depends on 8)

The signal processing apparatus according to claim 8, wherein
the image is a POV image.

### Claim 14

A signal processing method, by a signal processing apparatus, comprising:
acquiring information associated with a localization position of a sound image of an audio object in a listening space specified in a state where the listening space viewed from a listening position is displayed; and
generating a bit stream on a basis of the information associated with the localization position.

### Claim 15

A program causing a computer to execute processing comprising the steps of:
acquiring information associated with a localization position of a sound image of an audio object in a listening space specified in a state where the listening space viewed from a listening position is displayed; and
generating a bit stream on a basis of the information associated with the localization position.
