US 2014/0153753 A1 · Object Based Audio Rendering Using Visual Tracking of at Least One Listener

Abstract

In some embodiments, a method and system for generating image data, processing the image data to generate listener data indicative of at least one listener characteristic (e.g., position and/or size of each listener), and rendering at least one audio object (e.g., rendering an object based audio program) in response to the listener data (and optionally also listener identification data). For rendering a program indicative of audio objects, at least one speaker feed may be generated for driving at least one speaker to emit sound indicative of one of the objects and additional sound indicative of another one of the objects, where the sound is intended to be perceived by a listener at a first position with balance and delay appropriate to the first position, and the additional sound is intended to be perceived by a listener at a second position with balance and delay appropriate to the second position.

Claims20

Dependent claims

A method for rendering an audio program comprising one or more audio objects for playback in an environment including a speaker array comprising at least one speaker, said method including the steps of:

(a) generating image data indicative of at least one listener in the environment;
(b) processing the image data to generate listener data indicative of at least one characteristic of at least one said listener;
and
(c) rendering at least one of the audio objects in response to the listener data.

1 more element

A system for rendering an audio program comprising one or more audio objects for playback in an environment including a speaker array comprising at least one speaker, said system including:

a camera subsystem, including at least one camera, wherein the camera subsystem is configured to generate image data indicative of at least one listener in a field of view of at least one camera of the camera subsystem;
a visual tracking subsystem coupled and configured to process the image data to generate listener data indicative of at least one listener characteristic;
and
a rendering subsystem coupled and configured to render at least one of the audio objects in response to the listener data.

1 more element

Dependencies are inferred from the claim text.

Object Based Audio Rendering Using Visual Tracking of at Least One Listener

Life of this patent

Object Based Audio Rendering Using Visual Tracking of at Least One Listener

Life of this patent

Abstract

Claims20