US 7,606,372 B2Granted

Device and method for determining a reproduction position

AssigneeFraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.

InventorsFrank Melchior, Sandra Brix

Life of this patent

Estimating the term…

Abstract

A method and device are provided for determining a reproduction position of a source of sound for audio-visual reproduction of a film scene from a plurality of individual pictures with regard to a reproduction surface having a predetermined width, and with regard to a projection source having a projection reference point. A recording position of the source of sound, a camera position during recording, and an aperture angle of the camera during recording are obtained and the determined recording position is transformed to a camera coordinate system. A reproduction position for the source of sound is calculated and used to produce sound-source positioning in a reproduction room using wave-field synthesis methods.

Claims22

Dependent claims

A device for determining a reproduction position of a source of sound for audio-visual reproduction of a film scene from a plurality of individual pictures with regard to a reproduction surface having a predetermined width and a projection source having a projection reference point, the device comprising:

a provider configured for providing a recording position of the source of sound, a camera position during recording, and an aperture angle of the camera during recording;
a transformer configured for transforming the recording position of the source of sound to a camera coordinate system, the origin of which is defined, in relation to a camera aperture, to obtain a recording position of the source of sound in the camera coordinate system;
a calculator configured for calculating the reproduction position of the source of sound in relation to the projection reference point, the calculator being configured to use the projection reference point and the camera aperture as a common starting point, and the calculator being configured,
in the case of an aperture angle of the camera which equals a predetermined aperture angle,
to calculate the reproduction position on the basis of an intersection point between a straight line extending through the recording position of the source of sound in the camera coordinate system and through the common starting point and the reproduction surface, or
if no such intersection point exists, to calculate the reproduction position on the basis of an intersection point of the straight line with a projection sphere, the central point of which is the common starting point, and the radius of which depends on the width of the reproduction surface and the predetermined aperture angle, or
in the case of an aperture angle of the camera which deviates from the predetermined aperture angle,
to calculate the reproduction position on the basis of an intersection point between a straight line extending through the recording position and the source of sound in the camera coordinate system and a reference point, spaced away from the common starting point by a distance, and the reproduction surface, and on the basis of a shift by a difference in relation to the reproduction surface, the distance and the difference depending on the aperture angle of the camera, or
if no such intersection point exists, to calculate the reproduction position on the basis of an intersection point of the straight line with a projection sphere, the central point of which equals the common starting point, and on the basis of a shift by the difference.

6 more elements

A method for determining a reproduction position of a source of sound for audio-visual reproduction of a film scene from a plurality of individual pictures with regard to a reproduction surface having a predetermined width and a projection source having a projection reference point, the method comprising:

providing a recording position of the source of sound, a camera position during recording, and an aperture angle of the camera during recording to a hardware apparatus;
transforming, using the hardware apparatus, the recording position of the source of sound to a camera coordinate system, the origin of which is defined, in relation to a camera aperture, to obtain a recording position of the source of sound in the camera coordinate system;
calculating, using the hardware apparatus, the reproduction position of the source of sound in relation to the projection reference point, the calculator being configured to use the projection reference point and the camera aperture as a common starting point, and the calculator operating,
in the case of an aperture angle of the camera which equals a predetermined aperture angle,
to calculate the reproduction position on the basis of an intersection point between a straight line extending through the recording position of the source of sound in the camera coordinate system and through the common starting point and the reproduction surface, or
if no such intersection point exists, to calculate the reproduction position on the basis of an intersection point of the straight line with a projection sphere, the central point of which is the common starting point, and the radius of which depends on the width of the reproduction surface and the predetermined aperture angle, or
in the case of an aperture angle of the camera which deviates from the predetermined aperture angle,
to calculate the reproduction position on the basis of an intersection point between a straight line extending through the recording position and the source of sound in the camera coordinate system and a reference point, spaced away from the common starting point by a distance, and the reproduction surface, and on the basis of a shift by a difference in relation to the reproduction surface, the distance and the difference depending on the aperture angle of the camera, or
if no such intersection point exists, to calculate the reproduction position on the basis of an intersection point of the straight line with a projection sphere, the central point of which equals the common starting point, and on the basis of a shift by the difference.

6 more elements

A digital storage medium having stored thereon a computer program having a program code for performing a method for determining a reproduction position of a source of sound for audio-visual reproduction of a film scene from a plurality of individual pictures with regard to a reproduction surface having a predetermined width and a projection source having a projection reference point, the method comprising:

providing a recording position of the source of sound, a camera position during recording, and an aperture angle of the camera during recording;
transforming the recording position of the source of sound to a camera coordinate system, the origin of which is defined, in relation to a camera aperture, to obtain a recording position of the source of sound in the camera coordinate system;
calculating the reproduction position of the source of sound in relation to the projection reference point, the calculator being configured to use the projection reference point and the camera aperture as a common starting point, and the calculator being configured,
in the case of an aperture angle of the camera which equals a predetermined aperture angle,
to calculate the reproduction position on the basis of an intersection point between a straight line extending through the recording position of the source of sound in the camera coordinate system and through the common starting point and the reproduction surface, or
if no such intersection point exists, to calculate the reproduction position on the basis of an intersection point of the straight line with a projection sphere, the central point of which is the common starting point, and the radius of which depends on the width of the reproduction surface and the predetermined aperture angle, or
in the case of an aperture angle of the camera which deviates from the predetermined aperture angle,
to calculate the reproduction position on the basis of an intersection point between a straight line extending through the recording position and the source of sound in the camera coordinate system and a reference point, spaced away from the common starting point by a distance, and the reproduction surface, and on the basis of a shift by a difference in relation to the reproduction surface, the distance and the difference depending on the aperture angle of the camera, or
if no such intersection point exists, to calculate the reproduction position on the basis of an intersection point of the straight line with a projection sphere, the central point of which equals the common starting point, and on the basis of a shift by the difference,
when the program runs on a computer.

7 more elements

A device for reproducing, on a reproduction surface, a film scene having a plurality of individual pictures, comprising:

a provider configured for providing a reproduction position of a source of sound for audio-visual reproduction of a film scene from a plurality of individual pictures with regard to a reproduction surface having a predetermined width and a projection source having a projection reference point, the device including:
a provider configured for providing a recording position of the source of sound, a camera position during recording, and an aperture angle of the camera during recording;
a transformer configured for transforming the recording position of the source of sound to a camera coordinate system, the origin of which is defined, in relation to a camera aperture, to obtain a recording position of the source of sound in the camera coordinate system;
a calculator configured for calculating the reproduction position of the source of sound in relation to the projection reference point, the calculator being configured to use the projection reference point and the camera aperture as a common starting point, and the calculator being configured,
in the case of an aperture angle of the camera which equals a predetermined aperture angle,
to calculate the reproduction position on the basis of an intersection point between a straight line extending through the recording position of the source of sound in the camera coordinate system and through the common starting point and the reproduction surface, or
if no such intersection point exists, to calculate the reproduction position on the basis of an intersection point of the straight line with a projection sphere, the central point of which is the common starting point, and the radius of which depends on the width of the reproduction surface and the predetermined aperture angle, or
in the case of an aperture angle of the camera which deviates from the predetermined aperture angle,
to calculate the reproduction position on the basis of an intersection point between a straight line extending through the recording position and the source of sound in the camera coordinate system and a reference point, spaced away from the common starting point by a distance, and the reproduction surface, and on the basis of a shift by a difference in relation to the reproduction surface, the distance and the difference depending on the aperture angle of the camera, or
if no such intersection point exists, to calculate the reproduction position on the basis of an intersection point of the straight line with a projection sphere, the central point of which equals the common starting point, and on the basis of a shift by the difference,
a wave-field synthesis generator for generating control signals for one or several loudspeaker arrays to simulate a virtual reproduction position of the source of sound for a viewer positioned in an audience area.

8 more elements

Dependencies are inferred from the claim text.

Facts

Application: 11/058,511Filed 15 Feb 2005 · continuation
Priority: DE 103 05 82012 Feb 2003
Published: US 2005/0147257 A17 Jul 2005
Granted: 20 Oct 2009
Term ends: Not estimatedThe source records don’t support an estimate.

Classification5 codes

H04S 3/002
Systems employing more than two channels, e.g. quadraphonic: non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound…
H04N 5/2224
Studio circuitry; Studio devices; Studio equipment: related to virtual studio applications
H04S 2420/13
Techniques used stereophonic systems covered by H04S but not provided for in its groups: application of wave-field synthesis in stereophonic audio…
H04S
Stereophonic systems

Family

PCT/EP2004/000463Parent of this continuation · filed 21 Jan 2004
US 2005/0147257 A1Pre-grant publication · published 7 Jul 2005
US 7,606,372 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

patentgrep

Loading patent…

Abstract

a provider configured for providing a recording position of the source of sound, a camera position during recording, and an aperture angle of the camera during recording;
a transformer configured for transforming the recording position of the source of sound to a camera coordinate system, the origin of which is defined, in relation to a camera aperture, to obtain a recording position of the source of sound in the camera coordinate system;
a calculator configured for calculating the reproduction position of the source of sound in relation to the projection reference point, the calculator being configured to use the projection reference point and the camera aperture as a common starting point, and the calculator being configured,
in the case of an aperture angle of the camera which equals a predetermined aperture angle,
to calculate the reproduction position on the basis of an intersection point between a straight line extending through the recording position of the source of sound in the camera coordinate system and through the common starting point and the reproduction surface, or
if no such intersection point exists, to calculate the reproduction position on the basis of an intersection point of the straight line with a projection sphere, the central point of which is the common starting point, and the radius of which depends on the width of the reproduction surface and the predetermined aperture angle, or
in the case of an aperture angle of the camera which deviates from the predetermined aperture angle,
to calculate the reproduction position on the basis of an intersection point between a straight line extending through the recording position and the source of sound in the camera coordinate system and a reference point, spaced away from the common starting point by a distance, and the reproduction surface, and on the basis of a shift by a difference in relation to the reproduction surface, the distance and the difference depending on the aperture angle of the camera, or
if no such intersection point exists, to calculate the reproduction position on the basis of an intersection point of the straight line with a projection sphere, the central point of which equals the common starting point, and on the basis of a shift by the difference.

6 more elements

Facts

Application

11/058,511Filed 15 Feb 2005 · continuation

Priority

DE 103 05 82012 Feb 2003

Published

US 2005/0147257 A17 Jul 2005

Granted

20 Oct 2009

Term ends

Not estimatedThe source records don’t support an estimate.

Classification5 codes

H04S 3/002
Systems employing more than two channels, e.g. quadraphonic: non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound…
H04N 5/2224
Studio circuitry; Studio devices; Studio equipment: related to virtual studio applications
H04S 2420/13
Techniques used stereophonic systems covered by H04S but not provided for in its groups: application of wave-field synthesis in stereophonic audio…
H04S
Stereophonic systems