Three-dimensional sound creation assisted by visual information
AssigneeKoninklijke Philips Electronics N.V.
InventorsYun-Ting Lin, Yong Yan
Life of this patent
Estimating the term…
Abstract
A sound imaging system and method for generating multi-channel audio data from an audio/video signal having an audio component and a video component. The system comprises: a system for associating sound sources within the audio component to video objects within the video component of the audio/video signal; a system for determining position information of each sound source based on a position of the associated video object in the video component; and a system for assigning sound sources to audio channels based on the position information of each sound source.
Claims27
A sound imaging system for generating a three-dimensional sound image from an audio/video signal having an audio component and a video component, the system comprising:
- a system for associating sound sources within the audio component to video objects within the video component of the audio/video signal;
- a system for determining position information of each sound source based on a position of the associated video object in the video component;
- and
- a system for assigning sound sources to audio channels based on the position information of each sound source.
A program product stored on a recordable medium, which when executed generates multi-channel audio data from an audio/video signal having an audio component and a video component, the program product comprising:
- program code configured to associate sound sources within the audio component to video objects within the video component of the audio/video signal;
- program code configured to determine position information of each sound source based on a position of the associated video object in the video component;
- and
- program code configured to assign sound sources to audio channels based on the position information of each sound source.
A decoder having a sound imaging system for generating multi-channel audio data from an audio/video signal having an audio component and a video component, the decoder comprising:
- a system for extracting sound sources from the audio component;
- a system for extracting video objects from the video component;
- a system for matching extracted sound sources to extracted video objects;
- a system for determining position information of each sound source based on a position of the matched video object in the video component;
- and
- a system for assigning sound sources to audio channels based on the position information of each sound source.
A method of generating multi-channel audio data from an audio/video signal having an audio component and a video component, the method comprising the steps of:
- associating sound sources within the audio component to video objects within the video component of the audio/video signal;
- determining position information of each sound source based on a position of the associated video object in the video component;
- and
- assigning sound sources to audio channels based on the position information of each sound source.
Dependencies are inferred from the claim text.