Method and apparatus for improved matching of auditory space to visual space in video teleconferencing applications using window-based displays

An apparatus for generating a spatial rendering of a real-time audio sound from a conference participant to a remote video teleconference participant in real-time, the apparatus comprising:

• a plurality of speakers;
• a real-time window-based video display screen having a given physical location of said conference participant, the window-based video display screen for displaying a real-time video to the video teleconference participant, the real-time audio sound being related to the video being displayed to said video teleconference participant;
• a video input signal receiver which receives one or more real-time video input signals of said conference participant for use in displaying said video to said remote video teleconference participant on said window-based video display screen, each of said received video input signals being displayed in a corresponding window on said video display screen;
• an audio input signal receiver which receives one or more real-time audio input signals related to said one or more video input signals, one of said received audio input signals including said audio sound;
• a processor which determines a desired physical location of said conference participant for spatially rendering said audio sound relative to said video display screen, the desired physical location being determined based on a position on the video display screen at which a particular one of said windows is being displayed, the particular one of said windows corresponding to the received video input signal related to the received audio input signal which includes said audio sound;
• and
• an audio output signal generator which generates a plurality of real-time audio output signals based on said determined desired physical location for spatially rendering said audio sound, said plurality of audio signals being generated such that when delivered to said remote video teleconference participant using said plurality of speakers, the remote video teleconference participant hears said audio sound as being rendered from said determined desired physical location for spatially rendering said audio sound.