US 12,602,813 B2 · Deep aperture

Abstract

The techniques disclosed herein enable a realistic, inclusive sense of physical presence for videoconference participants that is comparable to in-person communication. Multiple users are simultaneously provided with an immersive experience without the need for head-mounted displays or other wearable technology. Specifically, a real-time three-dimensional model of a scene at the remote end of the videoconference is received. At the same time, the location and perspective of each local participant is determined. Each local participant is then individually provided with a spatially correct stereoscopic view of the model. The sense of physical presence is created by changing what each local participant sees in response to a change in their perspective. The sense of physical presence is enhanced by enabling direct eye contact, clear communication of emotional state and other non-verbal cues, and a shared visual experience and audio ambience across locations.

Claims20

Dependent claims

A method comprising:

receiving a three-dimensional model of a remote space;
determining a first perspective of a first local participant and a second perspective of a second local participant;
generating a first individualized view of the three-dimensional model from the first perspective and a second individualized view of the three-dimensional model from the second perspective;
simultaneously displaying the first and second individualized views on a display surface such that the first individualized view is observable by the first local participant and the second individualized view is observable by the second local participant;
determining that the first local participant and a remote participant are engaged in a closely-held conversation based on a determination that an apparent proximity of the first local participant and the remote participant is less than a defined threshold value, wherein the apparent proximity is based in part on the first perspective of the first local participant including a physical distance between the first local participant and the display surface;
and
limiting audio reproductions of the first local participant to the remote participant.

4 more elements

A computing device comprising:

one or more processors;
a memory in communication with the one or more processors, the memory having computer-readable instructions stored thereupon which, when executed by the one or more processors, cause the computing device to:
receive a three-dimensional model of a remote video conference room and a remote participant;
receive data indicating an emotional state of the remote participant;
determine a first perspective of a first local participant and a second perspective of a second local participant;
generate a first individualized view of the three-dimensional model from the first perspective and a second individualized view of the three-dimensional model from the second perspective, wherein a portion of the first individualized view that depicts the remote participant is augmented to emphasize the emotional state of the remote participant;
and
simultaneously display the first and second individualized views on a display surface such that the first individualized view is observable by the first local participant and the second individualized view is observable by the second local participant;
determine that the first local participant and a remote participant are engaged in a closely-held conversation based on a determination that an apparent proximity of the first local participant and the remote participant is less than a defined threshold value, wherein the apparent proximity is based in part on the first perspective of the first local participant including a physical distance between the first local participant and the display surface;
and
limit audio reproductions of the first local participant to the remote participant.

8 more elements

A computer-readable storage medium comprising instructions that, when executed by a processor, cause the processor to:

receive a three-dimensional model of a remote video conference room and a remote participant;
receive spatial audio data of a remote video conference room;
determine a first perspective of a first local participant and a second perspective of a second local participant;
generate a first individualized view of the three-dimensional model from the first perspective and a second individualized view of the three-dimensional model from the second perspective;
simultaneously display the first and second individualized views on a display surface such that the first individualized view is observable by the first local participant and the second individualized view is observable by the second local participant;
generate an audio stream directed to the first local participant that mimics what the first local participant would hear from the remote conference room if the remote conference room was adjacent to a local conference room;
determining that the first local participant and a remote participant are engaged in a closely-held conversation based on a determination that an apparent proximity of the first local participant and the remote participant is less than a defined threshold value, wherein the apparent proximity is based in part on the first perspective of the first local participant including a physical distance between the first local participant and the display surface;
and
limiting audio reproductions of the first local participant to the remote participant.

6 more elements

Dependencies are inferred from the claim text.

Deep aperture

Life of this patent

Deep aperture

Life of this patent

Abstract

Claims20