Dynamic resolution of depth conflicts in telepresence
AssigneeGoogle Inc.
InventorsEric Baczuk, Daniel Edmond Fish
Life of this patent
Estimating the term…
Abstract
Systems and methods are described for determining a capture volume associated with image content captured by at least one camera, determining depths associated with the image content, defining a viewing range in which stereoscopic effects are depicted when viewing the image content, determining a depth conflict between the image content and a boundary associated with the viewing range, the determining including detecting that at least one portion of the image content extends beyond the boundary associated with the viewing range and resolving the depth conflict for the at least one portion using the viewing range and at least one user interface element and generating, for rendering, modified image content with the resolved depth conflict.
Claims17
A method, comprising:
- determining a capture volume and depths associated with image content captured by at least one camera;
- defining, within the capture volume and based on the depths, a viewing range in which stereoscopic effects are depicted when viewing the image content;
- determining a depth conflict between the image content and a boundary associated with the viewing range, the determining including detecting that at least one portion of the image content extends beyond the boundary associated with the viewing range, the depth conflict being determined based on a tracked head position of a user viewing the image content;
- resolving the depth conflict for the at least one portion using the viewing range and at least one user interface element;
- and
- generating, for rendering, modified image content with the resolved depth conflict, the modified image content including portions of the image content replaced by the at least one user interface element, the resolving includes animating the at least one user interface element to hide the at least one portion of the image content with the modified image content.
A system comprising:
- at least one processing device;
- a plurality of stereo cameras;
- and
- a memory storing instructions that when executed cause the system to perform operations including:
- determining a volume and depths associated with image content captured by the plurality of stereo cameras;
- defining, within the volume and based on the depths, a viewing range in which stereoscopic effects occur;
- determining a depth conflict between the image content and a boundary associated with the viewing range and with at least one edge of a lenticular display device, the determining including detecting that at least one portion of the image content extends beyond the boundary associated with the viewing range, the depth conflict being determined based on a tracked head position of a user viewing the image content at a remote lenticular display device;
- resolving the depth conflict for the at least one portion using the viewing range and adjusting a size of at least one user interface element based on the tracked head position of the user;
- and
- generating, for rendering, modified image content with the resolved depth conflict, the modified image content including portions of the image content replaced by the at least one user interface element.
A non-transitory, machine-readable medium having instructions stored thereon, the instructions, when executed by a processor, cause a computing device to perform operations including:
- while capturing video content with a plurality of stereo cameras:
- determining a capture volume and depths associated with captured video content;
- defining, within the capture volume and based on the depths, a viewing range in which stereoscopic effects occur;
- determining a depth conflict between the captured video content and a boundary associated with the viewing range, the determining including detecting that at least one portion of the captured video content has a distance from the boundary and extends beyond the boundary associated with the viewing range, the depth conflict being determined based on a tracked head position of a user viewing the captured video content, the determining the depth conflict includes using at least some of the depths associated with the video content to generate a plurality of three-dimensional voxels representing a position in a plane of a display rendering the video content;
- resolving the depth conflict for the at least one portion using the viewing range and at least one user interface element selected based on the distance;
- and
- generating, for rendering, modified video content with the resolved depth conflict, the modified video content including portions of the video content replaced by the at least one user interface element.
Dependencies are inferred from the claim text.