Natural hand rendering in xr systems
AssigneeSnap Inc.
InventorMason Spong
Life of this patent
Estimating the term…
Abstract
An extended Reality (XR) system provides methodologies for clipping a virtual object displayed to a user. The XR system provides an XR user interface that includes a virtual object. The XR system captures tracking video frame data of a hand of the user and generates a clipping mask based on the tracking video frame data. The XR system generates a clipped virtual object by applying the clipping mask to the virtual object and displays the clipped virtual object in the XR user interface.
Claims20
A method comprising:
- providing an extended Reality (XR) user interface comprising a 3D virtual object displayed to a user;
- capturing video frame data of a real-world object;
- generating 3D model data of the real-world object based on the video frame data;
- determining an object distance based on the 3D model of the real-world object;
- determining a near clipping plane based on the object distance;
- defining a first surface of an irregular frustum using an intersection of the near clipping plane with the 3D model of the real-world object;
- performing a projection of the first surface of the irregular frustum to a far clipping plane to define a second surface of the irregular frustum;
- generating a 3D clipping volume using the irregular frustum;
- clipping the 3D virtual object using the 3D clipping volume;
- and
- providing a display of the clipped virtual object in the XR user interface.
A machine comprising:
- at least one processor;
- and
- at least one memory storing instructions that, when executed by the at least one processor, cause the machine to perform operations comprising:
- providing an extended Reality (XR) user interface comprising a 3D virtual object displayed to a user;
- capturing video frame data of a real-world object;
- generating 3D model data of the real-world object based on the video frame data;
- determining an object distance based on the 3D model of the real-world object;
- determining a near clipping plane based on the object distance;
- defining a first surface of an irregular frustum using an intersection of the near clipping plane with the 3D model of the real-world object;
- performing a projection of the first surface of the irregular frustum to a far clipping plane to define a second surface of the irregular frustum;
- generating a 3D clipping volume using the irregular frustum;
- clipping the 3D virtual object using the 3D clipping volume;
- and
- providing a display of the clipped virtual object in the XR user interface.
A machine-storage medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:
- providing an extended Reality (XR) user interface comprising a 3D virtual object displayed to a user;
- capturing video frame data of a real-world object;
- generating 3D model data of the real-world object based on the video frame data;
- determining an object distance based on the 3D model of the real-world object;
- determining a near clipping plane based on the object distance;
- defining a first surface of an irregular frustum using an intersection of the near clipping plane with the 3D model of the real-world object;
- performing a projection of the first surface of the irregular frustum to a far clipping plane to define a second surface of the irregular frustum;
- generating a 3D clipping volume using the irregular frustum;
- clipping the 3D virtual object using the 3D clipping volume;
- and
- providing a display of the clipped virtual object in the XR user interface.
Dependencies are inferred from the claim text.