# US 2026/0073626 A1 · Natural hand rendering in xr systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073626 A1
- Document ID: US20260073626A1
- Status: Published application
- Kind: A1
- Application number: 19/387,557
- Filed: 2025-11-12
- Published: 2026-03-12
- Earliest claimed: 2023-01-06
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Mason Spong
- Web page: https://patentgrep.com/patent/US20260073626A1

## CPC

- G06T 15/30: Clipping
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/593: from stereo images
- G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An extended Reality (XR) system provides methodologies for clipping a virtual object displayed to a user. The XR system provides an XR user interface that includes a virtual object. The XR system captures tracking video frame data of a hand of the user and generates a clipping mask based on the tracking video frame data. The XR system generates a clipped virtual object by applying the clipping mask to the virtual object and displays the clipped virtual object in the XR user interface.

## Claims

### Claim 1

A method comprising:
providing an extended Reality (XR) user interface comprising a 3D virtual object displayed to a user;
capturing video frame data of a real-world object;
generating 3D model data of the real-world object based on the video frame data;
determining an object distance based on the 3D model of the real-world object;
determining a near clipping plane based on the object distance;
defining a first surface of an irregular frustum using an intersection of the near clipping plane with the 3D model of the real-world object;
performing a projection of the first surface of the irregular frustum to a far clipping plane to define a second surface of the irregular frustum;
generating a 3D clipping volume using the irregular frustum;
clipping the 3D virtual object using the 3D clipping volume; and
providing a display of the clipped virtual object in the XR user interface.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining the object distance comprises determining the object distance based on binocular data of the video frame data.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining the object distance comprises determining the object distance based on monocular video frame data and an assumed size of the real-world object.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining the near clipping plane comprises:
determining the object distance based on a depth detection using Light Detection and Radar (LiDAR); and
determining the near clipping plane based on the object distance.

### Claim 5 (depends on 1)

The method of claim 1, wherein generating the 3D model data of the real-world object comprises using computer vision and geometric methodologies.

### Claim 6 (depends on 1)

The method of claim 1, wherein the clipped virtual object is displayed with a clipped portion that follows a contour of the real-world objects or real-world surfaces.

### Claim 7 (depends on 1)

The method of claim 1, wherein the XR system comprises a head-wearable apparatus.

### Claim 8

A machine comprising:
at least one processor; and
at least one memory storing instructions that, when executed by the at least one processor, cause the machine to perform operations comprising:
providing an extended Reality (XR) user interface comprising a 3D virtual object displayed to a user;
capturing video frame data of a real-world object;
generating 3D model data of the real-world object based on the video frame data;
determining an object distance based on the 3D model of the real-world object;
determining a near clipping plane based on the object distance;
defining a first surface of an irregular frustum using an intersection of the near clipping plane with the 3D model of the real-world object;
performing a projection of the first surface of the irregular frustum to a far clipping plane to define a second surface of the irregular frustum;
generating a 3D clipping volume using the irregular frustum;
clipping the 3D virtual object using the 3D clipping volume; and
providing a display of the clipped virtual object in the XR user interface.

### Claim 9 (depends on 8)

The machine of claim 8, wherein determining the object distance comprises determining the object distance based on binocular data of the video frame data.

### Claim 10 (depends on 8)

The machine of claim 8, wherein determining the object distance comprises determining the object distance based on monocular video frame data and an assumed size of the real-world object.

### Claim 11 (depends on 8)

The machine of claim 8, wherein determining the near clipping plane comprises:
determining the object distance based on a depth detection using Light Detection and Radar (LiDAR); and
determining the near clipping plane based on the object distance.

### Claim 12 (depends on 8)

The machine of claim 8, wherein generating the 3D model data of the real-world object comprises using computer vision and geometric methodologies.

### Claim 13 (depends on 8)

The machine of claim 8, wherein the clipped virtual object is displayed with a clipped portion that follows a contour of the real-world objects or real-world surfaces.

### Claim 14 (depends on 8)

The machine of claim 8, wherein the XR system comprises a head-wearable apparatus.

### Claim 15

A machine-storage medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:
providing an extended Reality (XR) user interface comprising a 3D virtual object displayed to a user;
capturing video frame data of a real-world object;
generating 3D model data of the real-world object based on the video frame data;
determining an object distance based on the 3D model of the real-world object;
determining a near clipping plane based on the object distance;
defining a first surface of an irregular frustum using an intersection of the near clipping plane with the 3D model of the real-world object;
performing a projection of the first surface of the irregular frustum to a far clipping plane to define a second surface of the irregular frustum;
generating a 3D clipping volume using the irregular frustum;
clipping the 3D virtual object using the 3D clipping volume; and
providing a display of the clipped virtual object in the XR user interface.

### Claim 16 (depends on 15)

The machine-storage medium of claim 15, wherein determining the object distance comprises determining the object distance based on binocular data of the video frame data.

### Claim 17 (depends on 15)

The machine-storage medium of claim 15, wherein determining the object distance comprises determining the object distance based on monocular video frame data and an assumed size of the real-world object.

### Claim 18 (depends on 15)

The machine-storage medium of claim 15, wherein determining the near clipping plane comprises:
determining the object distance based on a depth detection using Light Detection and Radar (LiDAR); and
determining the near clipping plane based on the object distance.

### Claim 19 (depends on 15)

The machine-storage medium of claim 15, wherein generating the 3D model data of the real-world object comprises using computer vision and geometric methodologies.

### Claim 20 (depends on 15)

The machine-storage medium of claim 15, wherein the clipped virtual object is displayed with a clipped portion that follows a contour of the real-world objects or real-world surfaces.
