# US 2026/0073652 A1 · Virtual object manipulation with gestures in a messaging system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073652 A1
- Document ID: US20260073652A1
- Status: Published application
- Kind: A1
- Application number: 19/392,701
- Filed: 2025-11-18
- Published: 2026-03-12
- Earliest claimed: 2022-09-09
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Kyle Goodrich; Maxim Maximov Lazarov; Andrew James McPhee; Daniel Moreno
- Web page: https://patentgrep.com/patent/US20260073652A1

## CPC

- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2219/024: Multi-user, collaborative environment
- G06T 2219/2016: Rotation, translation, scaling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The subject technology detects a first gesture and a second gesture, each gesture corresponding to an open trigger finger gesture. The subject technology detects a third gesture and a fourth gesture, each gesture corresponding to a closed trigger finger gesture. The subject technology, selects a first virtual object in a first scene. The subject technology detects a first location and a first position of a first representation of a first finger from the third gesture and a second location and a second position of a second representation of a second finger from the fourth gesture. The subject technology detects a first change in the first location and the first position and a second change in the second location and the second position. The subject technology modifies a set of dimensions of the first virtual object to a different set of dimensions.

## Claims

### Claim 1

A method, comprising:
selecting a virtual object for manipulation based on hand gesture data;
expanding the virtual object to a larger size in response to first updated hand gesture data indicating closure of thumbs on each hand closer to index fingers;
rotating the virtual object in a particular direction in response to second updated hand gesture data indicating changed hand positions; and
performing additional size modification of the virtual object in response to third updated hand gesture data.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first updated hand gesture data includes data for both hands of a user such that multi-gesture movements involving both hands are recognized, and wherein expanding the virtual object comprises detecting closure of thumbs on both hands simultaneously.

### Claim 3 (depends on 1)

The method of claim 1, wherein rotating the virtual object includes:
determining a direction of rotation based on relative positions of the changed hand positions;
rotating the virtual object in a first direction when a first hand position is higher than a second hand position; and
rotating the virtual object in a second direction opposite to the first direction when the first hand position is lower than the second hand position.

### Claim 4 (depends on 1)

The method of claim 1, wherein performing additional size modification comprises:
detecting third updated hand gesture data indicating a reduction gesture; and
reducing the virtual object in overall size in response to the third updated hand gesture data.

### Claim 5 (depends on 1)

The method of claim 1, wherein the virtual object is utilized by an application for performing a set of operations based at least in part on location, position, and size of the virtual object after each modification.

### Claim 6 (depends on 1)

The method of claim 1, wherein an open trigger finger gesture includes a particular gesture including a thumb and an index finger indicating a firearm or shooting hand sign, and a closed trigger finger gesture includes the thumb and the index finger pointing in a same direction.

### Claim 7 (depends on 1)

The method of claim 1, wherein the method comprises a sequential workflow including:
a first phase comprising selecting and expanding the virtual object;
a second phase comprising rotating the expanded virtual object; and
a third phase comprising modifying size dimensions of the rotated virtual object.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
rendering the virtual object after each modification operation; and
providing the rendered virtual object for display within a scene comprising real world video frame data and virtual object data.

### Claim 9 (depends on 1)

The method of claim 1, wherein detecting closure of thumbs on each hand closer to index fingers comprises detecting a pinch gesture on each hand simultaneously.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
continuously detecting changes in hand location video frame data and hand position video frame data; and
generating updated hand gesture data in response to each detected change to enable real-time virtual object manipulation.

### Claim 11

A system comprising:
a processor; and
a memory including instructions that, when executed by the processor, cause the processor to perform operations comprising:
selecting a virtual object for manipulation based on hand gesture data;
expanding the virtual object to a larger size in response to first updated hand gesture data indicating closure of thumbs on each hand closer to index fingers;
rotating the virtual object in a particular direction in response to second updated hand gesture data indicating changed hand positions; and
performing additional size modification of the virtual object in response to third updated hand gesture data.

### Claim 12 (depends on 11)

The system of claim 11, wherein the first updated hand gesture data includes data for both hands of a user such that multi-gesture movements involving both hands are recognized, and wherein expanding the virtual object comprises detecting closure of thumbs on both hands simultaneously.

### Claim 13 (depends on 11)

The system of claim 11, wherein rotating the virtual object includes:
determining a direction of rotation based on relative positions of the changed hand positions;
rotating the virtual object in a first direction when a first hand position is higher than a second hand position; and
rotating the virtual object in a second direction opposite to the first direction when the first hand position is lower than the second hand position.

### Claim 14 (depends on 11)

The system of claim 11, wherein performing additional size modification comprises:
detecting third updated hand gesture data indicating a reduction gesture; and
reducing the virtual object in overall size in response to the third updated hand gesture data.

### Claim 15 (depends on 11)

The system of claim 11, wherein the virtual object is utilized by an application for performing a set of operations based at least in part on location, position, and size of the virtual object after each modification.

### Claim 16 (depends on 11)

The system of claim 11, wherein an open trigger finger gesture includes a particular gesture including a thumb and an index finger indicating a firearm or shooting hand sign, and a closed trigger finger gesture includes the thumb and the index finger pointing in a same direction.

### Claim 17 (depends on 11)

The system of claim 11, wherein the operations further comprise a sequential workflow including:
a first phase comprising selecting and expanding the virtual object;
a second phase comprising rotating the expanded virtual object; and
a third phase comprising modifying size dimensions of the rotated virtual object.

### Claim 18 (depends on 11)

The system of claim 11, wherein the operations further comprise:
rendering the virtual object after each modification operation; and
providing the rendered virtual object for display within a scene comprising real world video frame data and virtual object data.

### Claim 19 (depends on 11)

The system of claim 11, wherein detecting closure of thumbs on each hand closer to index fingers comprises detecting a pinch gesture on each hand simultaneously.

### Claim 20

A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to perform operations comprising:
selecting a virtual object for manipulation based on hand gesture data;
expanding the virtual object to a larger size in response to first updated hand gesture data indicating closure of thumbs on each hand closer to index fingers;
rotating the virtual object in a particular direction in response to second updated hand gesture data indicating changed hand positions; and
performing additional size modification of the virtual object in response to third updated hand gesture data.
