# US 2025/0093962 A1 · Hand Gesture Tracking Techniques

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0093962 A1
- Document ID: US20250093962A1
- Status: Published application
- Kind: A1
- Application number: 18/885,732
- Filed: 2024-09-15
- Published: 2025-03-20
- Earliest claimed: 2023-09-14
- Assignees: Ultraleap Limited
- Applicants: Ultraleap Limited
- Inventors: Pip Timothy Holden Turner; Peter Nancollis; Rory James Clark
- Web page: https://patentgrep.com/patent/US20250093962A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Tendrils are a spatial, visually understandable way of understanding the relationship of how an object is constrained in 3D space to another object based on the distance between them, through tension. A tendril can be rendered as a string and can possess soft-body physic like dynamics. When close to breaking, the tension representation becomes key: the tendril may become straight when close to breaking, emphasized by the tendril becoming thinner, and completely disappearing when broken, along with a visual cue (e.g. a particle effect). But if returned back into the distance check soon after the check is broken, the tendril could be repaired. Further, Single-Handed Menus are a way to adapt existing hand menus to be used with just one hand, while keeping the benefits of a hand menu. Further, squish summon allows users to summon far away objects by aiming at them, “squishing” them into nothing (e.g. the scale animating down to zero) as they perform a pose (e.g. moving a hand into a “fist” pose), the object completely disappearing on pose completion, and then the object appearing near the user's hand, as the user's pose returns to idle. The object stays near the user's hand until the pose is weak enough, at which point it detaches from the user's hand, now in the user's direct interaction space.

## Claims

### Claim 1

A mid-air haptic feedback system comprising:
a phased array of ultrasonic transducers used to exert an acoustic radiation force on a target by defining at least one control point in a space within which an acoustic field exists;
wherein the ultrasonic transducers are controlled to create the acoustic field to exhibit desired amplitude at each of the at least one control point;
a visual representation of a connection between an object and a distance check of the object through a tendril;
wherein the visual representation of the tendril is slack when the object is not close to leaving the distance check of the object;
wherein the visual representation of the tendril is taut when the object is close to leaving the distance check of the object; and
wherein the visual representation of the tendril is deleted when the object leaves the distance check of the object.

### Claim 2 (depends on 1)

The system as in claim 1, wherein the object is a real object.

### Claim 3 (depends on 1)

The system as in claim 1, wherein the object is a virtual object.

### Claim 4 (depends on 1)

The system as in claim 1, wherein the close to leaving the distance check of the object occurs when the object is within 5% of a radius of the distance check.

### Claim 5 (depends on 1)

The system as in claim 1, wherein the visual representation of the tendril when the tendril is deleted further comprises a haptic effect.

### Claim 6 (depends on 1)

The system as in claim 1, wherein the visual representation of the tendril when the tendril is deleted further comprises a sound effect.

### Claim 7 (depends on 1)

The system as in claim 1, wherein the tendril represents an average of least two of the objects.

### Claim 8 (depends on 1)

The system as in claim 1, wherein the tendril becomes semitransparent when slack.

### Claim 9 (depends on 1)

The system as in claim 1, wherein a sensation begins when the tendril is taut and becomes an increased sensation when the tendril is deleted.

### Claim 10 (depends on 1)

The system as in claim 1, wherein when the tendril is taut, the tendril is reduced in thickness.

### Claim 11

A mid-air haptic feedback system comprising:
a phased array of ultrasonic transducers used to exert an acoustic radiation force on a target by defining at least one control point in a space within which an acoustic field exists;
wherein the ultrasonic transducers are controlled to create the acoustic field to exhibit desired amplitude at each of the at least one control point;
a camera for tracking one hand of a user;
a visual representation of a menu that can be used by the one hand of the user, wherein the visual representation has an attached to hand mode and a detached from hand mode.

### Claim 12 (depends on 11)

The system as in claim 11, wherein the attached to hand mode comprises a hidden menu stage and a shown menu stage, wherein the hidden menu stage is activated when the one hand of the user does not face the camera, and wherein the shown menu stage is activated when the one hand of the user faces the camera.

### Claim 13 (depends on 12)

The system as in claim 12, further comprising a locked world space stage that is activated when the one hand of the user makes a fist pose.

### Claim 14 (depends on 11)

The system as in claim 11, wherein the detached from hand mode comprises a hidden menu stage, a shown menu stage, and a following user stage, wherein the hidden menu stage is activated when the one hand of the user stops moving or when the user taps a grab ball associated with the menu, wherein the shown menu stage is activated when the one hand of the user pulls away from the menu, and wherein the following user stage is activated when the user moves away from the menu.

### Claim 15 (depends on 14)

The system as in claim 14, further comprising a reattachable stage that is activated when the one hand of the user makes a fist pose.

### Claim 16

A mid-air haptic feedback system comprising:
a phased array of ultrasonic transducers used to exert an acoustic radiation force on a target by defining at least one control point in a space within which an acoustic field exists;
wherein the ultrasonic transducers are controlled to create the acoustic field to exhibit desired amplitude at each of the at least one control point;
a camera for tracking one hand of a user;
a visual representation of an object that is locked upon a squishing move by the one hand of the user.

### Claim 17 (depends on 16)

The system as in claim 16, wherein a virtual black hole appears at the object's position.

### Claim 18 (depends on 16)

The system as in claim 16, wherein opacity of the object is reduced during the squishing move.

### Claim 19 (depends on 16)

The system as in claim 16, further comprising:
the visual representation of the object is unlocked upon an unsquishing move by the one hand of the user.

### Claim 20 (depends on 19)

The system as in claim 19, further comprising a first haptic effect upon the squishing move and a second haptic effect upon the unsquishing move.
