# US 2026/0175079 A1 · Virtual evaluation tools for augmented reality exercise experiences

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0175079 A1
- Document ID: US20260175079A1
- Status: Published application
- Kind: A1
- Application number: 19/539,264
- Filed: 2026-02-13
- Published: 2026-06-25
- Earliest claimed: 2022-01-26
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Ilteris Canberk; Ivan Fekete; Shin Hwun Kang; Dmytro Kucher; Ihor Kuzin; Vernon James Carlos Manlapaz; Artur Sydoran
- Web page: https://patentgrep.com/patent/US20260175079A1

## CPC

- A63B 24/0003: {Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis}
- G02B 27/017: {Head mounted}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- A63B 71/0622: {Visual, audio or audio-visual systems for entertaining, instructing or motivating the user}
- A63B 2071/0625: {Emitting sound, noise or music}
- A63B 2071/0666: {worn on the head or face, e.g. combined with goggles or glasses}
- A63B 2244/102: Boxing
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/03547: {Touch pads, in which fingers can move on a surface}
- A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Example systems, devices, media, and methods are described for evaluating movements and physical exercises in augmented reality using the display of an eyewear device. A motion evaluation application implements and controls the capturing of frames of motion data using an inertial measurement unit (IMU) on the eyewear device. The method includes presenting virtual targets on the display, localizing the current eyewear device location based on the captured motion data, and presenting virtual indicators on the display. The virtual targets represent goals or benchmarks for the user to achieve using body postures. The method includes detecting determining whether the eyewear device location represents an intersecting posture relative to the virtual targets, based on the IMU data. The virtual indicators display real-time feedback about user posture or performance relative to the virtual targets.

## Claims

### Claim 1

A method, comprising:
capturing frames of video data using a camera coupled to an eyewear device, wherein the eyewear device comprises a display;
presenting on the display a virtual target at a target position, wherein the virtual target is presented as an overlay relative to a physical environment, and wherein the virtual target is associated with a proximity relative to the target position;
determining an eyewear device location relative to the target position based on the frames of video data;
detecting a hand shape at a hand position based on the frames of video data;
presenting on the display a virtual indicator based on the hand shape, wherein the virtual indicator is presented as an overlay relative to the hand shape;
detecting an intersecting posture based on the eyewear device location and the hand position relative to the proximity; and
in response to detecting the intersecting posture, presenting on the display an animation associated with the virtual target.

### Claim 2 (depends on 1)

The method of claim 1, wherein presenting the animation comprises:
presenting the virtual indicator at the target position and as an overlay relative to the virtual target.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
setting the proximity associated with the virtual target, wherein the proximity comprises a configurable distance relative to a limit.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
capturing frames of motion data using an inertial measurement unit coupled to the eyewear device; and
determining the eyewear device location based on the frames of motion data.

### Claim 5 (depends on 1)

The method of claim 1, wherein the hand shape comprises at least one of a relaxed position or an extended position, and wherein presenting the virtual indicator comprises:
presenting a neutral glove associated with the relaxed position; and
presenting an active glove associated with the extended position.

### Claim 6 (depends on 5)

The method of claim 5, wherein presenting the animation comprises one or more of:
presenting a visible change in the virtual target, presenting the active glove in an apparent contact with the virtual target, presenting the virtual target in motion in response to the apparent contact, playing a sound through a loudspeaker, and generating a tactile vibration of the eyewear device.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
presenting a current count on the display at an information position relative to the display; and
incrementing the current count by one in response to detecting the intersecting posture.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
capturing frames of motion data using an inertial measurement unit coupled to the eyewear device;
detecting a repetitive motion of the eyewear device relative to the physical environment based on the frames of motion data; and
presenting the virtual target in response to detecting the repetitive motion.

### Claim 9

A system comprising:
an eyewear device comprising a processor, a memory, a camera, and a display;
programming in the memory, wherein execution of the programming by the processor configures the eyewear device to perform functions, including functions to:
capture frames of video data using the camera;
present on the display a virtual target at a target position, wherein the virtual target is presented as an overlay relative to a physical environment, and wherein the virtual target is associated with a proximity relative to the target position;
determine an eyewear device location relative to the target position based on the frames of video data;
detect a hand shape at a hand position based on the frames of video data;
present on the display a virtual indicator based on the hand shape, wherein the virtual indicator is presented as an overlay relative to the hand shape;
detect an intersecting posture based on the eyewear device location and the hand position relative to the proximity; and
present on the display an animation associated with the virtual target.

### Claim 10 (depends on 9)

The system of claim 9, wherein execution of the programming configures the eyewear device to perform further functions, including further functions to:
set the proximity associated with the virtual target, wherein the proximity comprises a configurable distance relative to a limit.

### Claim 11 (depends on 9)

The system of claim 9, wherein execution of the programming configures the eyewear device to perform further functions, including further functions to:
capture frames of motion data using an inertial measurement unit coupled to the eyewear device; and
determine the eyewear device location based on the frames of motion data.

### Claim 12 (depends on 9)

The system of claim 9, wherein the hand shape comprises at least one of a relaxed position or an extended position, wherein the function to present the virtual indicator comprises functions to:
present a neutral glove associated with the relaxed position; and
present an active glove associated with the extended position.

### Claim 13 (depends on 9)

The system of claim 9, wherein execution of the programming configures the eyewear device to perform further functions, including further functions to:
present a current count on the display at an information position relative to the display; and
increment the current count by one in response to detecting the intersecting posture.

### Claim 14 (depends on 9)

The system of claim 9, wherein execution of the programming configures the eyewear device to perform further functions, including further functions to:
capture frames of motion data using an inertial measurement unit coupled to the eyewear device;
detect a repetitive motion of the eyewear device relative to the physical environment based on the frames of motion data; and
present the virtual target in response to detecting the repetitive motion.

### Claim 15

A non-transitory computer-readable medium storing program code which, when executed, is operative to cause an electronic processor to perform the steps of:
capturing frames of video data using a camera coupled to an eyewear device, wherein the eyewear device comprises a display;
presenting on the display a virtual target at a target position, wherein the virtual target is presented as an overlay relative to a physical environment, and wherein the virtual target is associated with a proximity relative to the target position;
determining an eyewear device location relative to the target position based on the frames of video data;
detecting a hand shape at a hand position based on the frames of video data;
presenting on the display a virtual indicator based on the hand shape, wherein the virtual indicator is presented as an overlay relative to the hand shape;
detecting an intersecting posture based on the eyewear device location and the hand position relative to the proximity; and
in response to detecting the intersecting posture, presenting on the display an animation associated with the virtual target.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the program code when executed is operative to cause the electronic processor to perform the further steps of:
setting the proximity associated with the virtual target, wherein the proximity comprises a configurable distance relative to a limit.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the program code when executed is operative to cause the electronic processor to perform the further steps of:
capturing frames of motion data using an inertial measurement unit coupled to the eyewear device; and
determining the eyewear device location based on the frames of motion data.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the hand shape comprises at least one of a relaxed position or an extended position, and wherein the program code when executed is operative to cause the electronic processor to perform the further steps of:
presenting a neutral glove associated with the relaxed position; and
presenting an active glove associated with the extended position.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the program code when executed is operative to cause the electronic processor to perform the further steps of:
presenting a current count on the display at an information position relative to the display; and
incrementing the current count by one in response to detecting the intersecting posture.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the program code when executed is operative to cause the electronic processor to perform the further steps of:
capturing frames of motion data using an inertial measurement unit coupled to the eyewear device;
detecting a repetitive motion of the eyewear device relative to the physical environment based on the frames of motion data; and
presenting the virtual target in response to detecting the repetitive motion.
