# US 2026/0073654 A1 · Systems and methods of guided instructions or support using a virtual object

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073654 A1
- Document ID: US20260073654A1
- Status: Published application
- Kind: A1
- Application number: 19/395,480
- Filed: 2025-11-20
- Published: 2026-03-12
- Earliest claimed: 2022-01-28
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Joshua CHOI; Omar R. KHAN
- Web page: https://patentgrep.com/patent/US20260073654A1

## CPC

- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06Q 30/015: Providing customer assistance, e.g. assisting a customer within a business location or via helpdesk
- G06T 13/20: Three-dimensional [3D] animation
- G06T 2215/16: Using real world measurements to influence rendering
- G06T 2219/004: Annotating, labelling
- G06T 2219/2016: Rotation, translation, scaling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Disclosed herein is a method for providing guided instructions or support using a virtual object. The method comprises at a first computing device in communication with one or more input devices and a second computing device, capturing, using the one or more input devices, one or more images, determining an identity of an object using the one or more images, and transmitting the identity of the object to the second computing device. The method further comprises receiving from the second computing device an indication of a first input received at the second computing device and presenting a first view of the object comprising a first annotation that corresponds to the first input received at the second computing device.

## Claims

### Claim 1

A method, comprising:
at a first computing device in communication with one or more input devices and a second computing device:
receiving, from the second computing device, an identity of an object;
presenting a first view of the object including a first virtual representation of the object;
detecting an indication of a first input, using the one or more input devices, the first input comprising an interaction with the first virtual representation of the object; and
transmitting, to the second computing device, an indication of the first input or a first annotation that corresponds to the first input.

### Claim 2 (depends on 1)

The method of claim 1, wherein presenting the first view further includes presenting the first annotation that corresponds to the first input.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving, from the second computing device, a first state of the object;
wherein presenting the first view of the object includes the first virtual representation of the object in the first state.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving, from the second computing device, a second state of the object, the second state corresponding to a modification of the object detected by the second computing device corresponding to the first annotation; and
presenting a second view of the object including the first virtual representation of the object in the second state and ceasing presentation of the first annotation.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first annotation comprises an animation on or corresponding to the first virtual representation of the object.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
presenting a second view of the object including a second virtual representation of the object concurrently with the first view of the object.

### Claim 7 (depends on 6)

The method of claim 6, wherein:
the first view of the object comprises the first annotation and the second view of the object comprises the first annotation;
the first view of the object comprises the first annotation and the second view of the object comprises a second annotation;
the first view of the object comprises a first animation and the second view of the object comprises the first animation; or
the first view of the object comprises a first animation and the second view of the object comprises a second animation.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first input comprises a gesture input at a respective location corresponding to the first virtual representation of the object, and the first annotation corresponds to the gesture input and the respective location corresponding to a first view of the object presented at the second computing device.

### Claim 9

A first computing device, comprising:
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving, from a second computing device, an identity of an object;
presenting a first view of the object including a first virtual representation of the object;
detecting an indication of a first input, using one or more input devices, the first input comprising an interaction with the first virtual representation of the object; and
transmitting, to the second computing device, an indication of the first input or a first annotation that corresponds to the first input.

### Claim 10 (depends on 9)

The first computing device of claim 9, wherein presenting the first view further includes presenting the first annotation that corresponds to the first input.

### Claim 11 (depends on 9)

The first computing device of claim 9, the one or more programs including instructions for:
receiving, from the second computing device, a first state of the object;
wherein presenting the first view of the object includes the first virtual representation of the object in the first state.

### Claim 12 (depends on 9)

The first computing device of claim 9, the one or more programs including instructions for:
receiving, from the second computing device, a second state of the object, the second state corresponding to a modification of the object detected by the second computing device corresponding to the first annotation; and
presenting a second view of the object including the first virtual representation of the object in the second state and ceasing presentation of the first annotation.

### Claim 13 (depends on 9)

The first computing device of claim 9, wherein the first annotation comprises an animation on or corresponding to the first virtual representation of the object.

### Claim 14 (depends on 9)

The first computing device of claim 9, the one or more programs including instructions for:
presenting a second view of the object including a second virtual representation of the object concurrently with the first view of the object.

### Claim 15 (depends on 14)

The first computing device of claim 14, wherein:
the first view of the object comprises the first annotation and the second view of the object comprises the first annotation;
the first view of the object comprises the first annotation and the second view of the object comprises a second annotation;
the first view of the object comprises a first animation and the second view of the object comprises the first animation; or
the first view of the object comprises a first animation and the second view of the object comprises a second animation.

### Claim 16 (depends on 9)

The first computing device of claim 9, wherein the first input comprises a gesture input at a respective location corresponding to the first virtual representation of the object, and the first annotation corresponds to the gesture input and the respective location corresponding to a first view of the object presented at the second computing device.

### Claim 17

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a first computing device in communication with one or more input devices and a second computing device, cause the first computing device to:
receive, from the second computing device, an identity of an object;
present a first view of the object including a first virtual representation of the object;
detect an indication of a first input, using the one or more input devices, the first input comprising an interaction with the first virtual representation of the object; and
transmit, to the second computing device, an indication of the first input or a first annotation that corresponds to the first input.

### Claim 18 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein presenting the first view further includes presenting the first annotation that corresponds to the first input.

### Claim 19 (depends on 17)

The non-transitory computer readable storage medium of claim 17, the one or more programs further comprising instructions which cause the first computing device to:
receive, from the second computing device, a first state of the object;
wherein presenting the first view of the object includes the first virtual representation of the object in the first state.

### Claim 20 (depends on 17)

The non-transitory computer readable storage medium of claim 17, the one or more programs further comprising instructions which cause the first computing device to:
receive, from the second computing device, a second state of the object, the second state corresponding to a modification of the object detected by the second computing device corresponding to the first annotation; and
present a second view of the object including the first virtual representation of the object in the second state and ceasing presentation of the first annotation.

### Claim 21 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein the first annotation comprises an animation on or corresponding to the first virtual representation of the object.

### Claim 22 (depends on 17)

The non-transitory computer readable storage medium of claim 17, the one or more programs further comprising instructions which cause the first computing device to:
present a second view of the object including a second virtual representation of the object concurrently with the first view of the object.

### Claim 23 (depends on 22)

The non-transitory computer readable storage medium of claim 22, wherein:
the first view of the object comprises the first annotation and the second view of the object comprises the first annotation;
the first view of the object comprises the first annotation and the second view of the object comprises a second annotation;
the first view of the object comprises a first animation and the second view of the object comprises the first animation; or
the first view of the object comprises a first animation and the second view of the object comprises a second animation.

### Claim 24 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein the first input comprises a gesture input at a respective location corresponding to the first virtual representation of the object, and the first annotation corresponds to the gesture input and the respective location corresponding to a first view of the object presented at the second computing device.
