# US 12,112,098 B2 · Tool bridge

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,112,098 B2
- Document ID: US12112098B2
- Status: Granted
- Kind: B2
- Application number: 18/468,629
- Filed: 2023-09-15
- Published: 2024-01-04
- Granted: 2024-10-08
- Earliest claimed: 2020-02-14
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Richard St. Clair Bailey; Chun-Ip Fong; Erle Robert Bridgewater
- Web page: https://patentgrep.com/patent/US12112098B2

## CPC

- G06F 30/12: characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
- G02B 27/0172: {characterised by optical features}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 30/31: Design entry, e.g. editors specifically adapted for circuit design
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G02B 2027/0141: {characterised by the informative content of the display}
- G06F 2111/18: using virtual or augmented reality
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Disclosed herein are systems and methods for sharing and synchronizing virtual content. A method may include receiving, from a host application via a wearable device comprising a transmissive display, a first data package comprising first data; identifying virtual content based on the first data; presenting a view of the virtual content via the transmissive display; receiving, via the wearable device, first user input directed at the virtual content; generating second data based on the first data and the first user input; sending, to the host application via the wearable device, a second data package comprising the second data, wherein the host application is configured to execute via one or more processors of a computer system remote to the wearable device and in communication with the wearable device.

## Claims

### Claim 1

A wearable device comprising:
a transmissive display;
an input device; and
one or more processors configured to perform a method comprising:
receiving, from a host application via the wearable device, a first data package comprising first data;
identifying virtual content based on the first data;
presenting a view of the virtual content via the transmissive display;
receiving, via the input device, first user input directed at the virtual content;
generating second data based on the first data and the first user input; and
sending, to the host application via the wearable device, a second data package comprising the second data,
wherein:
said receiving the first data package from the host application comprises receiving the first data package from a host application executing via a remote computer system remote to the wearable device and in communication with the wearable device, said remote computer system comprising an asset library,
the virtual content comprises an asset,
said identifying the virtual content based on the first data comprises identifying the asset in the asset library of the remote computer system, and
said presenting the view of the virtual content comprises presenting a view of the asset identified in the asset library.

### Claim 2 (depends on 1)

The wearable device of claim 1, wherein the host application comprises a computer-aided drawing application.

### Claim 3 (depends on 1)

The wearable device of claim 1, wherein the method further comprises:
receiving second user input; and
modifying the view of the virtual content based on the second user input.

### Claim 4 (depends on 1)

The wearable device of claim 1, wherein:
the first data corresponds to a first state of the asset, and
the host application is configured to modify the first state of the asset based on the second data.

### Claim 5 (depends on 1)

The wearable device of claim 1, wherein:
the first data comprises data representing a change between a first state of the asset and an earlier state of the asset.

### Claim 6 (depends on 1)

The wearable device of claim 1, wherein said receiving the first data package from the host application comprises receiving the first data package via a first helper application configured to execute via the remote computer system.

### Claim 7 (depends on 1)

The wearable device of claim 1, wherein the asset comprises a 3D asset.

### Claim 8

A method comprising:
receiving, from a host application via a wearable device comprising a transmissive display, a first data package comprising first data;
identifying virtual content based on the first data;
presenting a view of the virtual content via the transmissive display;
receiving, via an input device of the wearable device, first user input directed at the virtual content;
generating second data based on the first data and the first user input; and
sending, to the host application via the wearable device, a second data package comprising the second data,
wherein:
said receiving the first data package from the host application comprises receiving the first data package from a host application executing via a remote computer system remote to the wearable device and in communication with the wearable device, said remote computer system comprising an asset library,
the virtual content comprises an asset,
said identifying the virtual content based on the first data comprises identifying the asset in the asset library of the remote computer system, and
said presenting the view of the virtual content comprises presenting a view of the asset identified in the asset library.

### Claim 9 (depends on 8)

The method of claim 8, wherein the host application comprises a computer-aided drawing application.

### Claim 10 (depends on 8)

The method of claim 8, further comprising:
receiving second user input; and
modifying the view of the virtual content based on the second user input.

### Claim 11 (depends on 8)

The method of claim 8, wherein:
the first data corresponds to a first state of the asset, and
the host application is configured to modify the first state of the asset based on the second data.

### Claim 12 (depends on 8)

The method of claim 8, wherein:
the first data comprises data representing a change between a first state of the asset and an earlier state of the asset.

### Claim 13 (depends on 8)

The method of claim 8, wherein said receiving the first data package from the host application comprises receiving the first data package via a first helper application configured to execute via the remote computer system.

### Claim 14 (depends on 8)

The method of claim 8, wherein the asset comprises a 3D asset.

### Claim 15

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a wearable device comprising a transmissive display, cause the one or more processors to perform a method comprising:
receiving, from a host application via a wearable device comprising a transmissive display, a first data package comprising first data;
identifying virtual content based on the first data;
presenting a view of the virtual content via the transmissive display;
receiving, via an input device of the wearable device, first user input directed at the virtual content;
generating second data based on the first data and the first user input; and
sending, to the host application via the wearable device, a second data package comprising the second data,
wherein:
said receiving the first data package from the host application comprises receiving the first data package from a host application executing via a remote computer system remote to the wearable device and in communication with the wearable device, said remote computer system comprising an asset library,
the virtual content comprises an asset,
said identifying the virtual content based on the first data comprises identifying the asset in the asset library of the remote computer system, and
said presenting the view of the virtual content comprises presenting a view of the asset identified in the asset library.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the method further comprises:
receiving second user input; and
modifying the view of the virtual content based on the second user input.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein:
the first data corresponds to a first state of the asset, and
the host application is configured to modify the first state of the asset based on the second data.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein:
the first data comprises data representing a change between a first state of the asset and an earlier state of the asset.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein said receiving the first data package from the host application comprises receiving the first data package via a first helper application configured to execute via the remote computer system.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the asset comprises a 3D asset.
