# US 2015/0091780 A1 · Wearable Electronic Device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0091780 A1
- Document ID: US20150091780A1
- Status: Published application
- Kind: A1
- Application number: 14/044,091
- Filed: 2013-10-02
- Published: 2015-04-02
- Earliest claimed: 2013-10-02
- Inventors: Philip Scott Lyren
- Web page: https://patentgrep.com/patent/US20150091780A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/017: {Head mounted}
- G02B 27/0172: {characterised by optical features}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/012: {Head tracking input arrangements}
- G06F 40/51: Translation evaluation
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method detects a real object with a wearable electronic device and displays a virtual image of the real object with the real object on a display of the wearable electronic device. The wearable electronic device displays movement of the virtual image of the real object to show a task to be completed and detects a completion of the task.

## Claims

### Claim 1

A method, comprising:
detecting, with wearable electronic glasses, a real object that is seen through a lens of the wearable electronic glasses;
displaying, on a display of the wearable electronic glasses, a virtual image of the real object next to the real object;
displaying, on the display of the wearable electronic glasses and while the virtual image of the real object is next to the real object, movement of the virtual image of the real object to show a task to be completed on the real object; and
detecting, with the wearable electronic glasses and while the virtual image of the real object is next to the real object, completion of the task on the real object such that the movement of the real object emulates the movement of the virtual image of the real object.

### Claim 2 (depends on 1)

The method of claim 1 further comprising:
maintaining a consistent distance between the real object and the virtual image of the real object being displayed on the display while the wearable electronic glasses move and change a location of where the real object exists in a field of view of the wearable electronic glasses.

### Claim 3 (depends on 1)

The method of claim 1 further comprising:
switching the virtual image of the real object from being located on one side of the real object to being located on an opposite side of the real object when the wearable electronic glasses move to have a field of view that obstructs a view of the virtual image of the real object on the one side.

### Claim 4 (depends on 1)

The method of claim 1 further comprising:
translating text in a first language that is located on a surface of the real object from the first language to a second language;
displaying the text in the second language on a surface of the virtual image of the real object such that the virtual image of the real object emulates an appearance of the real object but has text being displayed in the second language.

### Claim 5 (depends on 1)

The method of claim 1 further comprising:
displaying, on a display of a handheld portable electronic device, controls that instruct a wearer of the wearable electronic glasses with instructions of which direction to move and how fast to move in the direction;
displaying, on the display of the wearable electronic glasses, the controls that instruct the wearer of the wearable electronic glasses with the instructions of which direction to move and how fast to move in the direction.

### Claim 6 (depends on 1)

The method of claim 1 further comprising:
displaying, on a display of other wearable electronic glasses that are remote from the wearable electronic glasses, video of the real object;
detecting, at the other wearable electronic glasses, movements of a hand of a wearer of the other wearable electronic glasses toward the real object;
displaying, on the display of the wearable electronic glasses, a virtual hand that emulates the movements of the hand toward the real object.

### Claim 7 (depends on 1)

The method of claim 1 further comprising:
displaying the virtual image of the real object superimposed over the real object;
moving, while the virtual image of the real object is superimposed over the real object, a portion of the virtual image of the real object to show the task to be completed on the real object.

### Claim 8

Wearable electronic glasses, comprising:
a display;
a memory that store instructions; and
a processor in communication with the display and with the memory to execute the instructions to:
detect a real object that is visible through the wearable electronic glasses;
display, on the display and concurrently with the real object, a virtual object that emulates the real object;
display, on the display and while the virtual object is concurrently displayed with the real object, movement of the virtual object that shows an action to be performed on the real object; and
detect, while the virtual object is concurrently displayed with the real object, movement of the real object such that the movement of the real object copies the movement of the virtual object.

### Claim 9 (depends on 8)

The wearable electronic glasses of claim 8, wherein the processor further executes the instructions to:
track movement of eyes of a wearer of the wearable electronic glasses;
activate the virtual content to display on the display of the wearable electronic glasses when the eyes of the wearer focus on the real object.

### Claim 10 (depends on 8)

The wearable electronic glasses of claim 8, wherein the processor further executes the instructions to:
receive, from a remote pair of wearable electronic glasses, images of the virtual object that instruct a wearer of the wearable electronic glasses the action to be performed on the real object.

### Claim 11 (depends on 8)

The wearable electronic glasses of claim 8, wherein the processor further executes the instructions to:
display, on the display, the virtual object adjacent to one side of the real object in a field of view of the wearable electronic glasses;
detect movement of the wearable electronic glasses in which the virtual object is no longer within the field of view of the wearable electronic glasses;
move, in response to the virtual object no longer being within the field of view, the virtual object to an opposite side of the real object such that the virtual object is within the field of view of the wearable electronic glasses.

### Claim 12 (depends on 8)

The wearable electronic glasses of claim 8, wherein the processor further executes the instructions to:
maintain a constant distance between the virtual object being displayed on the display and the real object in a field of view of a wearer of the wearable electronic glasses while the wearable electronic glasses and the field of view moves and changes.

### Claim 13 (depends on 8)

The wearable electronic glasses of claim 8, wherein the processor further executes the instructions to:
receive, from a remote handheld portable electronic device, instructions;
display, on the display and to a wearer of the wearable electronic glasses, the instructions that simultaneously instruct which direction to move a head of the wearer along with which direction to move a body of the wearer along with what speed the wearer should proceed in the direction to move the body.

### Claim 14 (depends on 8)

The wearable electronic glasses of claim 8, wherein the processor further executes the instructions to:
receive, from a remote pair of wearable electronic glasses, the virtual object that shows the action to be performed on the real object, wherein the virtual object is a virtual hand of a wearer of the remote pair of the wearable electronic glasses.

### Claim 15

A non-transitory computer readable storage medium storing instructions that cause a computer system to execute a method, comprising:
capture, with wearable electronic glasses, a real object that is visible through a lens of the wearable electronic glasses;
display, through the wearable electronic glasses and concurrently with the real object, a virtual object that emulates the real object;
display, through the wearable electronic glasses and while the virtual object is concurrently displayed with the real object, a change to the virtual object that shows an action to be performed on the real object; and
capture, with the wearable electronic glasses and while the virtual object is concurrently displayed with the real object, performance of the action on the real object such that the performance of the action on the real action copies the action of the virtual object.

### Claim 16 (depends on 15)

The non-transitory computer readable storage medium storing instructions of claim 15 further to cause the computer system to execute the method comprising:
display, through the wearable electronic glasses, a visual notification that signifies the action on the real objected captured by the wearable electronic glasses did copy the action of the virtual object displayed through the wearable electronic glasses.

### Claim 17 (depends on 15)

The non-transitory computer readable storage medium storing instructions of claim 15 further to cause the computer system to execute the method comprising:
display, through the wearable electronic glasses, the virtual object at a distance from the real object while the real object is visible through the lens and within a field of view of the wearable electronic glasses;
maintain the distance between the virtual object and the real object as constant while the wearable electronic glasses move and change the field of view;
maintain the distance between the virtual object and the real object as constant while the real object moves within the field of view.

### Claim 18 (depends on 15)

The non-transitory computer readable storage medium storing instructions of claim 15, wherein the virtual object emulates the real object such that the virtual object has a size, shape, and color that matches a size, shape, and color of the real object.

### Claim 19 (depends on 15)

The non-transitory computer readable storage medium storing instructions of claim 15 further to cause the computer system to execute the method comprising:
detect when the virtual object begins to move outside the field of view of the wearable electronic glasses;
move, in response to detecting the virtual object moving outside the field of view, the virtual object to a different location with respect to the real object such that the different location situates the virtual object in the field of view of the wearable electronic glasses.

### Claim 20 (depends on 15)

The non-transitory computer readable storage medium storing instructions of claim 15 further to cause the computer system to execute the method comprising:
control, from a handheld portable electronic device that is remote from the wearable electronic glasses, movements of the virtual object in real-time as the virtual object moves and is displayed through the wearable electronic glasses.
