# US 2019/0377192 A1 · Augmented reality viewer with automated surface selection placement and content orientation placement

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0377192 A1
- Document ID: US20190377192A1
- Status: Published application
- Kind: A1
- Application number: 16/435,933
- Filed: 2019-06-10
- Published: 2019-12-12
- Earliest claimed: 2018-06-08
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Victor NG-THOW-HING
- Web page: https://patentgrep.com/patent/US20190377192A1

## CPC

- G02B 27/0176: {characterised by mechanical features}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/0172: {characterised by optical features}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/147: using display panels
- G09G 3/003: {to produce spatial visual effects}
- G09G 5/373: for modifying the size of the graphic pattern
- G09G 5/377: for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence)
- G09G 5/38: with means for controlling the display position
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen
- G09G 2340/0492: Change of orientation of the displayed image, e.g. upside-down, mirrored
- G09G 2354/00: Aspects of interface with display user
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

An augmented reality viewer is described. A user orientation determination module determines a user orientation. A content vector calculator calculates a content orientation vector relative to a near edge and a far edge of content, determines a dot product of the user orientation vector and the content orientation vector, and positions the content based on a magnitude of the dot product. A surface area vector calculator calculates a surface area orientation vector for each of a plurality of surface area. A surface selection module determines a dot product of the user orientation vector and each surface area orientation vector and selects a preferred surface based on the relative magnitude of the dot products.

## Claims

### Claim 1

An augmented reality viewer comprising:
a display that permits a user to see real world objects;
a data channel to hold content;
a user orientation determination module to determine a first user orientation of a user relative to the first display area and to determine a second user orientation of the user relative to the first display area;
a projector connected to the data channel to display the content through the display to the user within confines of the first display area while the user views the real world objects; and
a content orientation selection module connected to the surface extraction module and the user orientation module to display the content in a first content orientation relative to the first display area so that a near edge of the content is close to the user when the user is in the first user orientation, and display the content in a second content orientation relative to the first display area so that the near edge is rotated closer to the user when the user is in the second user orientation and the content is rotated relative to the first display area from the first content orientation to the second content orientation.

### Claim 2 (depends on 1)

The augmented reality viewer of claim 1, wherein the user orientation determination module determines a user orientation vector indicative of an orientation of a user, further comprising:
a content vector calculator to a calculate a content orientation vector relative to the near edge of the content, wherein the content orientation selection module determines a dot product of the user orientation vector and the content orientation vector and rotates the content from the first orientation to the second orientation based on a magnitude of the dot product in the second orientation and in the first orientation.

### Claim 3 (depends on 2)

The augmented reality viewer of claim 2, wherein the content orientation vector extends from the near edge of the content and the content rotates from the first content orientation to the second content orientation when the dot product becomes more in the second content orientation than in the first content orientation.

### Claim 4 (depends on 1)

The augmented reality viewer of claim 1, further comprising:
a size determination module that resizes the content to fit the surface area in the first orientation and the second orientation.

### Claim 5 (depends on 4)

The augmented reality viewer of claim 4, wherein the content has the same aspect ratio in the first orientation and in the second orientation.

### Claim 6 (depends on 1)

The augmented reality viewer of claim 1, further comprising:
a surface area extraction module to determine the first display area.

### Claim 7 (depends on 6)

The augmented reality viewer of claim 6, wherein the surface area extraction module determines second surface area and the user orientation determination module to determine a first orientation of a user relative to the first surface area and the second surface area, further comprising:
a surface area selection module to select a preferred surface area between the first surface area of the second surface area based on normal to the respective surface area being directed more opposite to the first user orientation of the user, wherein the projector displays the content through the display to the user within confines of the preferred surface area while the user views the real world objects.

### Claim 8

An augmented reality viewing method comprising:
determining, by the processor, a first user orientation of a user relative to the first display area;
determining, by the processor, a first content orientation relative to the display when the user is in the first orientation;
displaying, by the processor, content in the first content orientation through a display to the user within confines of the first display area while the user views real world objects through the display while in the first user orientation;
determining, by the processor, a second user orientation of the user relative to the first display area;
determining, by the processor, a second content orientation relative to the display when the user is in the second location; and
displaying, by the processor, content in the second content orientation through a display to the user within confines of the display area while the user views real world objects through the display from the second location, wherein the content is rotated relative to the first display area from the first content orientation to the second content orientation.

### Claim 9

(canceled)

### Claim 10

(canceled)

### Claim 11

(canceled)

### Claim 12

(canceled)

### Claim 13

(canceled)

### Claim 14

(canceled)

### Claim 15

(canceled)

### Claim 16

(canceled)

### Claim 17

(canceled)

### Claim 18

(canceled)

### Claim 19

(canceled)

### Claim 20

An augmented reality viewer comprising:
an environmental calculation unit to determine a first vector indicative an orientation of a user;
a vector calculator to a calculate a second vector;
a selection module to calculate a dot product of the first vector and the second vector;
a data channel to hold content;
a content rendering module to determine placement of the content based on the dot product;
a display that permits the user to see real world objects; and
a projector that displays the content through the display to the user while the user views the real world objects through the display, the content being displayed based on the placement determined by the content rendering module.

### Claim 21

An augmented reality viewing method comprising:
determining, by a processor, a first vector indicative an orientation of a user;
calculating, by the processor, a second vector;
calculating, by the processor, a dot product of the first vector and the second vector;
determining, by the processor, placement of content based on the dot product; and
displaying, by the processor, the content through a display to the user while the user views real world objects through the display, the content being displayed based on the placement determined by the content rendering module.