# US 2014/0192084 A1 · Mixed reality display accommodation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192084 A1
- Document ID: US20140192084A1
- Status: Published application
- Kind: A1
- Application number: 13/738,902
- Filed: 2013-01-10
- Published: 2014-07-10
- Earliest claimed: 2013-01-10
- Assignees: Microsoft Technology Licensing, LLC
- Inventors: Stephen Latta; Peter Tobias Kinnebrew
- Web page: https://patentgrep.com/patent/US20140192084A1

## CPC

- G09G 3/003: {to produce spatial visual effects}
- G02B 27/017: {Head mounted}
- G02B 30/22: of the stereoscopic type
- G06F 21/00: Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F 21/10: Protecting distributed programs or content, e.g. vending or licensing of copyrighted material (protection in video systems or pay television H04N7/16) {; Digital rights management [DRM]}
- G06F 21/36: by graphic or iconic representation
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0174: {holographic}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G03H 1/2294: {Addressing the hologram to an active spatial light modulator}
- G03H 2001/2284: {Superimposing the holobject with other visual information}
- G03H 2227/02: Handheld portable device, e.g. holographic camera, mobile holographic display
- G09G 2340/10: Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
- G09G 2340/12: Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
- G09G 2354/00: Aspects of interface with display user
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G03H: HOLOGRAPHIC PROCESSES OR APPARATUS (holograms, e.g. point holograms, used as ordinary optical elements G02B5/32; producing stereoscopic or other three-dimensional effects G02B30/00; diffraction-grating systems G02B27/44; systems using moiré fringes G02B27/60; optical logic elements G02F3/00; stereo-photography G03B35/00; photosensitive materials or processes for photographic purposes G03C; {stereo-photographic or similar processes G03C9/00}; apparatus for processing exposed photographic materials G03D; analogue computers performing mathematical operations with the aid of optical elements G06E3/00; authentication by radiation, of concealed information carried by holograms or diffraction gratings G06K19/16; holographic storage G11B7/0065, G11C13/04; {stereoscopic or other three dimensional effects in television systems H04N13/00})

## Abstract

A mixed reality accommodation system and related methods are provided. In one example, a head-mounted display device includes a plurality of sensors and a display system for presenting holographic objects. A mixed reality safety program is configured to receive a holographic object and associated content provider ID from a source. The program assigns a trust level to the object based on the content provider ID. If the trust level is less than a threshold, the object is displayed according to a first set of safety rules that provide a protective level of display restrictions. If the trust level is greater than or equal to the threshold, the object is displayed according to a second set of safety rules that provide a permissive level of display restrictions that are less than the protective level of display restrictions.

## Claims

### Claim 1

A method for displaying a holographic object to accommodate a mixed reality environment including a physical environment, comprising:
providing a head-mounted display device configured to be worn by a user and operatively connected to a computing device, the head-mounted display device including a plurality of sensors and a display system;
receiving physical environment data from the physical environment via one or more of the sensors;
receiving the holographic object from a source, the holographic object associated with a content provider ID;
assigning a trust level to the holographic object based on the content provider ID;
if the trust level is less than a trust level threshold, then:
applying a first set of safety rules that provide a protective level of display restrictions for the holographic object; and
displaying the holographic object via the display system according to the first set of safety rules;
if the trust level is greater than or equal to the trust level threshold, then:
applying a second set of safety rules that provide a permissive level of display restrictions for the holographic object; and
displaying the holographic object via the display system according to the second set of safety rules;
wherein the protective level of display restrictions is greater than the permissive level of display restrictions.

### Claim 2 (depends on 1)

The method of claim 1, wherein applying the first set of safety rules further comprises selecting the first set of safety rules based on the physical environment data, and applying the second set of safety rules further comprises selecting the second set of safety rules based on the physical environment data.

### Claim 3 (depends on 1)

The method of claim 1, wherein the physical environment data is selected from the group consisting of one or more environmental conditions, a user location, and one or more location-based restrictions.

### Claim 4 (depends on 3)

The method of claim 3, wherein the one or more environmental conditions are selected from the group consisting of a date, a time of day, a weather condition, an ambient light level, and an ambient noise level.

### Claim 5 (depends on 3)

The method of claim 3, wherein the one or more location-based restrictions are selected from the group consisting of government-based restrictions and private entity-based restrictions.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
receiving user action data that is selected from the group consisting of eye-tracking information, microphone information, optical sensor information, position sensor information, and biometric information; and
determining a current user action based on the user action data using one or more of heuristics, an action-inference table, and programmatic rules.

### Claim 7 (depends on 6)

The method of claim 6, wherein applying the first set of safety rules further comprises selecting the first set of safety rules based on the current user action, and
applying the second set of safety rules further comprises selecting the second set of safety rules based on the current user action.

### Claim 8 (depends on 6)

The method of claim 6, further comprising determining a user intention based on the user action data and using one or more of heuristics, an action-inference table, and programmatic rules, and wherein applying the first set of safety rules further comprises selecting the first set of safety rules based also on the user intention, and applying the second set of safety rules further comprises selecting the second set of safety rules based also on the user intention.

### Claim 9 (depends on 1)

The method of claim 1, wherein the holographic object comprises a first holographic object version that includes a protective safety rating and a second holographic object version that includes a permissive safety rating different from the protective safety rating.

### Claim 10 (depends on 9)

The method of claim 9, wherein applying the first set of safety rules further comprises selecting the first holographic object version, and applying the second set of safety rules further comprises selecting the second holographic object version.

### Claim 11

A mixed reality accommodation system, comprising:
a head-mounted display device configured to be worn by a user and operatively connected to a computing device, the head-mounted display device including a plurality of sensors and a display system for presenting holographic objects, and
a mixed reality safety program executed by a processor of the computing device, the mixed reality safety program configured to:
receive physical environment data from a physical environment via one or more of the sensors;
receive a holographic object from a source, the holographic object associated with a content provider ID;
assign a trust level to the holographic object based on the content provider ID;
if the trust level is less than a trust level threshold, then:
apply a first set of safety rules that provide a protective level of display restrictions for the holographic object; and
display the holographic object via the display system according to the first set of safety rules;
if the trust level is greater than or equal to the trust level threshold, then:
apply a second set of safety rules that provide a permissive level of display restrictions for the holographic object; and
display the holographic object via the display system according to the second set of safety rules;
wherein the protective level of display restrictions is greater than the permissive level of display restrictions.

### Claim 12 (depends on 11)

The mixed reality accommodation system of claim 11, wherein the mixed reality safety program is further configured to select the first set of safety rules based on the physical environment data, and select the second set of safety rules based on the physical environment data.

### Claim 13 (depends on 11)

The mixed reality accommodation system of claim 11, wherein the physical environment data is selected from the group consisting of one or more environmental conditions, a user location, and one or more location-based restrictions.

### Claim 14 (depends on 13)

The mixed reality accommodation system of claim 13, wherein the one or more environmental conditions are selected from the group consisting of a date, a time of day, a weather condition, an ambient light level, and an ambient noise level.

### Claim 15 (depends on 13)

The mixed reality accommodation system of claim 13, wherein the one or more location-based restrictions are selected from the group consisting of government-based restrictions and private entity-based restrictions.

### Claim 16 (depends on 11)

The mixed reality accommodation system of claim 11, wherein the mixed reality safety program is further configured to:
receive user action data that is selected from the group consisting of eye-tracking information, microphone information, optical sensor information, position sensor information, and biometric information;
determine a current user action based on the user action data using one or more of heuristics, an action-inference table, and programmatic rules;
select the first set of safety rules based on the current user action; and
select the second set of safety rules based on the current user action.

### Claim 17 (depends on 16)

The mixed reality accommodation system of claim 16, wherein the mixed reality safety program is further configured to:
determine a user intention based on the user action data and using one or more of heuristics, an action-inference table, and programmatic rules;
select the first set of safety rules based also on the user intention, and
select the second set of safety rules based also on the user intention.

### Claim 18 (depends on 11)

The mixed reality accommodation system of claim 11, wherein the holographic object comprises a first holographic object version that includes a protective safety rating and a second holographic object version that includes a permissive safety rating different from the protective safety rating, and the mixed reality safety program is further configured to:
select the first holographic object version based on the trust level; and
select the second holographic object version based on the trust level.

### Claim 19

A mixed reality accommodation system, comprising:
a head-mounted display device configured to be worn by a user and operatively connected to a computing device, the head-mounted display device including a plurality of sensors and a display system for presenting holographic objects, and
a mixed reality safety program executed by a processor of the computing device, the mixed reality safety program configured to:
receive physical environment data from a physical environment via one or more of the sensors;
receive a holographic object from a source, the holographic object associated with a content provider ID;
receive user action data that is selected from the group consisting of eye-tracking information, microphone information, optical sensor information, position sensor information, and biometric information;
determine a current user action based on the user action data using one or more of heuristics, an action-inference table, and programmatic rules;
assign a trust level to the holographic object based on the content provider ID;
if the trust level is less than a trust level threshold, then:
select a first set of safety rules based on the physical environment data and the current user action, the first set of safety rules providing a protective level of display restrictions for the holographic object;
apply the first set of safety rules; and
display the holographic object via the display system according to the first set of safety rules;
if the trust level is greater than or equal to the trust level threshold, then:
select a second set of safety rules based on the physical environment data and the current user action, the second set of safety rules providing a permissive level of display restrictions for the holographic object;
apply the second set of safety rules; and
display the holographic object via the display system according to the second set of safety rules;
wherein the protective level of display restrictions is greater than the permissive level of display restrictions.

### Claim 20 (depends on 19)

The mixed reality accommodation system of claim 19, wherein the mixed reality safety program is further configured to:
determine a user intention based on the user action data and using one or more of heuristics, an action-inference table, and programmatic rules;
select the first set of safety rules based also on the user intention, and
select the second set of safety rules based also on the user intention.