# US 2015/0106767 A1 · Method and apparatus for addressing obstruction in an interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0106767 A1
- Document ID: US20150106767A1
- Status: Published application
- Kind: A1
- Application number: 14/515,812
- Filed: 2014-10-16
- Published: 2015-04-16
- Earliest claimed: 2013-10-16
- Assignees: Atheer, Inc.
- Applicants: Atheer, Inc.
- Inventors: Nathan Abercrombie; Theo Goguely
- Web page: https://patentgrep.com/patent/US20150106767A1

## CPC

- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A user, a manipulator such as a hand, and at least one entity such as a virtual or augmented reality object are in an interface such as a 3D environmental interface. The manipulation distance is the distance between a reference feature of the user and a manipulation feature of the manipulator. The entity distance is the distance between the reference feature and an entity feature of the entity. When the manipulation distance becomes greater than the entity distance, the entity is caused to fade, disappear, move out of the way, shrink, etc. so as to be less of an obstruction to the user's field of view, for example to avoid obstructing more distant entities. Other factors than the manipulation distance and entity distance may be considered in determining whether to reduce the obstructivity of the entity, and exceptions to the obstruction relation may be considered.

## Claims

### Claim 1

A machine-implemented method, comprising in a processor:
establishing a manipulation distance between a reference feature associated with a user and a manipulation feature associated with a manipulator;
establishing an entity distance between said reference feature and an entity feature associated with an entity, said entity comprising a visual component; and
establishing an obstruction relation comprising said manipulation distance and said entity distance;
if said obstruction relation is positive, executing a response, said response comprising reducing a visual obstructivity of said entity relative to said user.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
said obstruction relation comprises a relation of said manipulation distance and said entity distance.

### Claim 3 (depends on 2)

The method of claim 2, wherein:
said manipulation distance must be greater than said entity distance for said obstruction relation to be positive.

### Claim 4 (depends on 3)

The method of claim 3, wherein:
said manipulation distance being greater than said entity distance is sufficient for said obstruction relation to be positive.

### Claim 5 (depends on 3)

The method of claim 3, wherein:
said manipulation distance being greater than said entity distance is not sufficient for said obstruction relation to be positive.

### Claim 6 (depends on 2)

The method of claim 2, wherein:
said method further comprises establishing an exception distance between said manipulation feature and said entity feature; and
said obstruction relation further comprises said exception distance.

### Claim 7 (depends on 6)

The method of claim 6, wherein:
if said exception distance is less than a minimum exception distance, said obstruction relation is negative.

### Claim 8 (depends on 7)

The method of claim 7, wherein:
said minimum exception distance is at least one of a group consisting of a linear distance and an angular distance.

### Claim 9 (depends on 7)

The method of claim 7, wherein:
said minimum exception distance is a function of said entity distance.

### Claim 10 (depends on 6)

The method of claim 6, wherein:
if said exception distance is greater than a maximum exception distance, said obstruction relation is negative.

### Claim 11 (depends on 11)

The method of claim 11, wherein:
said maximum exception distance is at least one of a group consisting of a linear distance and an angular distance.

### Claim 12 (depends on 1)

The method of claim 1, wherein:
said maximum exception distance is a function of said entity distance.

### Claim 13 (depends on 1)

The method of claim 1, wherein:
said method further comprises establishing at least one exception factor; and
if any of said at least one exception factor is satisfied said obstruction relation is negative.

### Claim 14 (depends on 13)

The method of claim 13, wherein:
said method comprises establishing an exception construct; and
said exception factor comprises disposition of said manipulation point within said exception construct, such that if said manipulation point is within said exception construct said obstruction relation is negative.

### Claim 15 (depends on 13)

The method of claim 13, wherein:
said exception factor comprises a user input, wherein if said user input is executed said obstruction relation is negative.

### Claim 16 (depends on 15)

The method of claim 15, wherein:
said user input comprises at least one of a group consisting of a hand posture, a hand gesture, an eye posture, an eye gesture, and a voice command

### Claim 17 (depends on 13)

The method of claim 13, wherein:
said exception factor comprises at least one of a group consisting of:
a minimum manipulation distance, such that if said manipulation distance is less than said minimum manipulation distance said obstruction relation is negative;
a maximum manipulation distance, such that if said manipulation distance is greater than said maximum manipulation distance said obstruction relation is negative;
a minimum entity distance, such that if said entity distance is less than said minimum entity distance said obstruction relation is negative; and
a maximum entity distance, such that if said entity distance is greater than said maximum entity distance said obstruction relation is negative.

### Claim 18 (depends on 1)

The method of claim 1, comprising:
if said response is executed, thereafter evaluating said obstruction relation using a prior entity distance in place of said entity distance, said prior entity distance comprising a distance between said reference feature and a position of said manipulation feature prior to executing said response.

### Claim 19 (depends on 1)

The method of claim 1, wherein:
said reference feature comprises at least one of a group consisting of a point, a surface, and a solid.

### Claim 20 (depends on 1)

The method of claim 1, wherein:
said reference feature is selectable by said user.

### Claim 21 (depends on 1)

The method of claim 1, wherein:
said manipulation feature comprises at least one of a group consisting of a point, a surface, and a solid.

### Claim 22 (depends on 1)

The method of claim 1, wherein:
said manipulation feature is selectable by said user.

### Claim 23 (depends on 1)

The method of claim 1, wherein:
said entity feature comprises at least one of a group consisting of a point, a surface, and a solid.

### Claim 24 (depends on 1)

The method of claim 1, wherein:
said entity feature is selectable by said user.

### Claim 25 (depends on 1)

The method of claim 1, wherein:
said reference feature substantially coincides with one of a group consisting of:
a geometric center of a body of said user;
a geometric center of a head of said user;
an eye of said user;
a retina of said user; and
a midpoint between eyes of said user.

### Claim 26 (depends on 1)

The method of claim 1, wherein:
said manipulation feature substantially coincides with one of a group consisting of:
a hand of said user;
a fingertip of said user; and
a tip of a stylus held by said user.

### Claim 27 (depends on 1)

The method of claim 1, wherein:
said entity feature substantially coincides with one of a group consisting of:
a geometric center of said entity;
a surface of said entity; and
a surface outwardly offset from said entity.

### Claim 28 (depends on 1)

The method of claim 1, wherein:
if said manipulation distance is greater than said entity distance by at least a trigger measure, executing said response, and if said manipulation distance is not greater than said entity distance by at least said trigger measure, not executing said response.

### Claim 29 (depends on 28)

The method of claim 28, wherein:
said trigger measure comprises at least one of a group consisting of:
an absolute distance; and
a proportional distance.

### Claim 30 (depends on 1)

The method of claim 1, wherein:
said response comprises at least one of a group consisting of:
decreasing an opacity of said entity;
decreasing said opacity of said entity to substantially zero;
de-resolving said entity;
deleting said entity;
decreasing a size of said entity; and
changing a position of said entity.

### Claim 31 (depends on 1)

The method of claim 1, wherein:
said response comprises angularly displacing said entity about an axis substantially coinciding with said reference feature.

### Claim 32 (depends on 31)

The method of claim 31, wherein:
said response comprises at least one of a group consisting of:
displacing said entity at least 60 degrees;
displacing said entity at least 120 degrees; and
displacing said entity at least by an angle such that said entity is substantially outside a field of view of said user;
displacing said entity such that said entity is substantially outside a field of view of said user.

### Claim 33 (depends on 1)

The method of claim 1, wherein:
said entity comprises at least one of a group consisting of an augmented reality entity and a virtual reality entity.

### Claim 34 (depends on 1)

The method of claim 1, wherein:
said entity comprises at least one of a group consisting of a light emission, a light projection and a hologram.

### Claim 35 (depends on 1)

The method of claim 1, comprising:
establishing a plurality of entity distances between said reference feature and a plurality of entity features for a plurality of entities, each of said entities comprising visual components; and
if for any of said entities said manipulation distance is greater than said entity distance, executing a response, said response comprising reducing a visual obstructivity relative to said user of said any of said entities.

### Claim 36 (depends on 1)

The method of claim 1, comprising:
if a distance between said manipulation feature and said entity feature is less than an exception distance, not executing said response.

### Claim 37 (depends on 36)

The method of claim 36, wherein:
said exception distance comprises at least one of a group consisting of a linear distance and an angular distance.

### Claim 38 (depends on 1)

The method of claim 1, comprising:
if said manipulation feature is within an exception construct for said entity, not executing said response.

### Claim 39 (depends on 1)

The method of claim 1, comprising:
establishing a facing of said user;
if said facing of said user is substantially aligned with said entity, not executing said response.

### Claim 40 (depends on 1)

The method of claim 1, comprising:
establishing a direction of a line of sight of said user;
if said line of sight of said user is substantially aligned with said entity, not executing said response.

### Claim 41 (depends on 1)

The method of claim 1, comprising:
if said entity is active, not executing said response.

### Claim 42 (depends on 1)

The method of claim 1, comprising:
if said entity was addressed within an exception time, not executing said response.

### Claim 43

An apparatus, comprising:
a processor;
at least one sensor in communication with said processor; and
an outputter in communication with said sensor;
wherein:
said sensor is adapted to sense a manipulation distance between a reference feature associated with a user and a manipulation feature associated with a manipulator;
said sensor is adapted to sense an entity distance between said reference feature and an entity feature associated with an entity, said entity comprising a visual component;
said processor is adapted to determine whether said manipulation distance is greater than said entity distance, and to determine a reduced obstructivity of said entity relative to said user if said manipulation distance is greater than said entity distance; and
said outputter is adapted to reduce said visual obstructivity of said entity.

### Claim 44 (depends on 43)

The apparatus of claim 43, wherein:
said at least one sensor comprises at least one of a group consisting of an imager, a stereo pair of imagers, a depth sensor, a structured light sensor, and a time of flight sensor.

### Claim 45 (depends on 43)

The apparatus of claim 43, wherein:
said output comprises at least one of a visual display, an optical see-through visual display, a virtual see-through display, and a stereo visual display.

### Claim 46 (depends on 43)

The apparatus of claim 43, wherein:
at least a portion of said apparatus is disposed on a head mounted display.

### Claim 47

An apparatus, comprising:
a processor;
at least one sensor in communication with said processor; and
an outputter in communication with said sensor;
wherein:
said sensor is adapted to sense a position of a reference feature associated with a user;
said sensor is adapted to sense a position of a manipulation feature associated with a manipulator;
said sensor is adapted to sense a position of an entity feature associated with an entity, said entity comprising a visual component;
said processor is adapted to determine whether a manipulation distance between said reference feature and said manipulation feature is greater than an entity distance between said reference feature and said entity feature, and to determine a reduced obstructivity of said entity relative to said user if said manipulation distance is greater than said entity distance; and
said outputter is adapted to reduce said visual obstructivity of said entity.

### Claim 48

An apparatus, comprising:
means for establishing a manipulation distance between a reference feature associated with a user and a manipulation feature associated with a manipulator;
means for establishing an entity distance between said reference feature and an entity feature associated with an entity, said entity comprising a visual component; and
means for executing a response if said manipulation distance is greater than said entity distance, said response comprising reducing a visual obstructivity of said entity relative to said user.
