# US 2016/0252965 A1 · Computer Interface for Remotely Controlled Objects and Wearable Articles with Absolute Pose Detection Component

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0252965 A1
- Document ID: US20160252965A1
- Status: Published application
- Kind: A1
- Application number: 14/992,748
- Filed: 2016-01-11
- Published: 2016-09-01
- Earliest claimed: 2004-01-30
- Assignees: Electronic Scripting Products, Inc.
- Applicants: Electronic Scripting Products, Inc.
- Inventors: Michael J. Mandella; Hector H. Gonzalez-Banos; Marek Alboszta
- Web page: https://patentgrep.com/patent/US20160252965A1

## CPC

- G01B 21/04: by measuring coordinates of points
- A63F 13/20: Input arrangements for video game devices
- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/428: involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
- A63F 13/812: Ball games, e.g. soccer or baseball
- G02B 27/0172: {characterised by optical features}
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0317: {in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface}
- G06F 3/0325: {using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/03545: {Pens or stylus}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06T 7/73: using feature-based methods
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 10/17: {using hand-held instruments}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G06T 2207/30241: Trajectory
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A remotely controlled object (e.g., an aircraft) or a wearable article (e.g., virtual or augmented reality glasses) using high optical contrast features and a photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The remotely controlled object or wearable article uses one or more controllers to determine its position and/or orientation in the real three-dimensional environment based on data from the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector.

## Claims

### Claim 1

A wearable article cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said wearable article comprising:
a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data representative of the positions of said first plurality of high optical contrast features; and
b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the position of said photodetector.

### Claim 2 (depends on 1)

The wearable article of claim 1, wherein said first plurality of high optical contrast features are invariant features disposed in a known pattern within said real three-dimensional environment.

### Claim 3 (depends on 1)

The wearable article of claim 1, wherein said derivative pattern is computed with at least one absolute pose recovery technique selected from the group consisting of geometric invariance, triangulation, ranging, path integration and motion analysis.

### Claim 4 (depends on 3)

The wearable article of claim 3, wherein said at least one absolute pose recovery technique comprises geometric invariance computed under application of the rules of perspective geometry.

### Claim 5 (depends on 1)

The wearable article of claim 1 deployed in an application selected from the group consisting of virtual reality and augmented reality.

### Claim 6 (depends on 5)

The wearable article of claim 5, wherein said wearable article comprises glasses.

### Claim 7 (depends on 1)

The wearable article of claim 1, further comprising an auxiliary motion detection component.

### Claim 8

A wearable article cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said wearable article comprising:
a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data representative of the positions of said first plurality of high optical contrast features; and
b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the orientation of said photodetector.

### Claim 9 (depends on 8)

The wearable article of claim 8, wherein said first plurality of high optical contrast features are invariant features disposed in a known pattern within said real three-dimensional environment.

### Claim 10 (depends on 8)

The wearable article of claim 8, wherein said derivative pattern is computed with at least one absolute pose recovery technique selected from the group consisting of geometric invariance, triangulation, ranging, path integration and motion analysis.

### Claim 11 (depends on 10)

The wearable article of claim 10, wherein said at least one absolute pose recovery technique comprises geometric invariance computed under application of the rules of perspective geometry.

### Claim 12 (depends on 8)

The wearable article of claim 8, deployed in an application selected from the group consisting of virtual reality and augmented reality.

### Claim 13 (depends on 12)

The wearable article of claim 12, wherein said wearable article comprises glasses.

### Claim 14 (depends on 8)

The wearable article of claim 8, further comprising an auxiliary motion detection component.

### Claim 15

A remotely controlled object cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said remotely controlled object comprising:
a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data representative of the positions of said first plurality of high optical contrast features; and
b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the position of said photodetector.

### Claim 16 (depends on 15)

The remotely controlled object of claim 15, wherein said first plurality of high optical contrast features are invariant features disposed in a known pattern within said real three-dimensional environment.

### Claim 17 (depends on 15)

The remotely controlled object of claim 15, wherein said derivative pattern is computed with at least one absolute pose recovery technique selected from the group consisting of geometric invariance, triangulation, ranging, path integration and motion analysis.

### Claim 18 (depends on 17)

The remotely controlled object of claim 17, wherein said at least one absolute pose recovery technique comprises geometric invariance computed under application of the rules of perspective geometry.

### Claim 19 (depends on 15)

The remotely controlled object of claim 15, wherein said remotely controlled object comprises an aircraft.

### Claim 20 (depends on 15)

The wearable article of claim 15, further comprising an auxiliary motion detection component.

### Claim 21

A remotely controlled object cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said remotely controlled object comprising:
a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data representative of the positions of said first plurality of high optical contrast features; and
b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the orientation of said photodetector.

### Claim 22 (depends on 21)

The remotely controlled object of claim 21, wherein said first plurality of high optical contrast features are invariant features disposed in a known pattern within said real three-dimensional environment.

### Claim 23 (depends on 21)

The remotely controlled object of claim 21, wherein said derivative pattern is computed with at least one absolute pose recovery technique selected from the group consisting of geometric invariance, triangulation, ranging, path integration and motion analysis.

### Claim 24 (depends on 23)

The remotely controlled object of claim 23, wherein said at least one absolute pose recovery technique comprises geometric invariance computed under application of the rules of perspective geometry.

### Claim 25 (depends on 21)

The remotely controlled object of claim 21, wherein said remotely controlled object comprises an aircraft.

### Claim 26 (depends on 21)

The wearable article of claim 21, further comprising an auxiliary motion detection component.
