# US 2009/0293012 A1 · Handheld synthetic vision device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0293012 A1
- Document ID: US20090293012A1
- Status: Published application
- Kind: A1
- Application number: 11/160,115
- Filed: 2005-06-09
- Published: 2009-11-26
- Earliest claimed: 2005-06-09
- Assignees: Nav3D Corporation
- Inventors: Keith Alter; Andrew Kevin Barrows; Chad Jennings
- Web page: https://patentgrep.com/patent/US20090293012A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G01C 21/20: Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence)
- G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 15/10: Geometric effects
- G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A handheld synthetic vision system includes a display, a sensor suite and a computer all housed in a handheld unit. The system enhances normal vision by displaying to a user actual or digitally created visual scenes of objects and information that may or may not be perceptible to unaided human senses.

## Claims

### Claim at position 1

1-16. (canceled)

### Claim 17

A synthetic vision system comprising:
a video imagery source configured to acquire and supply a real-time actual image;
a synthetic vision database having graphic objects stored therein;
a handheld unit;
a sensor suite housed within the handheld unit, the sensor suite comprising position and attitude sensors for reporting position and attitude data, respectively;
a display housed within the handheld unit and configured to render images of actual or digitally created scenes; and
a computer housed within the handheld unit and in communication with the video imagery source, the synthetic vision database, the sensor suite, and the display, the computer configured to:
(i) receive the position and attitude data from the sensor suite and compute a view frustum,
(ii) selectively retrieve graphic objects from the synthetic vision database,
(iii) command the display to render, in three dimensional perspective, an image of (a) the real-time actual image that lies wholly or partially within the view frustum and (b) graphic objects selectively retrieved from the synthetic vision database that lie wholly or partially within the view frustum,
wherein the image is rendered on the display with an expanded field of view, the expanded field of view being wider than a user field of view when the user is holding the handheld unit and looking at the image on the display.

### Claim 18 (depends on 1)

The system of claim 1, wherein:
the computer updates the display at least 12 times per second; and
position data RMS accuracy is 15 meters or better with 95% confidence.

### Claim 19 (depends on 17)

The system of claim 17, further comprising:
an input device in communication with the computer and housed in the handheld unit, the input device for allowing a user to select a plurality of viewpoints of the image rendered on the display.

### Claim 20 (depends on 17)

The system of claim 17, wherein the computer implements sensor fusion, Kalman filtering, or display smoothing algorithms to enhance image quality when slow or asynchronous data are received from the sensor suite or the video imagery source.

### Claim 21 (depends on 17)

The system of claim 17, wherein the computer is further configured to:
selectively render a reticle symbol to designate an object in the image; and
selectively render an arrow to indicate a direction in which to move the handheld unit, when the designated object is not visible in the image, in order to have the designated object once again visible in the image.

### Claim 22 (depends on 17)

The system of claim 17, further comprising:
an external communication device in communication with the computer and configured to selectively communicate with one or more external devices.

### Claim 23

A synthetic vision system comprising:
a handheld unit;
a sensor suite housed within the handheld unit, the sensor suite comprising position and attitude sensors for reporting position and attitude data, respectively, and a range finder for detecting and measuring distances to objects and reporting measured distance data;
a display housed within the handheld unit and configured to render actual or digitally created scenes; and
a computer housed within the handheld unit and in communication with the sensor suite and the display, the computer configured to (i) receive the position data, the attitude data, and the measure distance data from the sensor suite, (ii) compute a view frustum, (iii) compare computed distances to the detected objects with the distances measured by the range finder, and (iv) command the display to render, in three dimensional perspective, an image of actual or digitally created scenes that lie wholly or partially within the view frustum,
wherein:
the image includes the detected objects, and
the detected objects are rendered in styles that indicate their relative distances.

### Claim 24 (depends on 23)

The system of claim 23, wherein:
the computer updates the display at least 12 times per second; and
position data RMS accuracy is 15 meters or better with 95% confidence.

### Claim 25 (depends on 23)

The system of claim 23, further comprising:
an input device in communication with the computer and housed in the handheld unit, the input device for allowing a user to select a plurality of viewpoints of the image rendered on the display.

### Claim 26 (depends on 23)

The system of claim 23, wherein the computer implements sensor fusion, Kalman filtering, or display smoothing algorithms to enhance image quality when slow or asynchronous data are received from the sensor suite.

### Claim 27 (depends on 23)

The system of claim 23, wherein the computer is further configured to:
selectively render a reticle symbol to designate an object in the image; and
selectively render an arrow to indicate a direction in which to move the handheld unit, when the designated object is not visible in the image, in order to have the designated object once again visible in the image.

### Claim 28 (depends on 23)

The system of claim 23, further comprising:
an external communication device in communication with the computer and configured to selectively communicate with one or more external devices.
