# US 2017/0246070 A1 · Radar imagery in head-worn computing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0246070 A1
- Document ID: US20170246070A1
- Status: Published application
- Kind: A1
- Application number: 15/063,714
- Filed: 2016-03-08
- Published: 2017-08-31
- Earliest claimed: 2016-02-29
- Assignees: Osterhout Group, Inc.
- Applicants: Osterhout Group, Inc.
- Inventors: Ralph F. Osterhout; John N. Border; John D. Haddick
- Web page: https://patentgrep.com/patent/US20170246070A1

## CPC

- A61H 3/061: {with electronic detecting or guiding means}
- G02B 7/023: {permitting adjustment}
- G02B 27/0172: {characterised by optical features}
- G02B 27/0176: {characterised by mechanical features}
- G02C 7/088: {Lens systems mounted to spectacles}
- G02C 11/10: {Electronic devices other than hearing aids}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 5/73: Deblurring; Sharpening
- G06T 5/92: based on global image properties
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 10/235: {based on user input or interaction}
- G06V 20/20: in augmented reality scenes
- G06V 20/63: {Scene text, e.g. street names}
- G06V 40/19: Sensors therefor
- G09B 21/008: {using visual presentation of the information for the partially sighted}
- H04N 7/183: {for receiving images from a single remote source}
- H04N 7/185: {from a mobile camera, e.g. for remote control}
- H04N 23/63: by using electronic viewfinders
- H04N 23/682: {Vibration or motion blur correction}
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- A61H 2003/063: {with tactile perception}
- A61H 2201/0188: Illumination related features
- A61H 2201/1604: Head
- A61H 2201/165: Wearable interfaces
- A61H 2201/501: connected to external computer devices or networks
- A61H 2201/5043: Displays
- A61H 2201/5048: Audio interfaces, e.g. voice or music controlled
- A61H 2201/5058: Sensors or detectors
- A61H 2201/5061: Force sensors
- A61H 2201/5064: Position sensors
- A61H 2201/5071: Pressure sensors
- A61H 2201/5082: Temperature sensors
- A61H 2201/5084: Acceleration sensors
- A61H 2201/5092: Optical sensor
- G02B 2027/0127: {comprising devices increasing the depth of field}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0147: {comprising a device modifying the resolution of the displayed image}
- G02B 2027/0156: {with optionally usable elements}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06T 2207/20208: High dynamic range [HDR] image processing
- G06T 2207/20221: Image fusion; Image merging
- A61H: PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY (electrotherapy, magnetotherapy, radiation therapy or ultrasound therapy A61N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Aspects of the present disclosure relate aids for the visually impaired. An apparatus to assist a visually impaired person in navigating an environment includes a head-worn computer, a radar system mounted on the head-worn computer and positioned to measure distances to objects in the environment within an angular field in front of the visually impaired person wearing the head-worn computer, and a processor adapted to process the measured distances from the radar system and to identify objects in the environment that are within the angular field in front of the visually impaired person. The processor is further adapted to generate feedback cues to the visually impaired person in correspondence to the measured distances within the angular field in front of the visually impaired person as the visually impaired person moves his head from side to side while navigating the environment.

## Claims

### Claim 1

An apparatus to assist a visually impaired person in navigating an environment, comprising:
a. a head-worn computer;
b. a radar system mounted on the head-worn computer and positioned to measure distances to objects in the environment within an angular field in front of the visually impaired person wearing the head-worn computer; and
c. a processor adapted to process the measured distances from the radar system and to identify objects in the environment that are within the angular field in front of the visually impaired person, the processor further adapted to generate feedback cues to the visually impaired person in correspondence to the measured distances within the angular field in front of the visually impaired person as the visually impaired person moves his head from side to side while navigating the environment.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the processor is further adapted to interpret movements of the visually impaired person to make a prediction of a direction in which the visually impaired person is walking to assist in the person in navigating the environment.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the feedback cues are visual.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the feedback cues are audio based.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the feedback is haptic based.

### Claim 6 (depends on 1)

The apparatus of claim 1, further comprising a second radar system having a second angular field that overlaps at least a portion of the angular field.

### Claim 7 (depends on 1)

The apparatus of claim 1, further comprising a visual light camera, wherein the visual light camera is used to capture an image of an object in the environment in front of the person, wherein the processor is further adapted to identify the object; and wherein the radar system is adapted to identify a distance between the head-worn computer and the object.
