# US 11,298,288 B2 · Providing enhanced images for navigation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,298,288 B2
- Document ID: US11298288B2
- Status: Granted
- Kind: B2
- Application number: 17/077,980
- Filed: 2020-10-22
- Published: 2021-06-03
- Granted: 2022-04-12
- Earliest claimed: 2016-02-29
- Assignees: Mentor Acquisition One, LLC
- Applicants: Mentor Acquisition One, LLC
- Inventors: John N. Border
- Web page: https://patentgrep.com/patent/US11298288B2

## CPC

- A61H 3/061: {with electronic detecting or guiding means}
- G02B 7/023: {permitting adjustment}
- G02B 27/0172: {characterised by optical features}
- G02B 27/0176: {characterised by mechanical features}
- G02C 7/088: {Lens systems mounted to spectacles}
- G02C 11/10: {Electronic devices other than hearing aids}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 5/73: Deblurring; Sharpening
- G06T 5/92: based on global image properties
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 10/235: {based on user input or interaction}
- G06V 20/20: in augmented reality scenes
- G06V 20/63: {Scene text, e.g. street names}
- G06V 40/19: Sensors therefor
- G09B 21/008: {using visual presentation of the information for the partially sighted}
- H04N 7/183: {for receiving images from a single remote source}
- H04N 7/185: {from a mobile camera, e.g. for remote control}
- H04N 23/63: by using electronic viewfinders
- H04N 23/682: {Vibration or motion blur correction}
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- A61H 2003/063: {with tactile perception}
- A61H 2201/0188: Illumination related features
- A61H 2201/1604: Head
- A61H 2201/165: Wearable interfaces
- A61H 2201/501: connected to external computer devices or networks
- A61H 2201/5043: Displays
- A61H 2201/5048: Audio interfaces, e.g. voice or music controlled
- A61H 2201/5058: Sensors or detectors
- A61H 2201/5061: Force sensors
- A61H 2201/5064: Position sensors
- A61H 2201/5071: Pressure sensors
- A61H 2201/5082: Temperature sensors
- A61H 2201/5084: Acceleration sensors
- A61H 2201/5092: Optical sensor
- G02B 2027/0127: {comprising devices increasing the depth of field}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0147: {comprising a device modifying the resolution of the displayed image}
- G02B 2027/0156: {with optionally usable elements}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06T 2207/20208: High dynamic range [HDR] image processing
- G06T 2207/20221: Image fusion; Image merging
- A61H: PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY (electrotherapy, magnetotherapy, radiation therapy or ultrasound therapy A61N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Aspects of the present disclosures relate aids for the visually impaired.

## Claims

### Claim 1

A method comprising:
receiving, via one or more sensors of a wearable head device comprising a see-through display, sensor data indicative of a surrounding environment of a user of the wearable head device;
determining an image based on the sensor data, the image corresponding to the surrounding environment;
enhancing a visibility of a first portion of the image corresponding to a first portion of the surrounding environment;
forgoing enhancing a visibility of a second portion of the image corresponding to a second portion of the surrounding environment; and
presenting, concurrently via the see-through display of the wearable head device, the enhanced first portion of the image and a see-through view of the second portion of the surrounding environment,
wherein presenting the enhanced first portion comprises presenting the enhanced first portion at a region of the see-through display determined based on a position of an eye of the user relative to a field of view of the see-through display.

### Claim 2 (depends on 1)

The method of claim 1, wherein enhancing a visibility of a first portion of the image comprises increasing one or more of a contrast of the first portion of the image, a brightness of the first portion of the image, a sharpness of the first portion of the image, and a color saturation of the first portion of the image.

### Claim 3 (depends on 1)

The method of claim 1, wherein enhancing a visibility of a first portion of the image comprises changing a focus distance of the first portion of the image.

### Claim 4 (depends on 3)

The method of claim 3, wherein the focus distance is determined based on an ophthalmic characteristic of the eye.

### Claim 5 (depends on 1)

The method of claim 1, wherein enhancing the visibility of a first portion of the image comprises adjusting one or more digital code values corresponding to one or more pixels of the first portion of the image.

### Claim 6 (depends on 5)

The method of claim 5, wherein enhancing the visibility of the first portion of the image further comprises increasing code values that exceed a predetermined threshold and decreasing code values that do not exceed the predetermined threshold.

### Claim 7 (depends on 5)

The method of claim 5, wherein enhancing the visibility of the first portion of the image further comprises increasing luma for pixels that have luma values above a predetermined threshold and decreasing luma for pixels that have luma values below the predetermined threshold.

### Claim 8

A wearable system comprising:
A wearable head device comprising a see-through display and one or more sensors; and
one or more processors configured to perform a method comprising:
receiving, via the one or more sensors, sensor data indicative of a surrounding environment of a user of the wearable head device;
determining an image based on the sensor data, the image corresponding to the surrounding environment;
enhancing a visibility of a first portion of the image corresponding to a first portion of the surrounding environment;
forgoing enhancing a visibility of a second portion of the image corresponding to a second portion of the surrounding environment; and
presenting, concurrently via the see-through display, the enhanced first portion of the image and a see-through view of the second portion of the surrounding environment, wherein presenting the enhanced first portion comprises presenting the enhanced first portion at a region of the see-through display determined based on a position of an eye of the user relative to a field of view of the see-through display.

### Claim 9 (depends on 8)

The wearable system of claim 8, wherein enhancing a visibility of a first portion of the image comprises increasing one or more of a contrast of the first portion of the image, a brightness of the first portion of the image, a sharpness of the first portion of the image, and a color saturation of the first portion of the image.

### Claim 10 (depends on 8)

The wearable system of claim 8, wherein enhancing a visibility of a first portion of the image comprises changing a focus distance of the first portion of the image.

### Claim 11 (depends on 10)

The wearable system of claim 10, wherein the focus distance is determined based on an ophthalmic characteristic of the eye.

### Claim 12 (depends on 8)

The wearable system of claim 8, wherein enhancing the visibility of a first portion of the image comprises adjusting one or more digital code values corresponding to one or more pixels of the first portion of the image.

### Claim 13 (depends on 12)

The wearable system of claim 12, wherein enhancing the visibility of the first portion of the image further comprises increasing code values that exceed a predetermined threshold and decreasing code values that do not exceed the predetermined threshold.

### Claim 14 (depends on 12)

The wearable system of claim 12, wherein enhancing the visibility of the first portion of the image further comprises increasing luma for pixels that have luma values above a predetermined threshold and decreasing luma for pixels that have luma values below the predetermined threshold.

### Claim 15

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving, via one or more sensors of a wearable head device comprising a see-through display, sensor data indicative of a surrounding environment of a user of the wearable head device;
determining an image based on the sensor data, the image corresponding to the surrounding environment;
enhancing a visibility of a first portion of the image corresponding to a first portion of the surrounding environment;
forgoing enhancing a visibility of a second portion of the image corresponding to a second portion of the surrounding environment; and
presenting, concurrently via the see-through display of the wearable head device, the enhanced first portion of the image and a see-through view of the second portion of the surrounding environment,
wherein presenting the enhanced first portion comprises presenting the enhanced first portion at a region of the see-through display determined based on a position of an eye of the user relative to a field of view of the see-through display.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein enhancing a visibility of a first portion of the image comprises increasing one or more of a contrast of the first portion of the image, a brightness of the first portion of the image, a sharpness of the first portion of the image, and a color saturation of the first portion of the image.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein enhancing a visibility of a first portion of the image comprises changing a focus distance of the first portion of the image.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the focus distance is determined based on an ophthalmic characteristic of the eye.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein enhancing the visibility of a first portion of the image comprises adjusting one or more digital code values corresponding to one or more pixels of the first portion of the image.

### Claim 20 (depends on 19)

The non-transitory computer-readable medium of claim 19, wherein enhancing the visibility of the first portion of the image further comprises increasing code values that exceed a predetermined threshold and decreasing code values that do not exceed the predetermined threshold.