# US 2017/0249860 A1 · User interface for reading assist

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0249860 A1
- Document ID: US20170249860A1
- Status: Published application
- Kind: A1
- Application number: 15/063,667
- Filed: 2016-03-08
- Published: 2017-08-31
- Earliest claimed: 2016-02-29
- Assignees: Osterhout Group, Inc.
- Applicants: Osterhout Group, Inc.
- Inventors: Ralph F. Osterhout; Ed Riehle; John D. Haddick; John N. Border
- Web page: https://patentgrep.com/patent/US20170249860A1

## CPC

- A61H 3/061: {with electronic detecting or guiding means}
- G02B 7/023: {permitting adjustment}
- G02B 27/0172: {characterised by optical features}
- G02B 27/0176: {characterised by mechanical features}
- G02C 7/088: {Lens systems mounted to spectacles}
- G02C 11/10: {Electronic devices other than hearing aids}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 5/73: Deblurring; Sharpening
- G06T 5/92: based on global image properties
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 10/235: {based on user input or interaction}
- G06V 20/20: in augmented reality scenes
- G06V 20/63: {Scene text, e.g. street names}
- G06V 40/19: Sensors therefor
- G09B 21/008: {using visual presentation of the information for the partially sighted}
- H04N 7/183: {for receiving images from a single remote source}
- H04N 7/185: {from a mobile camera, e.g. for remote control}
- H04N 23/63: by using electronic viewfinders
- H04N 23/682: {Vibration or motion blur correction}
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- A61H 2003/063: {with tactile perception}
- A61H 2201/0188: Illumination related features
- A61H 2201/1604: Head
- A61H 2201/165: Wearable interfaces
- A61H 2201/501: connected to external computer devices or networks
- A61H 2201/5043: Displays
- A61H 2201/5048: Audio interfaces, e.g. voice or music controlled
- A61H 2201/5058: Sensors or detectors
- A61H 2201/5061: Force sensors
- A61H 2201/5064: Position sensors
- A61H 2201/5071: Pressure sensors
- A61H 2201/5082: Temperature sensors
- A61H 2201/5084: Acceleration sensors
- A61H 2201/5092: Optical sensor
- G02B 2027/0127: {comprising devices increasing the depth of field}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0147: {comprising a device modifying the resolution of the displayed image}
- G02B 2027/0156: {with optionally usable elements}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06T 2207/20208: High dynamic range [HDR] image processing
- G06T 2207/20221: Image fusion; Image merging
- A61H: PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY (electrotherapy, magnetotherapy, radiation therapy or ultrasound therapy A61N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Aspects of the present disclosure relate aids for the visually impaired.

## Claims

### Claim 1

An apparatus for reading assistance, comprising:
a. an augmented reality display system;
b. a sensor system positioned in a head-worn computer adapted to capture an image of text proximate a user and further adapted to capture a user gesture made in connection with the text;
c. a processor adapted to identify a computer operation associated with the gesture, wherein the computer operation causes the captured image of the text to be enhanced and presented in the augmented reality display.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the camera captures a wide angle image of the text and the processor applies digital zoom to form the images for presentation.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the camera captures a telephoto image of the text and the processor crops the captured image to form the images for presentation.

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein the gesture is a finger pointed at the text to indicate which text to be included in the formed image for display.

### Claim 5 (depends on 2)

The apparatus of claim 2, wherein the gesture is two fingers pointed at the text to indicate which text to be included in the formed image for display and a relative position of the two fingers indicates how much zoom to be applied to the formed images.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the portion of text that is enhanced changes as the gestures change.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the portion of the text that is enhanced is a line of text.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the portion of the text that is enhanced is a paragraph of text.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the displayed image remains the same regardless of head movement as long as the gesture can be identified.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the words included in the enhanced portion of text are defined words and one or more images related to the definition of words are displayed to the user along with the magnified text.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein if the gesture is removed, the portions of text that have previously been enhanced are highlighted to indicate they have been previously enhanced.
