# US 2017/0289488 A1 · Heads down intelligent display and processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0289488 A1
- Document ID: US20170289488A1
- Status: Published application
- Kind: A1
- Application number: 15/475,945
- Filed: 2017-03-31
- Published: 2017-10-05
- Earliest claimed: 2016-03-31
- Assignees: Peter G. Hartwell
- Inventors: Peter G. Hartwell
- Web page: https://patentgrep.com/patent/US20170289488A1

## CPC

- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- G03B 17/565: {Optical accessories, e.g. converters for close-up photography, tele-convertors, wide-angle convertors}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06F 3/147: using display panels
- H04M 1/0264: {for a camera module assembly}
- H04N 23/63: by using electronic viewfinders
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06V 30/142: using hand-held instruments; Constructional details of the instruments
- G09G 2340/125: wherein one of the images is motion video
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Techniques provided for using hardware and software to modify a mobile device to improve the safety and awareness of a user to their environmental surroundings. One embodiment of the invention is to update mobile device applications to include live video using the built in rear camera of area ahead of the user as background image. Rear camera would normally be viewing ground, so an embodiment includes a custom case or other attachment to the mobile device with a mirror to allow rear camera to view area ahead. The case or attachment positions the mirror relative to the camera and has an adjustable angle to achieve the correct field of view for the way (or posture) the user is holding the mobile device.

## Claims

### Claim 1

A method comprising:
displaying on a screen of a mobile device an interface of an application that is executing on the mobile device; and
concurrently with displaying the interface on the screen, displaying on the screen at least a portion of a live feed captured by a lens, of a camera of the mobile device, that is pointed at a mirror of a forward viewing system that is connected to the mobile device;
wherein the forward viewing system positions the mirror at an angle that allows a forward view to be seen through the lens when the mobile device is held at an angle of 75 degrees or less relative to ground.

### Claim 2 (depends on 1)

The method of claim 1, wherein displaying the portion of the live feed is performed by displaying the live feed as background while displaying the interface of the application as foreground.

### Claim 3 (depends on 1)

The method of claim 1, wherein displaying the portion of the live feed is performed by displaying a split screen where one part of the screen includes the live feed while another part of the screen includes the interface of the application.

### Claim 4 (depends on 1)

The method of claim 1 further comprising:
causing the mobile device to automatically detect potential hazards in the live feed; and
causing the mobile device to automatically generate an alert in response to detecting a potential hazard in the live feed.

### Claim 5 (depends on 1)

The method of claim 1 further comprising causing the mobile device to outline images of objects detected in the live feed.

### Claim 6 (depends on 5)

The method of claim 5 further comprising causing the mobile device to classify objects detected in the live feed, wherein images are outlined based, at least in part, on how the corresponding objects have been classified.

### Claim 7 (depends on 1)

The method of claim 1 further comprising causing the mobile device to turn on and off the display of the live feed based, at least in part, on contents of the live feed.

### Claim 8 (depends on 1)

The method of claim 1 further comprising causing the mobile device to turn on and off the display of the live feed based, at least in part, on whether the mobile device is in motion.

### Claim 9 (depends on 1)

The method of claim 1 further comprising causing the mobile device to detect and generate alerts relating to particular items or persons in the live feed.

### Claim 10 (depends on 1)

The method of claim 1 further comprising causing the mobile device to emit an infra-red light and causing the mobile device generate alerts for potential hazards that are detected by the mobile device based, at least in part, on the infra-red light.

### Claim 11 (depends on 1)

The method of claim 1 further comprising causing the mobile device to use one or more range finding sensors, in combination with the live feed, to detect potential hazards, and to generate alerts responsive to detecting potential hazards.

### Claim 12 (depends on 1)

The method of claim 1 further comprising changing transparency of the interface on a continuum from opaque to transparent based on at least one of: number of objects detected in the live feed, or distance from the mobile device of objects detected in the live feed.

### Claim 13

A forward viewing system for use with a mobile device that comprises a camera, wherein the forward viewing system includes a mirror disposed at an angle that allows a forward view to be seen through a lens of the camera when the mobile device is held at an angle of 76 degrees or less relative to ground.

### Claim 14 (depends on 13)

The mobile device accessory of claim 13 wherein the mirror is rotatably mounted.

### Claim 15 (depends on 13)

The mobile device accessory of claim 13 further comprising means for transitioning the mirror between an open position and a closed position responses to flip-of-the-wrist motions.

### Claim 16 (depends on 13)

The mobile device accessory of claim 13 wherein the mirror is held at an angle relative to the mobile device accessory with a tether.

### Claim 17

A mobile device having a camera and a lens through which the camera captures images, wherein the mobile device includes a screen and software for displaying a live video feed captured by the camera on the screen, wherein the lens is rotatably mounted on the mobile device to enable a forward view to be seen through a lens of the camera when the mobile device is held at an angle of 76 degrees or less relative to ground.
