# US 2016/0253560 A1 · Visibility enhancement devices, systems, and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253560 A1
- Document ID: US20160253560A1
- Status: Published application
- Kind: A1
- Application number: 14/634,367
- Filed: 2015-02-27
- Published: 2016-09-01
- Earliest claimed: 2015-02-27
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Kenji TOKUTAKE
- Web page: https://patentgrep.com/patent/US20160253560A1

## CPC

- G06V 20/20: in augmented reality scenes
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0412: {Digitisers structurally integrated in a display}
- H04M 1/72403: with means for local support of applications that increase the functionality
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- H04N 23/61: based on recognised objects
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/634: {Warning indications}
- G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
- G06V 2201/07: Target detection
- G06V 2201/10: Recognition assisted with metadata
- H04M 2250/52: including functional features of a camera
- H04N 23/635: {Region indicators; Field of view indicators}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments include systems of and methods for an electronic device having a camera configured to capture image data, a display configured to display the captured image data and content corresponding to an application of the electronic device, and a motion sensor configured to detect motion of the electronic device. The electronic device also includes circuitry configured to activate the camera when motion is detected by the motion sensor, and control the display to display at least a portion of the captured image data at a size proportional to an amount of motion as detected by an output of the motion sensor.

## Claims

### Claim 1

An electronic device, comprising:
a camera configured to capture image data;
a display configured to display the captured image data and content corresponding to an application of the electronic device;
a motion sensor configured to detect motion of the electronic device; and
circuitry configured to activate the camera when motion is detected by the motion sensor, and control the display to display at least a portion of the captured image data at a size proportional to an amount of motion as detected by an output of the motion sensor.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the circuitry is further configured to determine whether the detected motion is one of a walking state, a running state, or a vehicle riding state.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the circuitry is further configured to display a captured image of a user's environment on the display when a running state is detected.

### Claim 4 (depends on 2)

The electronic device of claim 2, wherein the circuitry is further configured to display a combined display of a captured transparent image of a user's environment and content of one or more working applications on the display when a walking state is detected, wherein a back layer of the display can be viewed through the captured transparent image.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein the circuitry is further configured to detect an approaching object from the captured image data of the camera and to issue a warning of the approaching object.

### Claim 6 (depends on 5)

The electronic device of claim 5, wherein the circuitry is further configured to detect a motion vector of the approaching object from the captured image data of the camera.

### Claim 7 (depends on 5)

The electronic device of claim 5, wherein the issued warning comprises one or more of an illumination of the approaching object, a flashing approaching object, an audible signal, or a vibratory signal.

### Claim 8 (depends on 1)

The electronic device of claim 1, wherein the motion sensor is further configured to detect a change in a viewing direction of the camera.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the circuitry is further configured to detect the change in viewing direction of the camera and to adjust a motion vector of an approaching object according to the change in viewing direction.

### Claim 10 (depends on 1)

The electronic device of claim 1, wherein the circuitry is further configured to detect an approaching object out of view of the camera based on a time and position of the approaching object from previously captured images.

### Claim 11 (depends on 1)

The electronic device of claim 1, wherein the electronic device comprises a handheld electronic device.

### Claim 12 (depends on 1)

The electronic device of claim 1, wherein the circuitry is further configured to detect a walking state when an acceleration of the electronic device changes from a static state to a first threshold level.

### Claim 13 (depends on 12)

The electronic device of claim 12, wherein the circuitry is further configured to detect a running state when an acceleration of the electronic device changes from the first threshold level to a second threshold level.

### Claim 14 (depends on 13)

The electronic device of claim 13, wherein the circuitry is further configured to detect a vehicle riding state when an acceleration of the electronic device changes from the second threshold level to a third threshold level.

### Claim 15 (depends on 1)

The electronic device of claim 1, wherein the electronic device comprises a head-mounted electronic device.

### Claim 16 (depends on 15)

The electronic device of claim 15, wherein the circuitry is further configured to determine when the electronic device changes a position from a seated user-perspective position to a standing user-perspective position.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein the circuitry is further configured to change the display of the electronic device from a full image of user-selected content while in the seated user-perspective position to a combined image of the user-selected content and a transparent image of the electronic device's surroundings while in the standing user-perspective position, wherein a back layer of the display can be viewed through the transparent image.

### Claim 18 (depends on 16)

The electronic device of claim 16, wherein the circuitry is further configured to determine when the electronic device changes to a walking state and to display a full image of the electronic device's surroundings.

### Claim 19

A displaying method of an electronic device, the displaying method comprising:
detecting via a motion sensor, a motion of the electronic device;
capturing via a camera, image data of a front-view image from the electronic device, subsequent to the detecting;
determining via circuitry to display an amount of the captured image data at a size proportional to an amount of motion as detected by an output of the motion sensor; and
displaying the determined amount of the captured image data on the display.

### Claim 20

A computer-readable storage medium having computer-readable instructions embodied thereon, that when executed by a computing device, executes a method comprising:
detecting via a motion sensor, a motion of the electronic device;
capturing via a camera, image data of a front-view image from the electronic device, subsequent to the detecting;
determining via circuitry to display an amount of the captured image data at a size proportional to an amount of motion as detected by an output of the motion sensor; and
displaying the determined amount of the captured image data on the display.
