# US 2015/0178562 A1 · Environmental Reproduction System for Representing an Environment Using One or More Environmental Sensors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0178562 A1
- Document ID: US20150178562A1
- Status: Published application
- Kind: A1
- Application number: 14/568,943
- Filed: 2014-12-12
- Published: 2015-06-25
- Earliest claimed: 2010-12-22
- Assignees: Google Inc.
- Applicants: Google Inc.
- Inventors: Casey Kwok Ching Ho; Sharvil A. Nanavati
- Web page: https://patentgrep.com/patent/US20150178562A1

## CPC

- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/00: Image enhancement or restoration
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 11/65: on geographic maps
- G06V 30/422: Technical drawings; Geographical maps
- G09B 21/00: Teaching, or communicating with, the blind, deaf or mute (audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B)
- G09B 21/006: {using audible presentation of the information}
- G09B 21/008: {using visual presentation of the information for the partially sighted}
- G09B 21/009: {Teaching or communicating with deaf persons (G09B21/04 takes precedence)}
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20221: Image fusion; Image merging
- H04M 2250/12: including a sensor for measuring a physical value, e.g. temperature or motion
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A environmental reproduction system multiplexes information from a variety of sources to reproduce a target environment having visual and/or auditory impediments. The visual impediments may include one or more environmental conditions, such as rain, sleet, snow, darkness, brightness, or any other type of environmental condition. The auditory impediments may include loud noises, such as construction noises, or sounds that are too low, such as an emergency vehicle sound not being heard. The environmental reproduction system may determine the environmental condition from one or more sources, such as an internal microphone, an external microphone, temperature sensor, a camera, a weather receiver, or other types of sensors. The environmental reproduction may be in communication with an environmental condition database and operative to apply a signal processing action to a recording (video and/or audio recording) of the target environment based on the determined environmental condition.

## Claims

### Claim 1

(canceled)

### Claim 2

A computer-implemented method comprising:
receiving a first image of an object;
determining a geographic location associated with the first image or the object;
determining to enhance an appearance of the object in the first image;
in response to determining to enhance the appearance of the object in the first image, identifying a second image based at least on the geographic location;
generating an enhanced image of the object based at least on the first image and the second image; and
providing the enhanced image for display.

### Claim 3 (depends on 2)

The method of claim 2, wherein determining a geographic location associated with the first image or the object comprises:
obtaining geographic coordinates indicating where the first image of the object was taken.

### Claim 4 (depends on 2)

The method of claim 2, wherein determining to enhance an appearance of the object in the first image comprises:
identifying the object in the first image; and
in response to identifying the object in the first image, determining to enhance the appearance of the object in the first image.

### Claim 5 (depends on 2)

The method of claim 2, wherein determining to enhance an appearance of the object in the first image comprises:
determining that the object is likely to be obscured in the first image; and
in response to determining that the object is likely to be obscured in the first image, determining to enhance the appearance of the object in the first image.

### Claim 6 (depends on 2)

The method of claim 2, wherein in response to determining to enhance the appearance of the object in the first image, identifying a second image based at least on the geographic location, comprises:
identifying the second image as an image stored in association with the geographic location.

### Claim 7 (depends on 2)

The method of claim 2, wherein generating an enhanced image of the object based at least on the first image and the second image comprises:
combining the first image and the second image.

### Claim 8 (depends on 7)

The method of claim 7, wherein combining the first image and the second image comprises:
overlaying a portion of the second image that includes at least a portion of the object over a portion of the first image that includes at least a portion of the object.

### Claim 9

A system comprising:
one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
receiving a first image of an object;
determining a geographic location associated with the first image or the object;
determining to enhance an appearance of the object in the first image;
in response to determining to enhance the appearance of the object in the first image, identifying a second image based at least on the geographic location;
generating an enhanced image of the object based at least on the first image and the second image; and
providing the enhanced image for display.

### Claim 10 (depends on 9)

The system of claim 9, wherein determining a geographic location associated with the first image or the object comprises:
obtaining geographic coordinates indicating where the first image of the object was taken.

### Claim 11 (depends on 9)

The system of claim 9, wherein determining to enhance an appearance of the object in the first image comprises:
identifying the object in the first image; and
in response to identifying the object in the first image, determining to enhance the appearance of the object in the first image.

### Claim 12 (depends on 9)

The system of claim 9, wherein determining to enhance an appearance of the object in the first image comprises:
determining that the object is likely to be obscured in the first image; and
in response to determining that the object is likely to be obscured in the first image, determining to enhance the appearance of the object in the first image.

### Claim 13 (depends on 9)

The system of claim 9, wherein in response to determining to enhance the appearance of the object in the first image, identifying a second image based at least on the geographic location, comprises:
identifying the second image as an image stored in association with the geographic location.

### Claim 14 (depends on 9)

The system of claim 9, wherein generating an enhanced image of the object based at least on the first image and the second image comprises:
combining the first image and the second image.

### Claim 15 (depends on 14)

The system of claim 14, wherein combining the first image and the second image comprises:
overlaying a portion of the second image that includes at least a portion of the object over a portion of the first image that includes at least a portion of the object.

### Claim 16

A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
receiving a first image of an object;
determining a geographic location associated with the first image or the object;
determining to enhance an appearance of the object in the first image;
in response to determining to enhance the appearance of the object in the first image, identifying a second image based at least on the geographic location;
generating an enhanced image of the object based at least on the first image and the second image; and
providing the enhanced image for display.

### Claim 17 (depends on 16)

The medium of claim 16, wherein determining a geographic location associated with the first image or the object comprises:
obtaining geographic coordinates indicating where the first image of the object was taken.

### Claim 18 (depends on 16)

The medium of claim 16, wherein determining to enhance an appearance of the object in the first image comprises:
identifying the object in the first image; and
in response to identifying the object in the first image, determining to enhance the appearance of the object in the first image.

### Claim 19 (depends on 16)

The medium of claim 16, wherein determining to enhance an appearance of the object in the first image comprises:
determining that the object is likely to be obscured in the first image; and
in response to determining that the object is likely to be obscured in the first image, determining to enhance the appearance of the object in the first image.

### Claim 20 (depends on 16)

The medium of claim 16, wherein in response to determining to enhance the appearance of the object in the first image, identifying a second image based at least on the geographic location, comprises:
identifying the second image as an image stored in association with the geographic location.

### Claim 21 (depends on 16)

The medium of claim 16, wherein generating an enhanced image of the object based at least on the first image and the second image comprises:
combining the first image and the second image.
