# US 2013/0293732 A1 · Imaging systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0293732 A1
- Document ID: US20130293732A1
- Status: Published application
- Kind: A1
- Application number: 13/875,100
- Filed: 2013-05-01
- Published: 2013-11-07
- Earliest claimed: 2012-05-03
- Assignees: Aptina Imaging Corporation
- Applicants: Aptina Imaging Corporation
- Inventors: Satish Kumar Bhrugumalla
- Web page: https://patentgrep.com/patent/US20130293732A1

## CPC

- G09G 5/30: Control of display attribute
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/63: by using electronic viewfinders
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An electronic device may have one or more imaging sensors. The imaging sensors may be used in combination with an optional mechanical gesture to analyze the lighting conditions of the environment around the electronic device. The electronic device may set auto-exposure, auto-white balance, and auto-focus settings based on the analysis. The electronic device may include a shaped display. The imaging sensors may be used in calibration of a projector for the shaped display and may be used in sending touch inputs associated with the shaped display. The electronic device may be able to capture a photograph during video capture. The electronic device may generate a display screen that identifies which portions of the scene being imaged correspond to the video and which portions correspond to the photograph.

## Claims

### Claim 1

An electronic device, comprising:
a non-planar display screen;
a projector that projects images onto the non-planar display screen; and
at least one image sensor that is sensitive to user inputs associated with the non-planar display screen.

### Claim 2 (depends on 1)

The electronic device defined in claim 1 further comprising:
warping and dewarping circuitry, wherein the at least one image sensor provides image signals to the dewarping circuitry, wherein the warping circuitry provide display signals to the projector; and

### Claim 3 (depends on 2)

The electronic device defined in claim 2 further comprising:
processing circuitry that analyzes the image signals from the at least one image sensor to calibrate the warping and dewarping circuitry.

### Claim 4 (depends on 1)

The electronic device defined in claim 1 wherein the at least one image sensor comprises a pair of image sensors configured for stereo imaging and wherein the pair of image sensors detect are sensitive to user inputs in a space in front of the non-planar display screen.

### Claim 5 (depends on 1)

The electronic device defined in claim 1 wherein the at least one image sensor is sensitive to user touch inputs on a first surface of the non-planar display screen.

### Claim 6 (depends on 5)

The electronic device defined in claim 5 wherein the projector and the at least one image sensor are located on a side of the non-planar display screen opposite the first surface of the non-planar display screen.

### Claim 7 (depends on 1)

The electronic device defined in claim 1 wherein the non-planar display screen forms at least a part of a dashboard of an automobile.

### Claim 8

A method, comprising:
with an electronic device, prompting a user to perform a mechanical gesture including at least a rotation of the electronic device;
with at least one image sensor in the electronic device and during the mechanical gesture, capturing image data of an environment around the electronic device;
with image processing circuitry in the electronic device, identifying lighting characteristics of the environment based on the image data;
with circuitry in the electronic device, determining imaging settings based on the identified lighting characteristics; and
with the at least one image sensor, capturing an image using the determined imaging settings.

### Claim 9 (depends on 8)

The method defined in claim 8 wherein the lighting characteristics comprises at least one lighting characteristic selected from the group consisting of: a location of a light source, a color temperature of the light source, a color profile of the light source, an intensity of the light source, and a relative velocity of the light source.

### Claim 10 (depends on 8)

The method defined in claim 8 wherein the determined imaging settings comprise at least one imaging setting selected from the group consisting of: an auto-white balance setting, an auto-exposure setting, and an auto-focus setting.

### Claim 11 (depends on 8)

The method defined in claim 8 wherein prompting the user to perform the mechanical gesture comprises:
with the electronic device, prompting the user to rotate the electronic device in approximately a full circle.

### Claim 12 (depends on 8)

The method defined in claim 8 wherein the at least one image sensor comprises a first image sensor on a front side of the electronic device and a second image sensor on a back side of the electronic device and wherein prompting the user to perform the mechanical gesture comprises:
with the electronic device, prompting the user to rotate the electronic device in approximately a half circle about an axis that is approximately parallel to both the front and back sides of the electronic device.

### Claim 13 (depends on 8)

The method defined in claim 8 comprising:
with location sensing circuitry, determining a location of the electronic device; and
storing the determined location together with at least one of the captured image data, identified lighting characteristics, and determined imaging settings in non-volatile storage in the electronic device.

### Claim 14 (depends on 13)

The method defined in claim 13 wherein the location sensing circuitry comprises global positioning system circuitry.

### Claim 15

A system, comprising:
a central processing unit;
memory;
input-output circuitry;
an imaging device that captures video having a first aspect ratio and that captures a photograph having a second aspect ratio, wherein the imaging device captures the photograph between capturing frames of the video;
a display; and
image processing circuitry that receives image data from the imaging device, manipulates portions of the image data associated with the photograph and the second aspect ratio, and provides display data to the display includes at least the manipulated portions of the image data.

### Claim 16 (depends on 15)

The system defined in claim 15 wherein the image processing circuitry manipulates portions of the image data by alpha-blending portions of the photograph that do not overlap the video.

### Claim 17 (depends on 16)

The system defined in claim 16 wherein the image processing circuitry provides display data including portions of the image data associated with the video and the manipulated portions of the image data associated with the photograph and the second aspect ratio.

### Claim 18 (depends on 17)

The system defined in claim 17 wherein display screen displays the portions of the image data associated with the video between first and second portions of the manipulated portions of the image data associated with the photograph and the second aspect ratio.
