# US 2021/0243363 A1 · Enhanced Image Capture

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243363 A1
- Document ID: US20210243363A1
- Status: Published application
- Kind: A1
- Application number: 17/234,257
- Filed: 2021-04-19
- Published: 2021-08-05
- Earliest claimed: 2014-05-21
- Assignees: Google Technology Holdings LLC
- Applicants: Google Technology Holdings LLC
- Inventors: Doina I. Petrescu; Thomas T. Lay; Steven R. Petrie; Bill Ryan; Snigdha Sinha; Jeffrey S. Vanhoof
- Web page: https://patentgrep.com/patent/US20210243363A1

## CPC

- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N 1/00: Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N 1/00244: {with a server, e.g. an internet server (fax-servers or the like for store and forward H04N1/324)}
- H04N 1/21: Intermediate information storage (H04N1/387, H04N1/41 take precedence {; for control between transmitter and receiver or between image input and image output device H04N1/32358; indexing, editing G11B27/00})
- H04N 1/212: {Motion video recording combined with still video recording (television signal recording H04N5/76)}
- H04N 1/2145: {of a sequence of images for selection of a single frame before final recording, e.g. from a continuous sequence captured before and after shutter-release}
- H04N 1/215: {Recording a sequence of still pictures, e.g. burst mode}
- H04N 23/60: Control of cameras or camera modules
- H04N 23/61: based on recognised objects
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/63: by using electronic viewfinders
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/6811: {based on the image signal}
- H04N 23/6812: {based on additional sensors, e.g. acceleration sensors}
- H04N 23/683: {performed by a processor, e.g. controlling the readout of an image memory}
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04N 2201/3247: Data linking a set of images to one another, e.g. sequence, burst or continuous capture mode
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed are techniques that provide a “best” picture taken within a few seconds of the moment when a capture command is received (e.g., when the “shutter” button is pressed). In some situations, several still images are automatically (that is, without the user's input) captured. These images are compared to find a “best” image that is presented to the photographer for consideration. Video is also captured automatically and analyzed to see if there is an action scene or other motion content around the time of the capture command. If the analysis reveals anything interesting, then the video clip is presented to the photographer. The video clip may be cropped to match the still-capture scene and to remove transitory parts. Higher-precision horizon detection may be provided based on motion analysis and on pixel-data analysis.

## Claims

### Claim 1

A method comprising:
capturing, simultaneously by an image-capture device, a video segment and a sequence of still images;
determining, by the image-capture device, that the video segment is of interest to a user of the image-capture device;
determining, by the image-capture device, that a first score of a quality characteristic for a first still image from the sequence of still images is greater than a second score of the quality characteristic for a second still image from the sequence of still images; and
presenting, by the image-capture device, the video segment and the first still image.

### Claim 2 (depends on 1)

The method of claim 1, wherein capturing the video segment and the sequence of still images is in temporal proximity to a capture command received by the image-capture device.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining that the video segment is of interest is based, at least in part, on motion content of the video segment.

### Claim 4 (depends on 3)

The method of claim 3, further comprising processing the video segment using image-stabilization techniques.

### Claim 5 (depends on 3)

The method of claim 3, further comprising processing the video segment to remove transitory portions of the video segment.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining that the video segment is of interest to the user is based, at least in part, on a region of interest within the video segment.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining that the first score is greater than the second score is based, at least in part, on face detection information.

### Claim 8 (depends on 1)

The method of claim 1, wherein determining that the first score is greater than the second score is based, at least in part, on a past behavior of the user.

### Claim 9 (depends on 1)

The method of claim 1, wherein determining that the first score is greater than the second score is based, at least in part, on motion-sensor data recorded by the image-capture device.

### Claim 10 (depends on 1)

The method of claim 1, wherein presenting the first still image includes presenting the first still image using a gallery mode.

### Claim 11 (depends on 10)

The method of claim 10, wherein presenting the first still image includes surrounding the first still image with a border to highlight the first still image.

### Claim 12 (depends on 1)

The method of claim 1, wherein the sequence of still images corresponds to frames of the video segment.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
receiving, from the user of the image-capture device, a selection of the first still image; and
transmitting, to a server, metadata associated with the selection of the first still image.

### Claim 14

An image-capture device comprising:
a display; and
a processing system configured to direct the image-capture device to:
capture, simultaneously, a video segment and a sequence of still images;
determine that the video segment is of interest to a user of the image-capture device;
determine that a first score of a quality characteristic of a first still image from the sequence of still images is greater than a second score of the quality characteristic for a second still image from the sequence of still images; and
present, using the display, the video segment and the first still image.

### Claim 15 (depends on 14)

The image-capture device of claim 14, wherein the image-capture device is a cellphone, a camera, or a tablet.

### Claim 16 (depends on 14)

The image-capture device of claim 14, further comprising:
a communication interface operatively connected to the processing system and configured to communicate with a server that is remote from the image-capture device.

### Claim 17 (depends on 16)

The image-capture device of claim 16, wherein the processing system is further configured to direct the image-capture device to:
receive a recommendation from the server; and
determine that the first score is greater than the second score based, least in part, on the recommendation.

### Claim 18 (depends on 16)

The image-capture device of claim 16, wherein the processing system is further configured to direct the image-capture device to:
transmit, to the server, metadata associated with the capture of the video segment and the sequence of still images.

### Claim 19 (depends on 14)

The image-capture device of claim 14, further comprising:
a motion-detection sensor to detect a movement or a position of the image-capture device and wherein the processing system is further configured to direct the image-capture device to:
determine that the video segment is of interest based, at least in part, on a detected movement or position of the image-capture device.

### Claim 20 (depends on 14)

The image capture device of claim 14, further comprising:
a motion-detection sensor to detect a movement or a position of the image-capture device and wherein the processing system is further configured to direct the image-capture device to:
determine that the first score is greater than a second score based, at least in part, on a detected movement or position of the image-capture device.
