US 10,706,892 B2Granted

Method and apparatus for finding and using video portions that are relevant to adjacent still images

AssigneeApple Inc.

InventorsClaus Molgaard, Brett M. Keating, George E. Williams, Marco Zuliani, Vincent Y. Wong, Frank Doepke, Ethan J. Tira-Thompson

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

The invention relates to systems, methods, and computer readable media for responding to a user snapshot request by capturing anticipatory pre-snapshot image data as well as post-snapshot image data. The captured information may be used, depending upon the embodiment, to create archival image information and image presentation information that is both useful and pleasing to a user. The captured information may automatically be trimmed or edited to facilitate creating an enhanced image, such as a moving still image. Varying embodiments of the invention offer techniques for trimming and editing based upon the following: exposure, brightness, focus, white balance, detected motion of the camera, substantive image analysis, detected sound, image metadata, and/or any combination of the foregoing.

Claims20

Dependent claims

A method of producing an enhanced image comprising:

capturing a first plurality of images, wherein the first plurality of images comprises:
a snapshot image, wherein the snapshot image is captured in response to receiving a snapshot indication through a user interface;
a pre-capture image sequence, wherein the pre-capture image sequence comprises a plurality of images captured prior to capturing the snapshot image, and wherein the snapshot indication is received after capturing at least one of the plurality of images of the pre-capture image sequence;
and
a post-capture image sequence, wherein the post-capture image sequence comprises a plurality of images captured after capturing the snapshot image;
obtaining motion information for each of the first plurality of images;
identifying a first subset of images from among the pre-capture image sequence that meet a first motion criterion, wherein the first motion criterion comprises a comparison between the motion information of a respective image of the pre-capture image sequence and the motion information of the snapshot image;
identifying a second subset of images from among the post-capture image sequence that meet a second motion criterion, wherein the second motion criterion comprises a comparison between the motion information of a respective image of the post-capture image sequence and the motion information of the snapshot image;
and
creating an enhanced image comprising the snapshot image, the first subset of images, and the second subset of images.

7 more elements

A non-transitory computer readable medium having stored thereon a program, the program comprising one or more instructions that, when executed by a processor, cause the processor to:

capture a first plurality of images, wherein the first plurality of images comprises:
a snapshot image, wherein the snapshot image is captured in response to receiving a snapshot indication through a user interface;
a pre-capture image sequence, wherein the pre-capture image sequence comprises a plurality of images captured prior to capturing the snapshot image, and wherein the snapshot indication is received after capturing at least one of the plurality of images of the pre-capture image sequence;
and
a post-capture image sequence, wherein the post-capture image sequence comprises a plurality of images captured after capturing the snapshot image;
obtain motion information for each of the first plurality of images;
identify a first subset of images from among the pre-capture image sequence that meet a first motion criterion, wherein the first motion criterion comprises a comparison between the motion information of a respective image of the pre-capture image sequence and the motion information of the snapshot image;
identify a second subset of images from among the post-capture image sequence that meet a second motion criterion, wherein the second motion criterion comprises a comparison between the motion information of a respective image of the post-capture image sequence and the motion information of the snapshot image;
and
create an enhanced image comprising the snapshot image, the first subset of images, and the second subset of images.

7 more elements

A system comprising:

one or more CPUs;
one or more cameras for capturing images;
and
a memory for storing program instructions for the one or more CPUs, wherein the instructions, when executed, cause the one or more CPUs to:
capture a first plurality of images, wherein the first plurality of images comprises:
a snapshot image, wherein the snapshot image is captured in response to receiving a snapshot indication through a user interface;
a pre-capture image sequence, wherein the pre-capture image sequence comprises a plurality of images captured prior to capturing the snapshot image, and wherein the snapshot indication is received after capturing at least one of the plurality of images of the pre-capture image sequence;
and
a post-capture image sequence, wherein the post-capture image sequence comprises a plurality of images captured after capturing the snapshot image;
obtain motion information for each of the first plurality of images;
identify a first subset of images from among the pre-capture image sequence that meet a first motion criterion, wherein the first motion criterion comprises a comparison between the motion information of a respective image of the pre-capture image sequence and the motion information of the snapshot image;
identify a second subset of images from among the post-capture image sequence that meet a second motion criterion, wherein the second motion criterion comprises a comparison between the motion information of a respective image of the post-capture image sequence and the motion information of the snapshot image;
and
create an enhanced image comprising the snapshot image, the first subset of images, and the second subset of images.

11 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/199,645Filed 26 Nov 2018 · continuation
Priority: 7 Jun 2015
Published: US 2019/0096441 A128 Mar 2019
Granted: 7 Jul 2020
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

H04N 5/2621
Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the…:…
G06V 20/41
In video content: higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian…
G06V 40/168
Human faces, e.g. facial parts, sketches or expressions: feature extraction; Face representation
G11B 27/34
Indexing; Addressing; Timing or synchronising; Measuring tape travel: indicating arrangements

Family

Application62/172,107Us provisional application · filed 7 Jun 2015
Application14/865,752Parent of this continuation · filed 25 Sep 2015
US 2019/0096441 A1Pre-grant publication · published 28 Mar 2019
US 10,170,157 B2Parent of this continuation
US 2016/0358634 A1Published application
US 10,706,892 B2This patent

From the US filing history. Foreign family members aren’t listed.