# US 2024/0144971 A1 · System and Method for Performing a Rewind Operation with a Mobile Image Capture Device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0144971 A1
- Document ID: US20240144971A1
- Status: Published application
- Kind: A1
- Application number: 18/503,746
- Filed: 2023-11-07
- Published: 2024-05-02
- Earliest claimed: 2020-11-05
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Donald A. Barnett; David Karam; Anton Vayvod; Aaron Michael Donsbach
- Web page: https://patentgrep.com/patent/US20240144971A1

## CPC

- G11B 27/005: {Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783)}
- H04N 23/62: Control of parameters via user interfaces
- G11B 20/10527: {Audio or video recording; Data buffering arrangements (G11B20/12 - G11B20/18 take precedence)}
- H04N 23/63: by using electronic viewfinders
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- G11B 2020/10537: {Audio or video recording}
- G11B 2020/10638: {First-in-first-out memories [FIFO] buffers}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A mobile image capture device is provided that can include an image capture system operable to capture image frames and be configured to: provide a live video stream for display in a viewfinder portion of a user interface that depicts at least a portion of a current field of view of the image capture system; store a video segment from the live video stream in a temporary image buffer that includes a plurality of image frames captured by the image capture system; receive a user input that is directed to the viewfinder portion of the user interface that requests a rewind operation; and, in response to such user input, perform the rewind operation in the viewfinder portion of the user interface with respect to the video segment in which at least two of the image frames of the video segment can be provided for display in the user interface in a reverse chronological order.

## Claims

### Claim 1

A mobile image capture device, comprising:
an image capture system operable to capture image frames;
one or more processors; and
one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:
providing a live video stream for display in a viewfinder portion of a user interface, the live video stream depicting at least a portion of a current field of view of the image capture system of the mobile image capture device;
storing a video segment from the live video stream in a temporary image buffer, wherein the video segment comprises a plurality of image frames captured by the image capture system;
receiving a user input that is directed to the viewfinder portion of the user interface and that requests a rewind operation; and
in response to receipt of the user input that requests the rewind operation, performing the rewind operation in the viewfinder portion of the user interface with respect to the video segment, wherein during the rewind operation at least two of the image frames of the video segment are provided for display in the user interface in a reverse chronological order.

### Claim 2 (depends on 1)

The mobile image capture device of claim 1, wherein the operations further comprise:
receiving a user selection of one of the image frames; and
storing the selected image frame into a non-temporary memory location.

### Claim 3 (depends on 1)

The mobile image capture device of claim 1, wherein:
the user input has a speed; and
performing the rewind operation comprises transitioning the user interface between display of a first image frame of the video segment to display of at least a second image frame of the video segment at a speed that is positively correlated to the speed of the user input.

### Claim 4 (depends on 1)

The mobile image capture device of claim 1, wherein the video segment from the live video stream is stored in the temporary image buffer in a first-in-first-out (FIFO) configuration associated with a moving time window.

### Claim 5 (depends on 1)

The mobile image capture device of claim 1, further comprising a touch-sensitive display screen that displays the user interface, and wherein the user input comprises a user touch action with respect to the touch-sensitive display screen.

### Claim 6 (depends on 5)

The mobile image capture device of claim 5, wherein performing the rewind operation comprises performing a scrubbing operation in response to movement of the user input.

### Claim 7 (depends on 1)

The mobile image capture device of claim 1, wherein the operations comprise displaying a rewind strip during the rewind operation.

### Claim 8 (depends on 1)

The mobile image capture device of claim 1, wherein the live video stream comprises a composite environmental stream generated from a plurality of live video streams.

### Claim 9 (depends on 1)

The mobile image capture device of claim 1, wherein performing the rewind operation comprises providing the video segment for display in the user interface in a reverse chronological order.

### Claim 10 (depends on 1)

The mobile image capture device of claim 1, further comprising a machine-learned image selection model configured to receive the plurality of image frames of the video segment, and, in response to receipt of the plurality of image frames, output a frame selection set that describes a selection of at least one of the plurality of image frames, and wherein the operations further comprise:
inputting the plurality of image frames of the video segment into the machine-learned image selection model;
receiving, as an output of the machine-learned image selection model, the frame selection set; and
providing a selection suggestion for display in the user interface, the selection suggestion including at least one of the image frames described by the frame selection set.

### Claim 11 (depends on 1)

The mobile image capture device of claim 1, wherein the operations further comprise:
receiving a user input that requests the live video stream switch from a first source to a second source; and
in response to receipt of the user input that requests the live video stream to switch from the first source to the second source, switching the live video stream from the first source to the second source.

### Claim 12 (depends on 1)

The mobile image capture device of claim 1, wherein the video segment is automatically stored from the live video stream in the temporary image buffer as soon as a camera application is opened.

### Claim 13 (depends on 12)

The mobile image capture device of claim 12, the camera application is operable in at least an image capture mode and a video capture mode, and wherein video segment is automatically stored from the live video stream when the camera application is in the image capture mode or the video capture mode.

### Claim 14

A mobile image capture device, comprising:
an image capture system operable to capture image frames from a plurality of sources, each source having a respective field of view;
one or more processors; and
one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:
providing a live video stream for display in a viewfinder portion of a user interface, the live video stream comprising a composite environmental stream generated from the plurality of sources;
storing a video segment from the live video stream in a temporary image buffer, wherein the video segment comprises a plurality of image frames captured by the image capture system;
receiving a user input that is directed to the viewfinder portion of the user interface and that requests a rewind operation; and
in response to receipt of the user input that requests the rewind operation, performing a rewind operation in the viewfinder portion of the user interface with respect to the video segment, wherein during the rewind operation at least two of the image frames of the video segment are provided for display in a user interface in a reverse chronological order.

### Claim 15 (depends on 14)

The mobile image capture device of claim 14, wherein:
providing the live video stream for display in the viewfinder portion of the user interface comprises displaying a primary live video stream and a secondary live video stream, the primary live video stream displayed larger than the secondary live video stream;
displaying the primary live video stream comprises displaying images from a first source of the plurality of sources; and
displaying the secondary live video stream comprises displaying images from a second source of the plurality of sources.

### Claim 16 (depends on 14)

The mobile image capture device of claim 14, wherein:
providing the live video stream for display in the viewfinder portion of the user interface comprises displaying a primary live video stream larger than a secondary live video stream; and
displaying the primary live video stream comprises automatically switching between displaying images from a first source of the plurality of sources to displaying images from a second source of the plurality of sources.

### Claim 17 (depends on 16)

The mobile image capture device of claim 16, wherein the first source of the plurality of sources comprises a front-facing camera, and wherein the second source of the plurality of sources comprises a rearward-facing camera.

### Claim 18

A method for performing a rewind operation, the method comprising:
providing, by one or more computing devices, a live video stream for display in a viewfinder portion of a user interface, the live video stream depicting at least a portion of a current field of view of an image capture system;
storing, by the one or more computing devices, a video segment from the live video stream in a temporary image buffer, wherein the video segment comprises a plurality of image frames captured by the image capture system;
receiving, by the one or more computing devices, a user input that is directed to the viewfinder portion of the user interface and that requests a rewind operation; and
in response to receipt of the user input that requests the rewind operation, performing, by the one or more computing devices, the rewind operation in the viewfinder portion of the user interface with respect to the video segment, wherein during the rewind operation at least two of the image frames of the video segment are provided for display in the user interface in a reverse chronological order.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
receiving, by the one or more computing devices, a user selection of one of the image frames; and
storing, by the one or more computing devices, the selected image frame into a non-temporary memory location.

### Claim 20 (depends on 18)

The method of claim 18, performing the rewind operation comprises transitioning the user interface between display of a first image frame of the video segment to display of at least a second image frame of the video segment at a speed that is positively correlated to a speed of the user input.
