# US 2023/0419996 A1 · Advanced video editing techniques using sampling patterns

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0419996 A1
- Document ID: US20230419996A1
- Status: Published application
- Kind: A1
- Application number: 18/243,487
- Filed: 2023-09-07
- Published: 2023-12-28
- Earliest claimed: 2017-08-30
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Nathan Kenneth Boyd; Devin Doty
- Web page: https://patentgrep.com/patent/US20230419996A1

## CPC

- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V 20/49: {Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes}
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally}
- H04N 21/8549: Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods provide for advanced video editing techniques using sampling patterns. In one example, a computing device can receive a selection of a clip of a video and a sampling pattern. The computing device can determine a respective number of frames to sample from the clip for each interval of time over a length of time for a new clip. For example, the computing device can determine a function corresponding the pattern that relates time and the number of frames to sample, a histogram corresponding to the pattern, or a definite integral corresponding to the pattern, among other approaches. The computing device can extract these numbers of frames from the clip and generate the new clip from the extracted frames. The computing device can present the new clip as a preview and send the new clip to other computing devices.

## Claims

### Claim 1

A method comprising:
determining, by a computing device, individual numbers of frames to sample from a first video clip for a plurality of intervals of time based on a pattern for sampling the first video clip, the determining comprising evaluating a function, the function corresponding to the pattern over the plurality of intervals of time, the function relating a time value and a number of frames to sample from the first video clip at the time value, the pattern being associated with a video effect being applied to the first video clip;
removing, by the computing device, one or more duplicate frames from the first video clip to produce a second video clip;
extracting, by the computing device, a plurality of frames of the second video clip using the individual numbers of frames; and
generating, by the computing device, a third video clip based on the plurality of frames.

### Claim 2 (depends on 1)

The method of claim 1, wherein the number of frames at the time value is less than a frame rate of the first video clip and the function causes the first video clip to be sub-sampled at the time value.

### Claim 3 (depends on 1)

The method of claim 1, wherein the number of frames at the time value is greater than a frame rate of the first video clip and the function causes given frames of the first video clip at the time value to be interpolated.

### Claim 4 (depends on 3)

The method of claim 3, wherein the given frames of the first video clip at the time value are interpolated by repeating one or more of the given frames.

### Claim 5 (depends on 3)

The method of claim 3, wherein the given frames of the first video clip at the time value are interpolated by merging at least two of the given frames.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
displaying, on a display screen of the computing device, a selection bar and a selection slider; and
determining a selection of the first video clip from a video based on a position of the selection slider relative to the selection bar.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
determining a relative length of the selection slider with respect to the selection bar based on a relationship between a first length of time of the first video clip and a second length of time of the first video clip.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
receiving an adjustment factor for determining a second length of time of the second video clip relative to a first length of time of the first video clip, the plurality of intervals of time occurring within the second length of time.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
displaying, on a display screen of the computing device, a plurality of predetermined sampling patterns; and
receiving the pattern from one of the plurality of predetermined sampling patterns.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
displaying, on a display screen of the computing device, a drawing interface; and
receiving the pattern as a drawing from the drawing interface.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
generating a fourth video clip by reversing the plurality of frames; and
presenting the second video clip and the fourth video clip on a display screen of the computing device.

### Claim 12 (depends on 1)

The method of claim 1, wherein the individual numbers of frames are first individual numbers of frames, wherein the pattern is a first pattern, and wherein the method further comprises:
receiving, at the computing device, a user input identifying a selection of a second pattern for sampling the first video clip;
determining second individual numbers of frames to sample from the first video clip for a second plurality of intervals of time using the second pattern;
extracting a second plurality of frames of the first video clip using the second individual numbers of frames; and
generating a fourth video clip using the second plurality of frames.

### Claim 13

A device comprising:
one or more processors; and
memory including instructions that, upon execution by the one or more processors, cause the device to perform operations comprising:
determining individual numbers of frames to sample from a first video clip for a plurality of intervals of time based on a pattern for sampling the first video clip, the determining comprising evaluating a function, the function corresponding to the pattern over the plurality of intervals of time, the function relating a time value and a number of frames to sample from the first video clip at the time value, the pattern being associated with a video effect being applied to the first video clip;
removing one or more duplicate frames from the first video clip to produce a second video clip;
extracting a plurality of frames of the second video clip using the individual numbers of frames; and
generating a third video clip based on the plurality of frames.

### Claim 14 (depends on 13)

The device of claim 13, wherein the number of frames at the time value is less than a frame rate of the first video clip and the function causes the first video clip to be sub-sampled at the time value.

### Claim 15 (depends on 13)

The device of claim 13, wherein the number of frames at the time value is greater than a frame rate of the first video clip and the function causes given frames of the first video clip at the time value to be interpolated.

### Claim 16 (depends on 15)

The device of claim 15, wherein the given frames of the first video clip at the time value are interpolated by repeating one or more of the given frames.

### Claim 17 (depends on 15)

The device of claim 15, wherein the given frames of the first video clip at the time value are interpolated by merging at least two of the given frames.

### Claim 18 (depends on 13)

The device of claim 13, wherein the operations further comprise:
displaying one or more user interface elements on a touchscreen of the device; and
receive, at the touchscreen, a length of time for the second video clip from the one or more user interface elements, the plurality of intervals of time occurring within the length of time.

### Claim 19 (depends on 13)

The device of claim 13, wherein the individual numbers of frames are first individual numbers of frames, wherein the plurality of intervals is a first plurality of intervals, and wherein the operations further comprise:
receiving, at a touchscreen of the device, a selection of a second pattern for sampling the first video clip;
determining second individual numbers of frames to sample from the first video clip for a second plurality of intervals of time using the second pattern;
extracting a second plurality of frames of the first video clip using the second individual numbers of frames; and
generating a fourth video clip using the second plurality of frames.

### Claim 20

A non-transitory computer-readable storage medium storing instructions that, upon execution by one or more processors of a device, cause the device to perform operations comprising:
determining individual numbers of frames to sample from a first video clip for a plurality of intervals of time based on a pattern for sampling the first video clip, the determining comprising evaluating a function, the function corresponding to the pattern over the plurality of intervals of time, the function relating a time value and a number of frames to sample from the first video clip at the time value, the pattern being associated with a video effect being applied to the first video clip;
removing one or more duplicate frames from the first video clip to produce a second video clip;
extracting a plurality of frames of the second video clip using the individual numbers of frames; and
generating a third video clip based on the plurality of frames.
