# US 2020/0286525 A1 · System And Method For Representing Long Video Sequences

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0286525 A1
- Document ID: US20200286525A1
- Status: Published application
- Kind: A1
- Application number: 16/789,086
- Filed: 2020-02-12
- Published: 2020-09-10
- Earliest claimed: 2008-04-18
- Assignees: Visible World, Inc.
- Applicants: Visible World, LLC
- Inventors: Erik Van de Pol
- Web page: https://patentgrep.com/patent/US20200286525A1

## CPC

- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- G06F 16/739: {in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames}
- G11B 27/105: {of operating discs}
- H04N 5/783: Adaptations for reproducing at a rate different from the recording rate
- H04N 21/4325: {by playing back content from the storage medium (reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and procedures for transforming video into a condensed visual representation. An example procedure may include receiving video comprised of a plurality of frames. For each frame, the example procedure may create a first representation, reduced in one dimension, wherein a visual property of each pixel of the first representation is assigned by aggregating a visual property of the pixels of the frame having the same position in the unreduced dimension. The example procedure may further form a condensed visual representation including the first representations aligned along the reduced dimension according to an order of the frames in the video.

## Claims

### Claim 1

A method comprising:
receiving content comprising a plurality of frames;
condensing the content to determine a condensed visual representation and metadata for each frame of the plurality of frames;
determining, based on the condensed visual representation, a transition or an insertion point in the content; and
causing display of the condensed visual representation and an identifier of the transition or the insertion point relative to the condensed visual representation.

### Claim 2 (depends on 1)

The method of claim 1, wherein condensing the content to determine the condensed visual representation and the metadata for each frame of the plurality of frames comprises:
aggregating, for each frame, a visual property of each of a plurality of pixels in at least one of a horizontal row and a vertical column to form a first representation of each frame; and
aligning the first representation of each frame according to an order of the plurality of frames in the content to determine the condensed visual representation.

### Claim 3 (depends on 2)

The method of claim 2, wherein aggregating the visual property of each of the plurality of pixels comprises averaging the color of each of the plurality of pixels.

### Claim 4 (depends on 3)

The method of claim 3, wherein the metadata for each frame comprises a standard deviation of the colors of the pixels in the frame from the average color.

### Claim 5 (depends on 2)

The method of claim 2, wherein the first representation of each frame is one pixel wide.

### Claim 6 (depends on 1)

The method of claim 1, wherein condensing the content to determine the condensed visual representation and the metadata for each frame of the plurality of frames comprises:
grouping a plurality of pixels of each frame into a block;
aggregating, for each block, a visual property of each of the plurality of pixels; and
replacing the plurality of pixels of each block with the aggregated visual property.

### Claim 7 (depends on 6)

The method of claim 6, wherein grouping the plurality of pixels of each frame into the block comprises grouping the plurality of pixels of each frame into a predetermined number of blocks.

### Claim 8 (depends on 7)

The method of claim 7, wherein the predetermined number of blocks is:
received as a user selection; or
automatically determined based on one of a dimension of the plurality of frames, an amount of visual information contained in each frame, and a visual characteristic of the content.

### Claim 9 (depends on 1)

The method of claim 1, further comprising inserting supplemental content in the content at the determined insertion point in the content.

### Claim 10 (depends on 9)

The method of claim 9, wherein the supplemental content comprises a local advertisement.

### Claim 11 (depends on 1)

The method of claim 1, wherein the metadata for each frame comprises a time stamp of the frame.

### Claim 12 (depends on 1)

The method of claim 1, wherein causing display of the condensed visual representation and the identifier of the transition or the insertion point relative to the condensed visual representation comprises causing display of a frame of the plurality of frames associated with the transition or the insertion point and causing display of a predetermined number of additional frames surrounding the frame in the content.

### Claim 13 (depends on 1)

The method of claim 1, wherein the transition is a scene cut in the content.

### Claim 14

A device comprising:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the device to:
receive content comprising a plurality of frames;
condense the content to determine a condensed visual representation and metadata for each frame of the plurality of frames;
determine, based on the condensed visual representation, a transition or an insertion point in the content; and
cause display of the condensed visual representation and an identifier of the transition or the insertion point relative to the condensed visual representation.

### Claim 15 (depends on 14)

The device of claim 14, wherein the instructions, when executed, cause the device to condense the content to determine the condensed visual representation and the metadata for each frame of the plurality of frames by:
aggregating, for each frame, a visual property of each of a plurality of pixels in at least one of a horizontal row and a vertical column to form a first representation for each frame; and
aligning the first representation of each frame according to an order of the plurality of frames in the content to determine the condensed visual representation.

### Claim 16 (depends on 15)

The device of claim 15, wherein the instructions, when executed, cause the device to aggregate the visual property of each of the plurality of pixels by averaging the color of each of the plurality of pixels.

### Claim 17 (depends on 14)

The device of claim 14, wherein the instructions, when executed, further cause the device to insert supplemental content in the content at the determined insertion point in the content.

### Claim 18

A computer-readable medium storing instructions that, when executed, cause:
receiving content comprising a plurality of frames;
condensing the content to determine a condensed visual representation and metadata for each frame of the plurality of frames;
determining, based on the condensed visual representation, a transition or an insertion point in the content; and
causing display of the condensed visual representation and an identifier of the transition or the insertion point relative to the condensed visual representation.

### Claim 19 (depends on 18)

The computer-readable medium of claim 18, wherein the instructions, when executed, cause condensing the content to determine the condensed visual representation and the metadata for each frame of the plurality of frames by:
aggregating, for each frame, a visual property of each of a plurality of pixels in at least one of a horizontal row and a vertical column to form a first representation for each frame; and
aligning the first representation of each frame according to an order of the plurality of frames in the content to determine the condensed visual representation.

### Claim 20 (depends on 19)

The computer-readable medium of claim 19, wherein the instructions, when executed, cause aggregating the visual property of each of the plurality of pixels by averaging the color of each of the plurality of pixels.
