# US 2021/0344978 A1 · Methods, systems, processors and computer code for providing video clips

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0344978 A1
- Document ID: US20210344978A1
- Status: Published application
- Kind: A1
- Application number: 17/367,906
- Filed: 2021-07-06
- Published: 2021-11-04
- Earliest claimed: 2017-04-28
- Assignees: Blackbird PLC
- Applicants: Blackbird PLC
- Inventors: Stephen STREATER; Nigel TOUATI-EVANS; Mark BURTENSHAW-SNELLGROVE; Brian BRUNSWICK; Andrew SLOUGH; Jeremy JAMES
- Web page: https://patentgrep.com/patent/US20210344978A1

## CPC

- H04N 21/2387: Stream processing in response to a playback request from an end-user, e.g. for trick-play
- H04N 21/2187: Live feed
- H04N 21/231: Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N 21/23439: {for generating different versions}
- H04N 21/237: Communication with additional data server
- H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)}
- H04N 21/8166: {involving executable data, e.g. software (arrangements for executing specific programs G06F9/44; broadcasting computer programmes in broadcast systems H04H20/91; involving the movement of software or configuration parameters H04L67/34)}
- H04N 21/8173: {End-user applications, e.g. Web browser, game}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N 21/854: Content authoring
- H04N 21/8543: using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] {(information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A computer-implemented method/system of providing video clip playback, including: (i) receiving a video feed; (ii) converting the video feed into a compressed format structure; (iii) uploading the compressed format structure to a first server; (iv) receiving an electronic edit decision list defining how to manipulate the compressed format structure; (v) saving the electronic edit decision list to a server; (vi) receiving a request to provide to a user terminal a video clip playback corresponding to a video clip defined by the compressed format structure and the electronic edit decision list; (vii) sending to the user code executable to provide the video clip defined by the compressed format structure and the electronic edit decision list, and (viii) responding to requests from the code when executed, to provide content corresponding to the compressed format structure stored, in accordance with the electronic edit decision list, to provide the decision list video clip playback.

## Claims

### Claim 1

A computer-implemented method of providing video clip playback, the method including the steps of:
(i) receiving a video feed;
(ii) converting the video feed into a compressed format structure, the compressed format structure including a hierarchy of levels of temporal resolution of frames, each respective level of the hierarchy including frames corresponding to a respective temporal resolution of the respective level of the hierarchy, but not including frames which are included in one or more lower levels of lower temporal resolution of frames of the hierarchy;
(iii) uploading the compressed format structure to a first server;
(iv) receiving an electronic edit decision list which defines how to manipulate the compressed format structure;
(v) saving the electronic edit decision list to the first server, or to a second server;
(vi) receiving a request to provide in a web browser executing on a user terminal a video clip playback corresponding to a video clip defined by the compressed format structure and the electronic edit decision list;
(vii) sending to the web browser code executable in the web browser to provide the video clip playback corresponding to the video clip defined by the compressed format structure stored on the first server and the electronic edit decision list saved on the first server or on the second server, and
(viii) responding to requests from the code when executing in the web browser, to provide content corresponding to the compressed format structure stored on the first server, in accordance with the electronic edit decision list saved on the first server or on the second server, to the web browser, to provide the video clip playback.

### Claim 2 (depends on 1)

The method of claim 1, in which the video feed is a live video feed; or in which the live video feed is a live sports video feed; or in which the video clip playback is real time video clip playback.

### Claim 3 (depends on 1)

The method of claim 1, in which converting the video feed into the compressed format structure is performed in real time.

### Claim 4 (depends on 1)

The method of claim 1, in which the code executable in the web browser is JavaScript code.

### Claim 5 (depends on 1)

The method of claim 1, (i) including the step of executing the code in the web browser to provide the video clip playback corresponding to the video clip defined by the compressed format structure stored on the first server and the electronic edit decision list saved on the first server or on the second server; or
(ii) including the step of the web browser code executing in the web browser to provide backwards play and forwards play at multiple speeds and at high displayed frame rate.

### Claim 6 (depends on 1)

The method of claim 1, including the step of the web browser code executing in the web browser to create no significant garbage while the web browser code is running.

### Claim 7 (depends on 1)

The method of claim 1, in which the web browser code is executable in the web browser without configuration or installation.

### Claim 8 (depends on 1)

The method of claim 1, including the step of providing the compressed format structure in chunks to a video editor, wherein the video editor is operable to generate the electronic edit decision list.

### Claim 9 (depends on 8)

The method of claim 8, (i) in which the video editor is operable to provide editing accurate to a single frame; or
(ii) in which the video editor is arranged to request and to receive frames at the highest level of temporal resolution in the hierarchy, in the vicinity of a selected frame; or
(iii) in which the video editor includes video/audio précis display hardware and/or software, which provides a visual summary of the video and/or audio, such as a navigation bar, which summarises the content at multiple temporal scales and allows fast and convenient jog and/or shuttle navigation through an action such as mouse clicking or dragging on a display, as well as further uses such as rapid scene detection and detection of significant parts of the content by an artificial intelligence (AI) algorithm.

### Claim 10 (depends on 1)

The method of claim 1, in which the first server is a cloud server, or in which the second server is a cloud server.

### Claim 11 (depends on 1)

The method of claim 1, including the step of the electronic edit decision list being generated even though the compressed format structure has not finished being stored on the first server.

### Claim 12 (depends on 1)

The method of claim 1, including the step of the compressed format structure being stored on an ingest server, before the compressed format structure is uploaded to the first server.

### Claim 13 (depends on 12)

The method of claim 12, in which the code is executable to download relevant video, audio, still, text and other files, including metadata files, from the first server or from the ingest server.

### Claim 14 (depends on 1)

The method of claim 1, in which the code is executable to read and to interpret the electronic EDL; or in which the code is executable to combine files in the compressed format structure to play back the edited video at any of the spatial resolutions in the compressed format structure.

### Claim 15 (depends on 1)

The method of claim 1, the method including an Edit step, in which a video editor system enables editing of video, audio, slides, titles and other media and metadata through the first server, to provide one or more electronic Edit Decision Lists.

### Claim 16 (depends on 1)

The method of claim 1, the method including a Player view step, in which opening a browser or other software gives access to the edited videos by real time playback of the electronic EDLs saved in step (v); or in which a Player, which runs entirely in JavaScript and has a relatively small footprint, is included in the web page code.

### Claim 17 (depends on 1)

The method of claim 1, the method including being able to provide video clips in less than 60 seconds from an original recording made using a video camera.

### Claim 18 (depends on 1)

The method of claim 1, the method including being able to provide video clips in less than 30 seconds from an original recording made using a video camera.

### Claim 19 (depends on 1)

The method of claim 1, the method including providing the video clip playback on a mobile computing device, on a mobile phone, on a smartphone, on a tablet computer, on a smart watch, on a laptop computer, on a desktop computers, or on a smart TV.

### Claim 20 (depends on 1)

The method of claim 1, in which the code is executable to provide live controls over some combination of video resolution, image size, playback speed, position through jog and/or shuttle, keyboard short cuts and other controls.

### Claim 21 (depends on 1)

The method of claim 1, in which the compressed format structure includes loss free compression.

### Claim 22 (depends on 21)

The method of claim 21, in which the loss free compression includes use of Transition Tables.

### Claim 23 (depends on 22)

The method of claim 22, in which the code uses a video codec, wherein the video codec supports private keys to randomise the initial state of its Transition Tables, making each bitstream randomised.

### Claim 24 (depends on 23)

The method of claim 23, in which a new player, incompatible with a previous player, is generated by providing new private keys.

### Claim 25 (depends on 1)

The method of claim 1, in which an order in which video and audio of the compressed format structure is uploaded to the first server is determined by an upload ordering system.

### Claim 26 (depends on 25)

The method of claim 25, including the steps of the upload ordering system
(a) uploading non-uploaded compressed audio, where available, as the highest priority;
(b) uploading non-uploaded coarsest temporal resolution video frames as the next highest priority;
(c) uploading the non-uploaded next-coarsest temporal resolution video frames as the next highest priority;
(d) uploading in this way until all video and audio frames have been uploaded.

### Claim 27 (depends on 1)

The method of claim 1, in which Edit software, or player software, or another application, downloads video from the cloud, when it calculates that the video is needed.

### Claim 28 (depends on 1)

The method of claim 1, in which a web-based player (e.g. a JavaScript player) requests relevant frames from a server, or from the cloud, before they are reached during playing, and the server, or the cloud, prioritises related uploads, and provides the relevant frames to the player, and the player plays back as many frames as are available.

### Claim 29 (depends on 1)

The method of claim 1, (i) in which the method includes use of an Electronic EDL interpreter library hardware and/or software to enable electronic EDLs, and the sources they link to, to be converted into decompressed frames and audio samples, in real time for playback; or
(ii) in which the method includes use of a Web-based video editor operable to create a cloud-hosted web page which can be accessed over a wide area network such as the internet and which contains a video player which plays back the published video; or
(iii) in which no time is required to upload an edited video to a renderer, or to a distribution network, because the video clip playback corresponds to a video clip defined by the compressed format structure and the electronic edit decision list, and because the video clip playback is provided using the web browser code.

### Claim 30 (depends on 1)

The method of claim 1, in which the video is not required to be uploaded to a distribution network on publishing because it is (a) either already in the editor, uploaded during editing/publishing so it is already on the cloud or (b) a Player can call for frames from an ingest server before the frames are uploaded when the Player decides the frames will be needed during playback; this causes the frames to upload ahead of playback and then to be relayed via the ingest server to the Player.

### Claim 31

A processing system including a processor and a first server, the system configured to provide video clip playback, wherein
(i) the processor is configured to receive a video feed;
(ii) the processor is configured to convert the video feed into a compressed format structure, the compressed format structure including a hierarchy of levels of temporal resolution of frames, each respective level of the hierarchy including frames corresponding to a respective temporal resolution of the respective level of the hierarchy, but not including frames which are included in one or more lower levels of lower temporal resolution of frames of the hierarchy;
(iii) the processor is configured to upload the compressed format structure to a first server;
(iv) the processor is configured to receive an electronic edit decision list which defines how to manipulate the compressed format structure;
(v) the processor is configured to save the electronic edit decision list to the first server, or to a second server wherein the system includes the second server;
(vi) the processor is configured to receive a request to provide in a web browser executing on a user terminal a video clip playback corresponding to a video clip defined by the compressed format structure and the electronic edit decision list;
(vii) the processor is configured to send to the web browser code executable in the web browser to provide the video clip playback corresponding to the video clip defined by the compressed format structure stored on the first server and the electronic edit decision list saved on the first server or on the second server, and
(viii) the processor is configured to respond to requests from the code when executing in the web browser, to provide content corresponding to the compressed format structure stored on the first server, in accordance with the electronic edit decision list saved on the first server or on the second server, to the web browser, to provide the video clip playback.

### Claim 32

A processor, wherein
(i) the processor is configured to receive a video feed;
(ii) the processor is configured to convert the video feed into a compressed format structure, the compressed format structure including a hierarchy of levels of temporal resolution of frames, each respective level of the hierarchy including frames corresponding to a respective temporal resolution of the respective level of the hierarchy, but not including frames which are included in one or more lower levels of lower temporal resolution of frames of the hierarchy;
(iii) the processor is configured to upload the compressed format structure to a first server;
(iv) the processor is configured to receive an electronic edit decision list which defines how to manipulate the compressed format structure;
(v) the processor is configured to save the electronic edit decision list to the first server or to a second server;
(vi) the processor is configured to receive a request to provide in a web browser executing on a user terminal a video clip playback corresponding to a video clip defined by the compressed format structure and the electronic edit decision list;
(vii) the processor is configured to send to the web browser code executable in the web browser to provide the video clip playback corresponding to the video clip defined by the compressed format structure stored on the first server and the electronic edit decision list saved on the first server or on the second server, and
(viii) the processor is configured to respond to requests from the code when executing in the web browser, to provide content corresponding to the compressed format structure stored on the first server, in accordance with the electronic edit decision list saved on the first server or on the second server, to the web browser, to provide the video clip playback.

### Claim 33

Computer code, the computer code embodied on a non-transitory storage medium, the computer code downloadable to a web browser executing on a user terminal and executable in the web browser to provide a video clip playback corresponding to a video clip defined by a compressed format structure stored on a first server and an electronic edit decision list saved on the first server or on a second server, wherein the compressed format structure includes a hierarchy of levels of temporal resolution of frames, each respective level of the hierarchy including frames corresponding to a respective temporal resolution of the respective level of the hierarchy, but not including frames which are included in one or more lower levels of lower temporal resolution of frames of the hierarchy, the computer code executable in the web browser to:
(i) request content corresponding to the compressed format structure stored on the first server, in accordance with the electronic edit decision list saved on the first server or on the second server, and
(ii) provide the video clip playback.
