# US 12,010,401 B2 · Systems and methods for production of fragmented video content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,401 B2 - Document ID: US12010401B2 - Status: Granted - Kind: B2 - Application number: 17/114,186 - Filed: 2020-12-07 - Published: 2021-05-27 - Granted: 2024-06-11 - Earliest claimed: 2017-09-15 - Assignees: Imagine Communications Corp. - Applicants: Imagine Communications Corp. - Inventors: Brick Eksten; Stephen Smith; Yuval Fisher; Steven Reynolds - Web page: https://patentgrep.com/patent/US12010401B2 ## CPC - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - H04L 65/70: Media network packetisation - H04L 65/764: {at the destination (reformatting of additional data in video clients H04N21/4355)} - H04N 21/2343: involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements {(video transcoding H04N19/40; media packet handling at the source H04L65/762)} - H04N 21/2405: {Monitoring of the internal components or processes of the server, e.g. server load (allocation of resources in multiprogramming arrangements G06F9/50; performance measurement of computer activity G06F11/34)} - H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)} - H04N 21/458: Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules {; time-related management operations (arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10)} - H04N 21/4882: {for displaying messages, e.g. warnings, reminders (arrangements for providing short real-time information to substation in data switching networks H04L12/1895)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract A system for producing fragmented video content is provided. The system includes a processing device, a non-transitory data store, and a memory storage device having at least a Manifest Processing Service (MPS) unit stored therein. The MPS unit is configured to generate at least one master manifest and store the master manifest in the non-transitory data store, the master manifest comprising a timing reference for a video fragment of the fragmented video content, wherein the timing reference indicates a temporal boundary of processing for the video fragment. ## Claims ### Claim 1 A computer-process-implemented method for producing video content, the method comprising: receiving video processing requirements for the video content, the video processing requirements including processing requirements for generation of at least one augmented video fragment by insertion of overlay content into at least one source video fragment; receiving the overlay content; receiving a plurality of source video fragments of the video content, each source video fragment being a separately managed unit of content, the source video fragments comprising a plurality of video fragments, each video fragment having a respective timing reference based on a timing model, where each timing reference indicates a temporal boundary of processing for the video fragment; generating the at least one augmented video fragment by insertion of the overlay content into at least one of the source video fragments in accordance with the received video processing requirements; aligning the plurality of video fragments with the timing model; generating at least one master manifest, the at least one master manifest comprising the timing references for the video fragments, the overlay content, and the video processing requirements; storing the master manifest in a non-transitory data store; and processing the one or more video fragments based on the master manifest. ### Claim 2 (depends on 1) The computer-process-implemented method of claim 1, comprising: generating timing guides based on the timing references; and displaying the timing guides to visually indicate the temporal boundaries of the video frames for alignment of a production event with a video fragment. ### Claim 3 (depends on 2) The computer-process-implemented method of claim 2, wherein the timing guides indicate reference frames for compressed video content. ### Claim 4 (depends on 1) The computer-process-implemented method of claim 1, managing, at a Manifest Orchestration Service (MOS) unit stored on a memory storage device, the video processing requirements based on the master manifest to align production events to the video fragments based on the timing model. ### Claim 5 (depends on 4) The computer-process-implemented method of claim 4, comprising routing, at the MOS unit, one or more fragments of the fragmented video content based on the master manifest. ### Claim 6 (depends on 1) The computer-process-implemented method of claim 1, comprising identifying, at a rules engine stored on a memory storage device, one or more fragments requiring augmentation based on one or more requirements of scheduled events from the master manifest. ### Claim 7 (depends on 1) The computer-process-implemented method of claim 1, comprising isochronously delivering an output video stream generated using the plurality of video fragments and the master manifest. ### Claim 8 (depends on 1) The computer-process-implemented method of claim 1, comprising generating a manifest for generating a first video output stream from a set of video fragments, the master manifest and the timing references being independent from the manifest. ### Claim 9 (depends on 1) The computer-process-implemented method of claim 1, wherein the master manifest indicates location data for pulling video fragments from different storage devices to generate a video output stream. ### Claim 10 (depends on 1) The computer-process-implemented method of claim 1, comprising providing, by a Manifest Processing Service, an instruction set for tracking of production events. ### Claim 11 (depends on 1) The computer-process-implemented method of claim 1, comprising: converting, via a transcoder, source content into the plurality of video fragments; processing, via the transcoder, one or more of the plurality of video fragments based on the master manifest to generate processed video fragments; generating a fragmented-video manifest based on the processed video fragments, the fragmented-video manifest containing timing data and location data for the processed video fragments to generate a first video stream suitable for origination, the location data indicating a storage location of the processed video fragments, the timing data indicating a sequence of the processed video fragments; and outputting the fragmented-video manifest for generation of the first video stream using the processed video fragments. ### Claim 12 (depends on 11) The computer-process-implemented method of claim 11, comprising: processing another set of one or more of the plurality of video fragments based on the master manifest; generating another fragmented-video manifest; and outputting a second video stream being different than the first video stream. ### Claim 13 (depends on 11) The computer-process-implemented method of claim 11, comprising processing a first set of video fragments using a first processing technique and a second set of video fragments using a second processing technique. ### Claim 14 (depends on 1) The computer-process-implemented method of claim 1, wherein the plurality of video fragments comprises one or more of a file based video fragment, a live video fragment, and a rendered video fragment. ### Claim 15 (depends on 1) The computer-process-implemented method of claim 1, comprising: balancing network resources based on the video processing requirements; and determining one or more unique video fragments of the video content to be processed. ### Claim 16 (depends on 15) The computer-process-implemented method of claim 15 comprising: receiving, at a transcoder, one or more control signals representing control commands for processing the video fragments; and process, by the transcoder, the one or more video fragments based on the control commands and the master manifest, wherein processing the one or more video fragments comprise inserting overlays into the one or more video fragments based on one or more timing references. ### Claim 17 (depends on 1) The computer-process-implemented method of claim 1, wherein the overlay content comprises at least one of advertisement, captions, audio, or emergency text data. ### Claim 18 (depends on 1) The computer-process-implemented method of claim 1, comprising sending the video fragments, overlay content and master manifest to a video playout server for processing and playout of the video content.