# US 2013/0094566 A1 · Video multi-codec encoders

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0094566 A1
- Document ID: US20130094566A1
- Status: Published application
- Kind: A1
- Application number: 13/275,292
- Filed: 2011-10-17
- Published: 2013-04-18
- Earliest claimed: 2011-10-17
- Assignees: Exaimage Corporation
- Inventors: Jaime MILSTEIN
- Web page: https://patentgrep.com/patent/US20130094566A1

## CPC

- H04N 19/40: using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
- H04N 19/439: {using cascaded computational arrangements for performing a single operation, e.g. filtering}
- H04N 19/61: in combination with predictive coding
- H04N 19/625: using discrete cosine transform [DCT]
- H04N 19/63: using sub-band based transform, e.g. wavelets
- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 21/234309: {by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo (conversion of standards in analog television systems H04N7/01)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods for a video multi-codec encoder are provided. Video input data including a plurality of video frames is accepted. At least one codec Y subsystem is applied to frame data that includes at least one video frame of the plurality of video frames, where the frame data includes at least an unencoded portion of the plurality of video frames before one or more of the at least one codec Y subsystem is applied. The at least one codec Y subsystem includes at least partial Yi codec functionality. Yi is a codec selected from video codecs ={Y1, . . . , Yn}. At least one codec Z subsystem is applied to the frame data, where the at least one codec Z subsystem includes at least partial Z codec functionality. Video output data is generated including simple Z-encoded video data of the at least one video frame using the frame data.

## Claims

### Claim 1

A computer-readable medium comprising computer-readable instructions for a video multi-codec encoder, wherein execution of said computer-readable instructions by one or more processors causes said one or more processors to carry out steps comprising:
accepting video input data comprising a plurality of video frames;
applying at least one codec Y subsystem to frame data comprising at least one video frame of said plurality of video frames, wherein said frame data comprises at least an unencoded portion of said plurality of video frames before one or more of said at least one codec Y subsystem is applied, and wherein said at least one codec Y subsystem includes at least partial Yi codec functionality, where Yi is a codec selected from video codecs ={Y1, . . . , Yn}, where n is an integer greater than or equal to 1;
applying at least one codec Z subsystem to said frame data, where said at least one codec Z subsystem includes at least partial Z codec functionality; and
generating video output data comprising simple Z-encoded video data of said at least one video frame using said frame data.

### Claim 2 (depends on 1)

The computer-readable medium comprising computer-readable instructions for video multi-codec encoder of claim 1, further comprising processing said video input data with a channel processor.

### Claim 3 (depends on 1)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 1, further comprising an I/O insert for at least one of said video codecs and Z.

### Claim 4 (depends on 1)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 1, wherein said video output data comprises at least one encoded video data stream.

### Claim 5 (depends on 1)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 1, wherein said video multi-codec encoder is an interacting encoder, wherein said steps further comprise:
generating at least one YZ handoff product by applying one or more of said at least one codec Y subsystem to said frame data,
wherein said Z-encoded video data is generated by applying one or more of said at least one codec Z subsystem to said at least one YZ handoff product.

### Claim 6 (depends on 5)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 5, wherein {Y1, . . . , Yn-1} and output codec Z comprise an interacting video encoder system Z′ and wherein {Yn} and output codec Z′ comprises a video multi-codec encoder system.

### Claim 7 (depends on 1)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 1, wherein comprises at least one wavelet-based video codec W, wherein said at least one codec Y subsystem comprises at least one codec W subsystem configured to provide at least partial wavelet-based video codec functionality.

### Claim 8 (depends on 5)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 5, wherein comprises at least one wavelet-based video codec W, wherein said at least one codec Y subsystem comprises at least one codec W subsystem configured to provide at least partial wavelet-based video codec functionality, and wherein said at least one YZ handoff product comprises at least one WZ handoff product generated by applying said at least one codec W subsystem.

### Claim 9 (depends on 8)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 8, wherein generating said WZ handoff product further comprises:
applying said at least one codec W subsystem to said frame data to generate at least one W-processed original;
generating at least one difference frame between said at least one selected video frame and said at least one W-processed original; and
applying a filter operation on said at least one difference frame,
wherein generating said at least one WZ handoff product is based on said at least one difference frame and said at least one W-processed original.

### Claim 10 (depends on 5)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 5, wherein said steps further comprise:
generating at least one ZY handoff product by applying said at least one codec Z subsystem to said at least one YZ handoff product; and
generating at least one subsequent YZ handoff product by applying said at least one codec Y subsystem to said at least one ZY handoff product.

### Claim 11 (depends on 10)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 10, wherein said at least one codec Z subsystem generates said at least one ZY handoff product for processing by one or more of said at least one codec Y subsystem until at least one target criterion is met.

### Claim 12 (depends on 5)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 5, wherein said steps further comprise:
generating Y-encoded video data by applying said at least one codec Y subsystem.

### Claim 13 (depends on 5)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 5, wherein codec Z is a DCT-based codec.

### Claim 14 (depends on 5)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 5, wherein codec Z is a wavelet-based codec.

### Claim 15 (depends on 1)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 1, wherein said video output data comprises two or more related encoded video data streams, wherein each of said two or more related encoded video data streams comprises an encoded semblance of said at least one selected video frame.

### Claim 16 (depends on 15)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 15, wherein said two or more related encoded video data streams encode same-frame images that, together, comprise a distinct same-frame image.

### Claim 17 (depends on 15)

The computer-readable medium comprising computer-readable instructions for a video multi-codec encoder of claim 15, wherein said two or more related encoded video data streams produce an enhanced video stream comprising enhanced frame data associated with said at least one video frame when said two or more related encoded video data streams are merged.

### Claim 18

A video multi-codec encoder system comprising:
at least one codec Y subsystem, wherein said at least one codec Y subsystem includes at least partial Yi codec functionality, where Yi is a codec selected from video codecs ={Y1, . . . , Yn}, where n is an integer greater than or equal to 1;
at least one codec Z subsystem, where said at least one codec Z subsystem includes at least partial Z codec functionality;
wherein said at least one codec Y subsystem or said at least one Z codec subsystem or both are configured to accept video input data comprising a plurality of video frames and generate video output data comprising simple Z-encoded video data by applying said at least one codec Y subsystem to frame data comprising at least one video frame of said plurality of video frames and applying said at least one codec Z subsystem to said frame data, wherein said frame data comprises at least an unencoded portion of said plurality of video frames before one or more of said at least one codec Y subsystem is applied, and wherein said video output data comprises simple Z-encoded video data of said at least one video frame.

### Claim 19 (depends on 18)

The video multi-codec encoder system of claim 18, further comprising a channel processor.

### Claim 20 (depends on 18)

The video multi-codec encoder system of claim 18, further comprising a frame differencing or summing subsystem.

### Claim 21 (depends on 18)

The video multi-codec encoder system of claim 18, further comprising a de-interlacer.

### Claim 22 (depends on 18)

The video multi-codec encoder system of claim 18, further comprising an iterative feature enhancer.

### Claim 23 (depends on 18)

The video multi-codec encoder system of claim 18, further comprising a merging unit.

### Claim 24 (depends on 18)

The video multi-codec encoder system of claim 18, wherein at least one of said video codecs and Z comprises an I/O insert.

### Claim 25 (depends on 18)

The video multi-codec encoder system of claim 18, wherein at least one of said at least one codec Y subsystem and said at least one codec Z subsystem comprises a hardware subsystem.

### Claim 26 (depends on 18)

The video multi-codec encoder system of claim 18, wherein at least one codec Y subsystem is further configured to generate at least one YZ handoff product by applying one or more of said at least one codec Y subsystem to said frame data, and wherein said at least one codec Z subsystem is further configured to generate said Z-encoded video data based on said at least one YZ handoff product.

### Claim 27 (depends on 26)

The video multi-codec encoder system of claim 26, wherein {Y1, . . . , Yn-1} and output codec Z comprises an interacting video encoder system Z′ and wherein {Yn} and output codec Z′ comprises a video multi-codec encoder system.

### Claim 28 (depends on 18)

The video multi-codec encoder system of claim 18, wherein comprises at least one wavelet-based video codec W, and wherein said at least one codec Y subsystem comprises at least one codec W subsystem configured to provide at least partial wavelet-based video codec functionality.

### Claim 29 (depends on 26)

The video multi-codec encoder system of claim 26, wherein comprises at least one wavelet-based video codec W, wherein said at least one codec Y subsystem comprises at least one codec W subsystem configured to provide at least partial wavelet-based video codec functionality, and wherein said at least one YZ handoff product comprises at least one WZ handoff product generated by applying said at least one codec W subsystem.

### Claim 30 (depends on 29)

The video multi-codec encoder system of claim 29, wherein said at least one codec W subsystem is configured to generate said at least one WZ handoff product by:
applying said at least one codec W subsystem to said frame data to generate at least one W-processed original;
generating at least one difference frame between said at least one selected video frame and said at least one W-processed original; and
applying a filter operation on said at least one difference frame,
wherein generating said at least one WZ handoff product is based on said at least one difference frame and said at least one W-processed original.

### Claim 31 (depends on 26)

The video multi-codec encoder system of claim 26, wherein said at least one codec Z subsystem is further configured to generate at least one ZY handoff product based on said at least one YZ handoff product; and wherein said at least one codec Y subsystem is further configured to generate at least one subsequent YZ handoff product based on said at least one ZY handoff product.

### Claim 32 (depends on 31)

The video multi-codec encoder system of claim 31, wherein said at least one codec Z subsystem is configured to generate said at least one ZY handoff product for processing by one or more of said at least one codec Y subsystem until at least one target criterion is met.

### Claim 33 (depends on 26)

The video multi-codec encoder system of claim 26, wherein said at least one codec Y subsystem is further configured to generate Y-encoded video data.

### Claim 34 (depends on 26)

The video multi-codec encoder system of claim 26, wherein codec Z is a DCT-based codec.

### Claim 35 (depends on 26)

The video multi-codec encoder system of claim 26, wherein codec Z is a wavelet-based codec.

### Claim 36 (depends on 26)

The video multi-codec encoder system of claim 26, wherein said video output data comprises two or more related encoded video data streams, wherein each of said two or more related encoded video data streams comprises an encoded semblance of said at least one selected video frame.

### Claim 37 (depends on 36)

The video multi-codec encoder system of claim 36, wherein said two or more related encoded video data streams encode same-frame images that, together, comprise a distinct same-frame image.

### Claim 38 (depends on 36)

The video multi-codec encoder system of claim 36, wherein said two or more related encoded video data streams produce an enhanced video stream comprising enhanced frame data associated with said at least one video frame when said two or more related encoded video data streams are merged.

### Claim 39

A tangible computer-readable medium comprising Z-encoded video data, wherein said Z-encoded video data is generated by executing computer-readable instructions using one or more processors, wherein said computer-readable instructions causes said one or more processors to carry out steps comprising:
accepting video input data comprising a plurality of video frames;
applying at least one codec Y subsystem to frame data comprising at least one video frame of said plurality of video frames, wherein said frame data comprises at least an unencoded portion of said plurality of video frames before one or more of said at least one codec Y subsystem is applied, and wherein said at least one codec Y subsystem includes at least partial Yi codec functionality, where Yi is a codec selected from video codecs ={Y1, . . . , Yn}, where n is an integer greater than or equal to 1;
applying at least one codec Z subsystem to said frame data, where said at least one codec Z subsystem includes at least partial Z codec functionality; and
generating video output data comprising simple Z-encoded video data of said at least one video frame using said frame data.

### Claim 40 (depends on 39)

The tangible computer-readable medium comprising Z-encoded video data of claim 39, further comprising processing said video input data with a channel processor.

### Claim 41 (depends on 39)

The tangible computer-readable medium comprising Z-encoded video data of claim 39, wherein said steps further comprise providing an I/O insert for at least one of said video codecs and Z.

### Claim 42 (depends on 39)

The tangible computer-readable medium comprising Z-encoded video data of claim 39, wherein said steps further comprise:
generating at least one YZ handoff product by applying one or more of said at least one codec Y subsystem to said at frame data,
wherein said Z-encoded video data is generated by applying one or more of said at least one codec Z subsystem to said at least one YZ handoff product.

### Claim 43 (depends on 42)

The tangible computer-readable medium comprising Z-encoded video data of claim 42, wherein {Y1, . . . , Yn-1} and output codec Z comprises an interacting video encoder system Z′ and wherein {Y1} and output codec Z′ comprises a video multi-codec encoder system.

### Claim 44 (depends on 39)

The tangible computer-readable medium comprising Z-encoded video data of claim 39, wherein comprises at least one wavelet-based video codec W, wherein said at least one codec Y subsystem comprises at least one codec W subsystem configured to provide at least partial wavelet-based video codec functionality.

### Claim 45 (depends on 42)

The tangible computer-readable medium comprising Z-encoded video data of claim 42, wherein comprises at least one wavelet-based video codec W, wherein said at least one codec Y subsystem comprises at least one codec W subsystem configured to provide at least partial wavelet-based video codec functionality, and wherein said at least one YZ handoff product comprises at least one WZ handoff product generated by applying said at least one codec W subsystem.

### Claim 46 (depends on 45)

The tangible computer-readable medium comprising Z-encoded video data of claim 45, wherein generating said WZ handoff product further comprises:
applying said at least one codec W subsystem to said frame to generate at least one W-processed original;
generating at least one difference frame between said at least one selected video frame and said at least one W-processed original; and
applying a filter operation on said at least one difference frame,
wherein generating said at least one WZ handoff product is based on said at least one difference frame and said at least one W-processed original.

### Claim 47 (depends on 42)

The tangible computer-readable medium comprising Z-encoded video data of claim 42, wherein said steps further comprise:
generating at least one ZY handoff product by applying said at least one codec Z subsystem to said at least one YZ handoff product; and
generating at least one subsequent YZ handoff product by applying said at least one codec Y subsystem to said at least one ZY handoff product.

### Claim 48 (depends on 47)

The tangible computer-readable medium comprising Z-encoded video data of claim 47, wherein said at least one codec Z subsystem generates said at least one ZY handoff product for processing by one or more of said at least one codec Y subsystem until at least one target criterion is met.

### Claim 49 (depends on 42)

The tangible computer-readable medium comprising Z-encoded video data of claim 42, wherein said steps further comprise:
generating Y-encoded video data by applying said at least one codec Y subsystem.

### Claim 50 (depends on 42)

The tangible computer-readable medium comprising Z-encoded video data of claim 42, wherein codec Z is a DCT-based codec.

### Claim 51 (depends on 42)

The tangible computer-readable medium comprising Z-encoded video data of claim 42, wherein codec Z is a wavelet-based codec.

### Claim 52 (depends on 39)

The tangible computer-readable medium comprising Z-encoded video data of claim 39, wherein said video output data comprises two or more related encoded video data streams, wherein each of said two or more related encoded video data streams comprises an encoded semblance of said at least one selected video frame.

### Claim 53 (depends on 52)

The tangible computer-readable medium comprising Z-encoded video data of claim 52, wherein said two or more related encoded video data streams encode same-frame images that, together, comprise a distinct same-frame image.

### Claim 54 (depends on 52)

The tangible computer-readable medium comprising Z-encoded video data of claim 52, wherein said two or more related encoded video data streams produce an enhanced video stream comprising enhanced frame data associated with said at least one video frame when said two or more related encoded video data streams are merged.

### Claim 55

A computer-readable medium comprising computer-readable instructions for a video multi-codec encoder, wherein execution of said computer-readable instructions by one or more processors causes said one or more processors to carry out steps comprising:
accepting video input data comprising a plurality of video frames;
applying at least one codec Z subsystem to frame data associated with said at least one video frame, where said at least one codec Z subsystem includes at least partial Z codec functionality and wherein said at least one codec Z subsystem comprises an I/O insert;
generating video output data comprising simple Z-encoded video data of said at least one video frame using said frame data.

### Claim 56 (depends on 55)

The computer-readable medium comprising computer-readable instructions for video multi-codec encoder of claim 55, wherein said steps further comprise processing the video input data with a channel processor.

### Claim 57

A video multi-codec encoder system comprising:
at least one codec Z subsystem, where said at least one codec Z subsystem includes at least partial Z codec functionality, wherein said at least one video codec Z comprises an I/O insert; and
wherein said at least one Z codec subsystem is configured to accept video input data comprising a plurality of video frames and generate video output data comprising simple Z-encoded video data by applying said at least one codec Z subsystem to frame data associated with said at least one video frame, wherein said video output data comprises simple Z-encoded video data of said at least one video frame.

### Claim 58 (depends on 57)

The video multi-codec encoder system of claim 57, further comprising a channel processor.

### Claim 59 (depends on 57)

The video multi-codec encoder system of claim 57, further comprising a frame differencing or summing subsystem.

### Claim 60 (depends on 57)

The video multi-codec encoder system of claim 57, further comprising a de-interlacer.

### Claim 61 (depends on 57)

The video multi-codec encoder system of claim 57, further comprising an iterative feature enhancer.

### Claim 62 (depends on 57)

The video multi-codec encoder system of claim 57, further comprising a merging unit.

### Claim 63

A tangible computer-readable medium comprising Z-encoded video data, wherein said Z-encoded video data is generated by executing computer-readable instructions using one or more processors, wherein said computer-readable instructions causes said one or more processors to carry out steps comprising:
accepting video input data comprising a plurality of video frames;
applying at least one codec Z subsystem to frame data associated with said at least one video frame, where said at least one codec Z subsystem includes at least partial Z codec functionality;
providing an I/O insert for said at least one video codec Z; and
generating video output data comprising simple Z-encoded video data of said at least one video frame using said frame data.

### Claim 64 (depends on 63)

The tangible computer-readable medium comprising Z-encoded video data of claim 63, further comprising processing said video input data with a channel processor.
