Content based video compression system

Abstract

A content based method of compressing a segment of video is implemented in two stages. In a spatial integration stage, figures are represented in terms of compact models. In a temporal integration stage, which uses the information from the spatial integration stage, constructs, i.e., world images and data describing relationships between world images and frames, are generated. In operation, each frame in a series of frames is preprocessed to tessellate any moving figures and to obtain motion data for the moving figures and for the image background. The figure motion data is stored in a manner so as to associate the motion data with the original frame. Frame information identifying the size and position of each frame with respect to a background world image is also stored. Each tessellated figure is compared to the original frame to produce a template for each moving figure and a template for the background. Each template is compared to a world image that is associated with that template so that material common to both can be cut and the remaining material added to form a new world image. The steps are repeated until all frames in the segment are processed. The resulting world image data, figure motion data, and frame information are output for transmission or storage. The world image data may be compressed prior to transmission or storage.

Dependencies are inferred from the claim text.