Video bit stream extension by differential information annotation

A memory for storing data for access by an application program being executed on a video processing system comprising a video data structure stored in the memory, the data structure including information resident in storage used by the application program and including:

• video frame data for each respective video frame of a sequence of video frames;
• a table of parameters having video information describing the video frame data;
• and
• an annotation to the video frame data for a current video frame associated with and separate from the video frame data for the current video frame, the annotation comprising parameters that provide differential information indicating the difference between a current state of auxiliary information regarding the sequence of video frames as provided in the table of parameters and auxiliary information regarding a current video frame of the sequence of video frames.

An article of manufacture comprising a machine-accessible medium including data that, when accessed by a machine, cause the machine to generate an annotated video bit stream comprising:

• video frame data for each respective video frame of a sequence of video frames;
• a table of parameters having video information describing the video frame data;
• and
• an annotation to the video frame data for a current video frame associated with and separate from the video frame data for the current video frame, the annotation comprising parameters that provide differential information indicating the difference between a current state of auxiliary information regarding the sequence of video frames as provided in the table of parameters and auxiliary information regarding a current video frame of the sequence of video frames.

An article of manufacture comprising a machine-accessible medium including data that, when accessed by a machine, cause the machine to generate an annotated video bit stream comprising:

• video frame data corresponding to a sequence of video frames;
• and
• a table of parameters having video information describing the video frame data;
• and
• an annotation frame annotated to each frame of the sequence of video frames, the annotation frames being separate and distinct from the video frames, the annotation frames comprising parameters that provide differential information that is the difference between video information describing a current video frame and the video information stored in the table of parameters.