Screen Map and Standards-Based Progressive Codec for Screen Content Coding

A system comprising:

• a classification component executing on a computing system and configured to classify screen content for each of a plurality of coding units as having a content type selected from among a plurality of content types, at least one of the content types comprising a screen image type;
• and
• one or more encoding modules executing on the computing system, the one or more encoding modules configured to apply an encoding to the screen content of a coding unit based on the content type;
• wherein the one or more encoding modules are configured to apply a progressive standards-based encoding to the screen content associated with the coding units having the screen image type.

A computer storage medium having computer-executable instructions stored thereon which, when executed, cause a computing system to perform a method of delivering screen content to a client device, the method comprising:

• for each of a plurality of coding units corresponding to screen regions included in a screen at a particular time:
• classifying screen content included in the coding unit as having a content type selected from among a plurality of content types, the plurality of content types including a screen image type, a video type, and a text type;
• based on a determination that the screen content has a screen image type, applying a progressive standards-based encoding to the screen content of that coding unit;
• based on a determination that the screen content has a video type, applying a standards-based encoding to the screen content of that coding unit;
• and
• based on a determination that the screen content has a text type, applying a text codec to the screen content of that coding unit;
• generating a screen map including metadata associated with each of the plurality of coding units, the metadata including one or more quality flags, a slides flag, a special effects flag, a motion flag, a spatial skip flag, and a temporal skip flag;
• and
• transmitting encoded screen content for each of the screen regions to the client device.