# US 2009/0262136 A1 · Methods, Systems, and Products for Transforming and Rendering Media Data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0262136 A1
- Document ID: US20090262136A1
- Status: Published application
- Kind: A1
- Application number: 12/107,232
- Filed: 2008-04-22
- Published: 2009-10-22
- Earliest claimed: 2008-04-22
- Inventors: Steven N. Tischer; Karl Cartwright; Jerry Liu
- Web page: https://patentgrep.com/patent/US20090262136A1

## CPC

- G06T 9/20: Contour coding, e.g. using detection of edges
- G06T 1/00: General purpose image data processing
- G06T 7/13: Edge detection
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 13/00: Animation
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence)
- H04N 19/164: Feedback from the receiver or from the transmission channel
- H04N 19/17: the unit being an image region, e.g. an object
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods, systems, and products are disclosed for transforming and rendering scenes of video data. A frame of video data is stored as a scene file. Components within the scene are edge detected, such that boundaries of the components of the scene are determined. The edge-detected components are saved as a first synthesized scene file describing the scene. The minor components of the scene are discarded, and the remaining major components are saved as a second synthesized scene file describing the scene. Vectors describing the boundaries of the major components are saved as a third synthesized scene file describing the scene. When a request is received for the frame of video data, any of the scene files may be returned to a requesting device, depending on bandwidth and/or cost.

## Claims

### Claim 1

A method of transforming media data, comprising:
storing a frame of media data;
edge detecting components of a scene within the frame, such that boundaries of the components within the scene are determined;
saving the edge-detected components as a first synthesized file describing the frame of media data;
discarding minor components within the scene, such that major components remain;
saving the major components as a second synthesized file describing the frame of media data;
determining vectors describing the boundaries of the major components;
saving the vectors as a third synthesized file describing the frame of media data.

### Claim 2 (depends on 1)

The method according to claim 1, wherein edge detecting the components comprises comparing a chrominance of a region in the frame to the chrominance of an adjacent region in the frame.

### Claim 3 (depends on 2)

The method according to claim 2, wherein if the chrominance of the region differs from the chrominance of an adjacent region by a threshold chrominance value, then defining a boundary of a component of the scene.

### Claim 4 (depends on 2)

The method according to claim 2, wherein if the chrominance between the region and the adjacent region does not differ by the threshold chrominance value, then choosing another region for comparison.

### Claim 5 (depends on 1)

The method according to claim 1, wherein edge detecting the components comprises comparing a luminance of a region in the frame to the luminance of an adjacent region in the frame.

### Claim 6 (depends on 5)

The method according to claim 5, wherein if the luminance of the region differs from the luminance of an adjacent region by a threshold luminance value, then defining a boundary of a component of the scene.

### Claim 7 (depends on 5)

The method according to claim 5, wherein if the luminance between the region and the adjacent region does not differ by the threshold luminance value, then choosing another region for comparison.

### Claim 8 (depends on 1)

The method according to claim 1, further comprising:
dividing the frame into n regions; and
discarding components having a size smaller than an area of a region.

### Claim 9 (depends on 1)

The method according to claim 1, further comprising discarding a color from the frame according to a color gamut, such that a color of a component is discarded if not specified in the color gamut.

### Claim 10 (depends on 9)

The method according to claim 9, further comprising replacing the discarded color with another color in the color gamut.

### Claim 11 (depends on 1)

The method according to claim 1, further comprising:
receiving a request for the frame of media data; and
offering a lower resolution alternative to the media data, the lower resolution alternative comprising at least one of i) the first synthesized file describing the edge-detected components, ii) the second synthesized file describing the major components of the scene, and iii) the third synthesized file of the vectors describing the boundaries of the major components of the scene.

### Claim 12 (depends on 11)

The method according to claim 11, further comprising communicating a cost to provide the frame of media data and to provide the lower resolution alternative.

### Claim 13 (depends on 1)

The method according to claim 1, further comprising pushing a set of attributes with the third synthesized file, such that the vectors describing the boundaries of the major components will be rendered using the set of attributes.

### Claim 14

A method of rendering media data, comprising:
receiving a vector representation of the media data, the vector representation comprising mathematical vectors that describe a boundary of an edge-detected component within a frame of the media data;
retrieving a set of attributes; and
rendering the mathematical vectors using the set of attributes to present a synthesized image of the media data.

### Claim 15 (depends on 14)

The method according to claim 14, further comprising:
receiving a selection of an area within the synthesized image;
receiving another selection of a color; and
rendering the selected area in the selected color.

### Claim 16 (depends on 14)

The method according to claim 14, further comprising associating the set of attributes to a sender of the vector representation of the media data.

### Claim 17 (depends on 14)

The method according to claim 14, further comprising downloading the set of attributes.

### Claim 18 (depends on 14)

The method according to claim 14, further comprising converting the vector representation of the media data into another image.

### Claim 19 (depends on 14)

The method according to claim 14, further comprising applying change in curl of the mathematical vectors to another image.

### Claim 20

A system for transforming media data, comprising:
means for storing a frame of media data;
means for comparing a chrominance of a region in the frame to the chrominance of an adjacent region in the frame;
means for edge detecting boundaries of components within the frame using the chrominance;
means for saving the edge-detected boundaries of the components as a first synthesized file;
means for discarding minor components within the frame, such that major components remain;
means for saving the major components as a second synthesized file;
means for determining mathematical vectors describing the boundaries of the major components;
means for saving the mathematical vectors as a third synthesized file;
means for receiving a request for the media data; and
means for sending a lower resolution alternative to the media data, the lower resolution alternative comprising at least one of i) the first synthesized file describing the edge-detected components, ii) the second synthesized file describing the major components within the frame, and iii) the third synthesized file of the mathematical vectors describing the boundaries of the major components within the frame.