# US 2004/0001645 A1 · Systems and methods for providing forward mapping with visibility for and resolution of accumulated samples

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0001645 A1
- Document ID: US20040001645A1
- Status: Published application
- Kind: A1
- Application number: 10/186,990
- Filed: 2002-06-28
- Published: 2004-01-01
- Earliest claimed: 2002-06-28
- Assignees: Microsoft Corporation
- Inventors: John Michael Snyder
- Web page: https://patentgrep.com/patent/US20040001645A1

## CPC

- G06T 15/04: Texture mapping
- G06T 15/405: {using Z-buffer}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods for forward mapping are provided, which accumulate and resolve over all samples forward mapped to each pixel bin. The invention uses a pixel, or sub-pixel, binning approach that accumulates and resolves over all samples, and performs particularly well compared to prior architectures in areas that have higher frequency content, solving the minification antialiasing problem and producing a high quality result. A filter determines the value(s) to assign to each pixel based upon accumulation and resolution, e.g., taking the mean, taking the median, taking the mode, taking the minimum, taking the maximum, applying a least squares fit or applying some other function, of all of the sample points that fall within the pixel bin(s), rather than assigning a value by selecting only the point sample that corresponds to the center of the pixel. During accumulation and resolution of each of the samples, since a point sample from a forefront object and a point sample from an occluded object may be received by the same bin, wherein only the former should be accumulated and resolved according to the accumulation and resolution process, a Z-range, or Z-interval, is assigned to each sample instead of the conventional Z-value. The Z-range is a function of the Z-value. Analysis of the overlapping of these Z-ranges then determines which samples are to be accumulated and resolved together according to the accumulation and resolution process, and which are not. Gaps or holes left by conventional forward-mapping techniques are thus eliminated more simply by oversampling the source(s), and interpolated points are generated at a higher rate than the original source signal(s) to adequately cover the destination bins, while Z-buffer visibility in the destination bins is addressed in an efficacious manner. A variety of image processing applications are contemplated wherein forward mapping, and accumulation and resolution of forward mapped point samples can be applied, ranging from 4-D graphics applications to applications wherein images recorded in a recording/storage environment are mapped to the arbitrary requirements of a display environment.

## Claims

### Claim 1

A method of rendering visual content to a display device having a plurality of pixels, comprising:
receiving at least one sample in each bin of a buffer, wherein each sample includes a Z-value reflecting an orthogonal distance of the sample from a plane of a display of the display device defined by said plurality of pixels; and
for each bin, assigning a Z-range to each of said at least one sample in the bin.

### Claim 2 (depends on 1)

A method according to claim 1, further including for each bin,
if the Z-range of a first sample of said at least one sample overlaps the Z-range of a second sample, setting a Z-interval for the bin to have a low limit which is the lower of the low limit of the Z-range for the first sample and the low limit for the Z-range for the second sample.

### Claim 3 (depends on 1)

A method according to claim 1, further including for each bin,
if the Z-range of the first sample of said at least one sample overlaps the Z-range of a second sample, setting the Z-interval for the bin to have a high limit which is the higher of the high limit of the Z-range for the first sample and the high limit for the Z-range for the second sample.

### Claim 4 (depends on 1)

A method according to claim 1, further including for each bin,
if the Z-range of the first sample of said at least one sample does not overlap the Z-range of a second sample, setting the Z-interval for the bin to the Z-range of the first sample if the first sample's Z-range is in front of the second sample's Z-range, and to the Z-range of the second sample if the Z-range of the second sample is in front of the Z-range of the first sample.

### Claim 5 (depends on 4)

A method according to claim 4, wherein the second sample is discarded if the first sample's Z-range is in front of the second sample's Z-range, and the first sample is discarded if the Z-range of the second sample is in front of the Z-range of the first sample.

### Claim 6 (depends on 4)

A method according to claim 4, wherein the second sample is stored temporarily if the first sample's Z-range is in front of the second sample's Z-range in case the Z-interval for the bin subsequently overlaps with the second sample's Z-range, and the first sample is temporarily stored if the Z-range of the second sample is in front of the Z-range of the first sample in case the Z-interval for the bin subsequently overlaps with the first sample's Z-range.

### Claim 7 (depends on 1)

A method according to claim 1, wherein said assigning includes:
calculating said Z-range for each sample based on a function of at least one of (A) the Z-value for the sample and (B) a Z-value for a neighbor of the sample from a geometry map from where the samples originated.

### Claim 8 (depends on 7)

A method according to claim 7, wherein said Z-range for each sample is set at a width such that the Z-value for said sample and at least one neighbor of the sample has a Z-value that are in said Z-range.

### Claim 9 (depends on 1)

A method according to claim 1, further including for each bin,
accumulating at least one sample that has a Z-value in said Z-interval for the bin; and
resolving said accumulated at least one sample.

### Claim 10 (depends on 9)

A method according to claim 9, further including:
calculating at least one pixel value of a pixel associated with said bin in accordance with the output of said resolving.

### Claim 11 (depends on 1)

A method according to claim 1, wherein the buffer is a frame buffer and a pixel of the display device is set based upon at least one of said at least one sample in accordance with an analysis of at least one Z-range.

### Claim 12 (depends on 1)

At least one of an operating system, driver code, an application programming interface, a tool kit and a coprocessing device for providing the image rendering of claim 1.

### Claim 13 (depends on 1)

A modulated data signal carrying computer executable instructions for performing the method of claim 1.

### Claim 14 (depends on 1)

A computing device comprising means for performing the method of claim 1.

### Claim 15

A system for rendering visual content to a display device having a plurality of pixels, comprising:
a frame buffer comprising a plurality of bins, wherein each bin receives at least one sample, whereby a pixel of the display device is set based upon at least one of said at least one sample and wherein each sample includes a Z-value reflecting an orthogonal distance of the sample from a plane of a display of the display device defined by said plurality of pixels;
a Z-range assigning component for assigning a Z-range to each of said at least one sample in each bin; and
a Z-interval setting component for setting a Z-interval for each bin.

### Claim 16 (depends on 15)

A system according to claim 15, wherein if the Z-range of a first sample of said at least one sample in each bin overlaps the Z-range of a second sample, the setting component sets a Z-interval for the bin to have a low limit which is the lower of the low limit of the Z-range for the first sample and the low limit for the Z-range for the second sample.

### Claim 17 (depends on 15)

A system according to claim 15, wherein if the Z-range of the first sample of said at least one sample overlaps the Z-range of a second sample, the setting component sets the Z-interval for the bin to have a high limit which is the higher of the high limit of the Z-range for the first sample and the high limit for the Z-range for the second sample.

### Claim 18 (depends on 15)

A system according to claim 15, wherein if the Z-range of the first sample of said at least one sample does not overlap the Z-range of a second sample, the setting component sets the Z-interval for the bin to the Z-range of the first sample if the first sample's Z-range is in front of the second sample's Z-range, and to the Z-range of the second sample if the Z-range of the second sample is in front of the Z-range of the first sample.

### Claim 19 (depends on 18)

A system according to claim 18, wherein the second sample is discarded if the first sample's Z-range is in front of the second sample's Z-range, and the first sample is discarded if the Z-range of the second sample is in front of the Z-range of the first sample.

### Claim 20 (depends on 18)

A system according to claim 18, wherein the second sample is stored temporarily if the first sample's Z-range is in front of the second sample's Z-range in case the Z-interval for the bin subsequently overlaps with the second sample's Z-range, and the first sample is temporarily stored if the Z-range of the second sample is in front of the Z-range of the first sample in case the Z-interval for the bin subsequently overlaps with the first sample's Z-range.

### Claim 21 (depends on 15)

A system according to claim 15, wherein said Z-range assigning component calculates said Z-range for each sample based on a function of at least one of (A) the Z-value for the sample and (B) a Z-value for a neighbor of the sample from a geometry map from where the samples originated.

### Claim 22 (depends on 21)

A system according to claim 21, wherein said Z-range for each sample is set at a width such that the Z-value for said sample and at least one neighbor of the sample has a Z-value that are in said Z-range.

### Claim 23 (depends on 15)

A system according to claim 15, further including
an accumulating component for accumulating at least one sample that has a Z-value in said Z-interval for each bin; and
a resolution component for resolving said samples accumulated by said accumulating component.

### Claim 24 (depends on 23)

A system according to claim 23, further including:
a rasterizing component that calculates at least one pixel value of a pixel associated with the bin in accordance with the output of said resolving.

### Claim 25

At least one computer readable medium for rendering visual content to a display device having a plurality of pixels having stored thereon a plurality of computer-executable modules comprising computer executable instructions, the modules comprising:
buffering means comprising a plurality of bins, wherein each bin receives at least one sample, whereby a pixel of the display device is set based upon at least one of said at least one sample and wherein each sample includes a Z-value reflecting an orthogonal distance of the sample from a plane of a display of the display device defined by said plurality of pixels;
Z-range assigning means for assigning a Z-range to each of said at least one sample in each bin; and
Z-interval setting means for setting a Z-interval for each bin based upon an analysis of at least one Z-range of a sample in the bin.

### Claim 26 (depends on 25)

At least one computer readable medium according to claim 25, wherein if the Z-range of a first sample of said at least one sample in each bin overlaps the Z-range of a second sample, the setting means sets a Z-interval for the bin to have a low limit which is the lower of the low limit of the Z-range for the first sample and the low limit for the Z-range for the second sample.

### Claim 27 (depends on 25)

At least one computer readable medium according to claim 25, wherein if the Z-range of the first sample of said at least one sample overlaps the Z-range of a second sample, the setting means sets the Z-interval for the bin to have a high limit which is the higher of the high limit of the Z-range for the first sample and the high limit for the Z-range for the second sample.

### Claim 28 (depends on 25)

At least one computer readable medium according to claim 25, wherein if the Z-range of the first sample of said at least one sample does not overlap the Z-range of a second sample, the setting means sets the Z-interval for the bin to the Z-range of the first sample if the first sample's Z-range is in front of the second sample's Z-range, and to the Z-range of the second sample if the Z-range of the second sample is in front of the Z-range of the first sample.

### Claim 29 (depends on 28)

At least one computer readable medium according to claim 28, wherein the second sample is discarded if the first sample's Z-range is in front of the second sample's Z-range, and the first sample is discarded if the Z-range of the second sample is in front of the Z-range of the first sample.

### Claim 30 (depends on 28)

At least one computer readable medium according to claim 28, wherein the second sample is stored temporarily if the first sample's Z-range is in front of the second sample's Z-range in case the Z-interval for the bin subsequently overlaps with the second sample's Z-range, and the first sample is temporarily stored if the Z-range of the second sample is in front of the Z-range of the first sample in case the Z-interval for the bin subsequently overlaps with the first sample's Z-range.

### Claim 31 (depends on 25)

At least one computer readable medium according to claim 25, wherein said Z-range assigning means calculates said Z-range for each sample based on a function of at least one of (A) the Z-value for the sample and (B) a Z-value for a neighbor of the sample from a geometry map from where the samples originated.

### Claim 32 (depends on 31)

At least one computer readable medium according to claim 31, wherein said Z-range for each sample is set at a width such that the Z-value for said sample and at least one neighbor of the sample has a Z-value that are in said Z-range.

### Claim 33 (depends on 25)

At least one computer readable medium according to claim 25, further including
accumulating means for accumulating at least one sample that has a Z-value in said Z-interval for each bin; and
resolution means for resolving said samples accumulated by said accumulating means.

### Claim 34 (depends on 23)

At least one computer readable medium according to claim 23, further including:
rasterizing means that calculates at least one pixel value of a pixel associated with the bin in accordance with the output of said resolving.

### Claim 35 (depends on 25)

A computing device for use in connection with image rendering, comprising the modules of claim 25.
