US 12,755,354 B2Granted

Antialiasing engine(s) for distributed morphological antialiasing reconstruction

AssigneeMicrosoft Technology Licensing, LLC

InventorsJulian Sebastian Meder, Florian Born

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods provide an antialiasing engine and its related functions that distribute the computational effort and image reconstruction functions to achieve higher visual quality using morphological methods and operations. For example, an antialiasing engine detects one or more edges within a first frame and generates an edge image indicating a respective pixel's proximity to the foreground or the background based on detection of the one or more edges within the first frame. The antialiasing engine then generates an analytical edge by tracing the edge image and encodes the analytical edge into a depth frame within a video stream. The video stream is then transmitted to a client device where the analytical edge is responsively decoded by a client-side antialiasing engine and sampled to generate a final composition integrating the first frame into a second frame using the analytical edge, where the second frame is generated by the client device.

Claims20

Dependent claims

A computing apparatus comprising:

a computer-readable storage medium;
an antialiasing engine comprising processor-executable instructions stored on the computer-readable storage medium;
and
one or more processors coupled to the computer-readable storage medium and configured to execute the processor-executable instructions, wherein the processor-executable instructions, when executed by the one or more processors, direct the computing apparatus, to at least:
detect one or more edges within a first frame, wherein the first frame comprises a foreground and a background;
generate an edge image based on detection of the one or more edges within the first frame, wherein the edge image indicates a respective pixel's proximity to the foreground or the background within the first frame;
generate an analytical edge by tracing the edge image;
encode the analytical edge into a depth frame within a video stream;
and
transmit the video stream to a client device, wherein responsive to receiving the video stream, a client-side antialiasing engine:
samples the depth frame from the video stream to reconstruct the analytical edge;
and
generates a final composition by integrating the first frame into a second frame using the analytical edge, wherein the second frame is generated by the client device.

10 more elements

A method for distributed morphological antialiasing, the method comprising:

detecting, by a server-side antialiasing engine, one or more edges within a first frame, wherein the first frame comprises a foreground and a background;
generating, by the server-side antialiasing engine, an edge image based on detection of the one or more edges within the first frame, wherein the edge image indicates a respective pixel's proximity to the foreground or the background within the first frame;
generating, by the server-side antialiasing engine, an analytical edge by tracing the edge image;
encoding, by the server-side antialiasing engine, a video stream with the analytical edge;
and
transmitting, by the server-side antialiasing engine, the video stream to a client-side antialiasing engine executing on a client device;
decoding, by the client-side antialiasing engine, the analytical edge from the video stream responsive to receiving the video stream;
and
generating, by the client-side antialiasing engine, a final composition by integrating the first frame into a second frame using the analytical edge, wherein the second frame is generated by the client device.

6 more elements

A computer readable storage media comprising processor-executable instructions configured to cause one or more processors to:

detect, by a server-side antialiasing engine, one or more edges within a first frame, wherein the first frame comprises a foreground and a background;
generate, by the server-side antialiasing engine, an edge image based on detection of the one or more edges within the first frame, wherein the edge image indicates a respective pixel's proximity to the foreground or the background within the first frame;
generate, by the server-side antialiasing engine, an analytical edge by tracing the edge image;
encode, by the server-side antialiasing engine, the analytical edge into a depth frame within a video stream;
and
transmit, by the server-side antialiasing engine, the video stream to a client-side antialiasing engine executing on a client device, wherein responsive to receiving the video stream the client-side antialiasing engine:
decodes the analytical edge from depth frame of the video stream responsive to receiving the video stream;
and
performs a multi-sample antialiasing (MSAA) process to incorporate the analytical edge into a second frame generated locally on the client device;
and
generate a final composition based on the MSAA process, wherein the final composition combines the first frame with the second frame.

8 more elements

Dependencies are inferred from the claim text.