# US 2026/0228859 A1 · Method and system for forming foveated images based on eye gaze

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0228859 A1
- Document ID: US20260228859A1
- Status: Published application
- Kind: A1
- Application number: 19/578,600
- Filed: 2026-03-25
- Published: 2026-08-06
- Earliest claimed: 2023-10-12
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Edward Diaz; Kevin Maurice Irick
- Web page: https://patentgrep.com/patent/US20260228859A1

## CPC

- G02B 27/017: {Head mounted}
- G09G 3/20: for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix {no fixed position being assigned to or needed to be assigned to the individual characters or partial characters}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/10: Segmentation; Edge detection (motion-based segmentation G06T7/215)
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 40/18: Eye characteristics, e.g. of the iris
- G02B 2027/0147: {comprising a device modifying the resolution of the displayed image}
- G06T 2207/20221: Image fusion; Image merging
- G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method includes rendering an original image at a first processor, encoding the original image to provide an encoded image, and transmitting the encoded image to a second processor. The method also includes decoding the encoded image to provide a decoded image, determining an eye gaze location, splitting the decoded image into N sections based on the eye gaze location, and processing N-1 sections of the N sections to produce N-1 secondary quality sections. The method further includes processing one section of the N sections to provide one primary quality section, combining the one primary quality section and the N-1 secondary quality sections to form a foveated image, and transmitting the foveated image to a display.

## Claims

### Claim 1

A method comprising:
rendering an original image at a first processor;
encoding the original image to provide an encoded image;
transmitting the encoded image to a second processor;
decoding the encoded image to provide a decoded image;
determining an eye gaze location;
splitting the decoded image into N sections based on the eye gaze location;
processing N-1 sections of the N sections to produce N-1 secondary quality sections;
processing one section of the N sections to provide one primary quality section;
combining the one primary quality section and the N-1 secondary quality sections to form a foveated image; and
transmitting the foveated image to a display.

### Claim 2 (depends on 1)

The method of claim 1 wherein the first processor comprises a graphics processing unit and the second processor comprises a display driver.

### Claim 3 (depends on 1)

The method of claim 1 wherein the one primary quality section includes pixels corresponding to the eye gaze location.

### Claim 4 (depends on 1)

The method of claim 1 wherein processing the N-1 sections of the N sections to produce the N-1 secondary quality sections comprises compressing the N-1 sections using a lossy compression process.

### Claim 5 (depends on 4)

The method of claim 4 wherein the original image comprises an M×N image and the N-1 secondary quality sections comprise M×N images.

### Claim 6 (depends on 1)

The method of claim 1 wherein processing the N-1 sections of the N sections to produce the N-1 secondary quality sections comprises subsampling the N-1 sections.

### Claim 7 (depends on 6)

The method of claim 6 wherein the original image comprises an M×N image and the N-1 secondary quality sections comprise αM×αN images, where α<1.

### Claim 8 (depends on 1)

The method of claim 1 further comprising warping the foveated image prior to transmitting the foveated image to the display.

### Claim 9 (depends on 1)

The method of claim 1 further comprising determining an eye gaze velocity, wherein pixel dimensions of the one primary quality section are a function of the eye gaze velocity.

### Claim 10 (depends on 1)

The method of claim 1 wherein:
the eye gaze location comprises an eye gaze region; and
the one primary quality section includes pixels corresponding to the eye gaze region.

### Claim 11

A method comprising:
determining an eye gaze location;
rendering, at a first processor, a first image having a first image quality and a second image having a second image quality, wherein the first image quality is higher than the second image quality;
encoding the first image to provide a first encoded image;
encoding the second image to provide a second encoded image;
transmitting the first encoded image and the second encoded image to a second processor;
decoding the first encoded image and the second encoded image to provide a first decoded image and a second decoded image;
combining the first decoded image and the second decoded image to form a foveated image; and
transmitting the foveated image to a display.

### Claim 12 (depends on 11)

The method of claim 11 wherein the first processor comprises a graphics processing unit and the second processor comprises a display driver.

### Claim 13 (depends on 11)

The method of claim 11 wherein the first image includes pixels corresponding to the eye gaze location.

### Claim 14 (depends on 11)

The method of claim 11 further comprising:
compressing the first decoded image using a lossless compression process;
compressing the second decoded image using a lossless compression process; and
storing the compressed first decoded image and the compressed second decoded image in memory.

### Claim 15 (depends on 14)

The method of claim 14 wherein:
the compressed first decoded image comprises an M×N image;
the compressed second decoded image comprises an M×N image; and
the foveated image comprises a 2M×2N image.

### Claim 16 (depends on 11)

The method of claim 11 wherein the foveated image comprises an M×N image and the first image and the second image comprise αM×αN images, where α<1.

### Claim 17 (depends on 11)

The method of claim 11 further comprising warping the foveated image prior to transmitting the foveated image to the display.

### Claim 18 (depends on 11)

The method of claim 11 wherein determining the eye gaze location is performed at a first frame rate and rendering the first image and the second image is performed at a second frame rate higher than the first frame rate.

### Claim 19 (depends on 18)

The method of claim 18 further comprising displaying the foveated image at the second frame rate.

### Claim 20 (depends on 11)

The method of claim 11 wherein the first image has a rectangular shape centered at the eye gaze location.
