# US 11,308,685 B2 · Rendering computer-generated reality text

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,308,685 B2
- Document ID: US11308685B2
- Status: Granted
- Kind: B2
- Application number: 17/028,887
- Filed: 2020-09-22
- Published: 2021-03-25
- Granted: 2022-04-19
- Earliest claimed: 2019-09-23
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Siddharth S. Hazra; William J. Dobbie; Moinul H. Khan; Yanli Zhang; Yohan Rajan; Arthur Y. Zhang
- Web page: https://patentgrep.com/patent/US11308685B2

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 7/74: {involving reference images or patches}
- G06T 15/20: Perspective computation
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 10/235: {based on user input or interaction}
- G06V 40/18: Eye characteristics, e.g. of the iris
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/017: {Head mounted}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G06T 2207/30244: Camera pose
- G06T 2219/004: Annotating, labelling
- G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.

## Claims

### Claim 1

A method comprising:
at an electronic device having a processor:
determining a viewpoint of a computer-generated reality (CGR) environment, the CGR environment comprising text;
determining a measurement associated with viewing the text from the viewpoint in the CGR environment, wherein the measurement comprises an angle subtended by a portion of the text;
determining a size of a first zone based on the measurement; and
rendering an image providing a view of the CGR environment from the viewpoint by rendering content in the first zone according to a first rendering technique and rendering content in a second zone according to a second rendering technique, the first zone distinct from the second zone and the first rendering technique different from the second rendering technique.

### Claim 2 (depends on 1)

The method of claim 1, wherein the measurement is an angle subtended by an individual glyph of the text.

### Claim 3 (depends on 1)

The method of claim 1, wherein the measurement is a maximum angle subtended by all individual glyphs of the text.

### Claim 4 (depends on 1)

The method of claim 1, wherein the size of the first zone is determined based on a predetermined number of glyphs.

### Claim 5 (depends on 1)

The method of claim 1, wherein a width of the first zone is determined based on a predetermined number of glyphs.

### Claim 6 (depends on 1)

The method of claim 1, further comprising dynamically adjusting the size of the first zone for rendering additional images providing views of the CGR environment based on additional measurements associated with viewing the text in the CGR environment.

### Claim 7 (depends on 1)

The method of claim 1, wherein the viewpoint is determined based on tracking a pose of a device upon which the rendering is displayed.

### Claim 8 (depends on 1)

The method of claim 1 wherein the first rendering technique uses a greater sampling rate than the second rendering technique.

### Claim 9 (depends on 1)

The method of claim 1, wherein the rendering includes rendering content in a third zone according to a third rendering technique, the third zone distinct from the first zone and the second zone and the third rendering technique different from the first rendering technique and the second rendering technique.

### Claim 10 (depends on 9)

The method of claim 9, wherein a size of the second zone or the third zone is based on the measurement.

### Claim 11 (depends on 1)

The method of claim 1, wherein the measurement is an angle subtended by spacing between lines of the text.

### Claim 12 (depends on 1)

The method of claim 1, wherein the measurement is an angle subtended by a current gaze position and an end of a current line of the text.

### Claim 13 (depends on 1)

The method of claim 1 further comprising identifying a user attribute, wherein the size of the first zone is based on the user attribute.

### Claim 14 (depends on 1)

The method of claim 1, wherein the size of the first zone is based on a visual saliency estimate.

### Claim 15

A method comprising:
at an electronic device having a processor:
determining a viewpoint of a computer-generated reality (CGR) environment, the CGR environment comprising text;
determining a rendering resolution for a portion of an image, the image providing a view of the CGR environment from the viewpoint;
determining a rendering technique for a part of a glyph based on a size of an area that the part of the glyph will occupy in the portion of the image and the rendering resolution for the portion of the image; and
rendering the image providing the view of the CGR environment from the viewpoint, wherein the part of the glyph is rendered according the rendering technique.

### Claim 16 (depends on 15)

The method of claim 15, wherein different rendering resolutions are used in rendering different zones of the image.

### Claim 17 (depends on 15)

The method of claim 15, wherein determining the rendering technique comprises:
determining an area of the image that the part of the glyph will occupy;
determining a number of rendering pixels of the area according to the rendering resolution; and
selecting the rendering technique based on the number of rendering pixels.

### Claim 18 (depends on 15)

The method of claim 15, wherein determining the rendering technique comprises selecting a first rendering technique based on determining that the rendering resolution exceeds a threshold.

### Claim 19 (depends on 15)

The method of claim 15, wherein the rendering technique is determined by selecting a rendering technique from a plurality of different rendering techniques based on the area that the part of the glyph will occupy in the portion of the image and the rendering resolution for the portion of the image.

### Claim 20

A device comprising:
a non-transitory computer-readable storage medium; and
one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause a system to perform operations comprising:
determining a viewpoint of a computer-generated reality (CGR) environment, the CGR environment comprising text;
determining a measurement associated with viewing the text from the viewpoint in the CGR environment, wherein the measurement comprises an angle subtended by a portion of the text;
determining a size of a first zone based on the measurement; and
rendering an image providing a view of the CGR environment from the viewpoint by rendering content in the first zone according to a first rendering technique and rendering content in a second zone according to a second rendering technique, the first zone distinct from the second zone and the first rendering technique different from the second rendering technique.
