# US 11,443,408 B2 · Systems and methods to process electronic images to provide improved visualization and rendering of histopathology slides

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,443,408 B2
- Document ID: US11443408B2
- Status: Granted
- Kind: B2
- Application number: 17/535,084
- Filed: 2021-11-24
- Published: 2022-03-17
- Granted: 2022-09-13
- Earliest claimed: 2020-08-11
- Assignees: Paige.AI, Inc.
- Applicants: PAIGE.AI, Inc.
- Inventors: Alexandre Kirszenberg; Razik Yousfi; Thomas Fresneau; Peter Schueffler
- Web page: https://patentgrep.com/patent/US11443408B2

## CPC

- G06T 1/60: Memory management
- G16H 30/40: for processing medical images, e.g. editing
- G06T 7/0012: {Biomedical image inspection}
- G06V 20/69: Microscopic objects, e.g. biological cells or cellular parts
- H04N 23/58: Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
- H04N 23/63: by using electronic viewfinders
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for processing an electronic image including receiving, by a viewer, the electronic image and a FOV (field of view), wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor, loading, by the viewer, a plurality of tiles within the FOV, determining, by the viewer, a state of the plurality of tiles in a cache, and in response to determining that the state of the plurality of tiles in the cache is a fully loaded state, rendering, by the viewer, the plurality of tiles to a display.

## Claims

### Claim 1

A computer-implemented method for processing an electronic image, the method comprising:
receiving, by a slide viewer running on a web browser, the electronic image and a field of view (FOV) of the electronic image, wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor;
loading, by the slide viewer and from a cache of the slide viewer, one or more first tiles of a plurality of tiles within the FOV;
determining, by the slide viewer, that one or more second tiles of the plurality of tiles within the FOV are not in the cache;
requesting one or more electronic images of the one or more second tiles based on the determining;
determining, by the slide viewer and after requesting the one or more electronic images, that the one or more second tiles have the one or more electronic images and do not have one or more textures in the cache; and
rendering, by the slide viewer, the plurality of tiles to a display after requesting the one or more electronic images.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the loading of the one or more first tiles further comprises:
loading, by the slide viewer, the one or more first tiles from the cache in one or more groups in an order of priority based on the magnification factor of the FOV or based on a magnification level of the one or more first tiles.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, further comprising:
loading, by the slide viewer, the one or more electronic images of the one or more second tiles based on requesting the one or more images.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the loading of the one or more electronic images further comprises:
loading, by the slide viewer, the one or more electronic images into the cache.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising:
loading, by the slide viewer, the one or more textures for the one or more second tiles to a graphics processing unit (GPU) of the slide viewer based on determining that the one or more second tiles have the one or more images and do not have the one or more textures in the cache.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising:
pruning, by the slide viewer, the cache of one or more unused electronic images or textures for the one or more second tiles prior to rendering the plurality of tiles.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the slide viewer comprises at least one of:
the cache,
a core processor,
a renderer, or
a loader.

### Claim 8

A computer system for processing an electronic image, the computer system comprising:
at least one memory storing instructions; and
at least one processor configured to execute the instructions to perform operations comprising:
receiving, by a slide viewer, the electronic image and a field of view (FOV), wherein the FOV of the electronic image includes at least one coordinate, at least one dimension, and a magnification factor;
loading, by the slide viewer and from a cache of the slide viewer, one or more first tiles of a plurality of tiles within the FOV;
determining, by the slide viewer, that one or more second tiles of the plurality of tiles within the FOV are not in the cache;
requesting, by the slide viewer, one or more electronic images of the one or more second tiles based on the determining;
determining, by the slide viewer and after requesting the one or more electronic images, that the one or more second tiles have the one or more electronic images and do not have one or more textures in the cache; and
rendering, by the slide viewer, the plurality of tiles to a display after requesting the one or more electronic images.

### Claim 9 (depends on 8)

The computer system of claim 8, wherein the loading of the one or more first tiles further comprises:
loading, by the slide viewer, the one or more first tiles from the cache in one or more groups in an order of priority based on the magnification factor of the FOV or based on a magnification level of the one or more first tiles.

### Claim 10 (depends on 8)

The computer system of claim 8, wherein the operations further comprise:
loading, by the slide viewer, the one or more electronic images of the one or more second tiles based on requesting the one or more electronic images.

### Claim 11 (depends on 10)

The computer system of claim 10, wherein the loading of the one or more electronic images further comprises:
loading, by the slide viewer, the one or more electronic images into the cache.

### Claim 12 (depends on 8)

The computer system of claim 8, wherein the operations further comprise:
loading, by the slide viewer, the one or more textures for the one or more second tiles to a graphics processing unit (GPU) of the slide viewer based on determining that the one or more second tiles have the one or more electronic images and do not have the one or more textures in the cache.

### Claim 13

A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations for processing an electronic image, the operations comprising:
receiving, by a slide viewer, the electronic image and a field of view (FOV) of the electronic image, wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor;
loading, by the slide viewer and from a cache of the slide viewer, one or more first tiles of a plurality of tiles within the FOV;
determining, by the slide viewer, that one or more second tiles of the plurality of tiles within the FOV are not in the cache;
requesting, by the slide viewer, one or more images of the one or more second tiles based on the determining;
determining, by the slide viewer and after requesting the one or more electronic images, that the one or more second tiles have the one or more electronic images and do not have one or more textures in the cache; and
rendering, by the slide viewer, the plurality of tiles to a display after requesting the one or more images.

### Claim 14 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the loading of the one or more first tiles further comprises:
loading, by the slide viewer, the one or more first tiles from the cache in one or more groups in an order of priority based on the magnification factor of the FOV or based on a magnification level of the one or more first tiles.

### Claim 15 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the operations further comprise:
loading, by the slide viewer, the one or more textures for the one or more second tiles to a graphics processing unit (GPU) of the slide viewer based on determining that the one or more second tiles have the one or more electronic images and do not have the one or more textures in the cache.

### Claim 16 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the operations further comprise:
pruning the cache of one or more unused electronic images or textures for the one or more second tiles prior to rendering the plurality of tiles.

### Claim 17 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the slide viewer comprises at least one of:
the cache,
a core processor,
a renderer, or
a loader.
