# US 2023/0419444 A1 · Systems, devices, and methods for providing feedback on and improving the accuracy of super-resolution imaging

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0419444 A1
- Document ID: US20230419444A1
- Status: Published application
- Kind: A1
- Application number: 18/240,910
- Filed: 2023-08-31
- Published: 2023-12-28
- Earliest claimed: 2018-07-03
- Assignees: Nanotronics Imaging, Inc.
- Applicants: Nanotronics Imaging, Inc.
- Inventors: Matthew C. Putman; John B. Putman; Vadim PINSKIY; Josephn R. Succar
- Web page: https://patentgrep.com/patent/US20230419444A1

## CPC

- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06F 18/2411: based on the proximity to a decision surface, e.g. support vector machines
- G06F 18/2413: based on distances to training or reference patterns
- G06T 3/4053: based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/993: {Evaluation of the quality of the acquired pattern}
- G06V 20/693: {Acquisition}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems, methods, and computer-readable media for feedback on and improving the accuracy of super-resolution imaging. In some embodiments, a low resolution image of a specimen can be obtained using a low resolution objective of a microscopy inspection system. A super-resolution image of at least a portion of the specimen can be generated from the low resolution image of the specimen using a super-resolution image simulation. Subsequently, an accuracy assessment of the super-resolution image can be identified based on one or more degrees of equivalence between the super-resolution image and one or more actually scanned high resolution images of at least a portion of one or more related specimens identified using a simulated image classifier. Based on the accuracy assessment of the super-resolution image, it can be determined whether to further process the super-resolution image. The super-resolution image can be further processed if it is determined to further process the super-resolution image.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A method, comprising:
obtaining, by a computing system, a low resolution image of a specimen using a low resolution objective of a microscopy inspection system;
detecting, by the computing system, a plurality of artifacts in the low resolution image;
determining, by the computing system, that a first artifact of the plurality of artifacts is suitable for super-resolution imaging;
determining, by the computing system, that a second artifact of the plurality of artifacts is not suitable for super-resolution imaging; and
based on the determining,
generating, by the computing system, a super-resolution image of a first portion of the specimen that includes the first artifact,
generating, by the computing system, a high resolution image of a second portion of the specimen that includes the second artifact, and
generating, by the computing system, a single coherent image of the specimen by combining the super-resolution image and the high resolution image.

### Claim 22 (depends on 21)

The method of claim 21, wherein determining, by the computing system, that the first artifact of the plurality of artifacts is suitable for super-resolution imaging comprises:
cross-correlating the first artifact to known artifacts that have been assessed as suitable for super-resolution imaging.

### Claim 23 (depends on 22)

The method of claim 22, wherein cross-correlating the first artifact to the known artifacts that have been assessed as suitable for super-resolution imaging comprises:
measuring a similarity of the first artifact to each known artifact as a function of a displacement of the first artifact relative to each known artifact.

### Claim 24 (depends on 22)

The method of claim 22, wherein the known artifacts that have been assessed as suitable for super-resolution imaging comprises artifacts where super-resolution images were generated and determined to be high-confidence super-resolution images.

### Claim 25 (depends on 21)

The method of claim 21, wherein determining, by the computing system, that the second artifact of the plurality of artifacts is not suitable for super-resolution imaging comprises:
cross-correlating the second artifact to known artifacts that have been assessed as not being suitable for super-resolution imaging.

### Claim 26 (depends on 25)

The method of claim 25, wherein cross-correlating the second artifact to the known artifacts that have been assessed as not being suitable for super-resolution imaging comprises:
measuring a similarity of the second artifact to each known artifact as a function of a displacement of the second artifact relative to each known artifact.

### Claim 27 (depends on 21)

The method of claim 21, further comprising:
determining, by the computing system, a total number of artifacts on the specimen based on the single coherent image.

### Claim 28

A non-transitory computer readable medium comprising one or more sequences of instructions, which, when executed by one or more processors, causes a computing system to perform operations comprising:
obtaining, by the computing system, a low resolution image of a specimen using a low resolution objective of a microscopy inspection system;
detecting, by the computing system, a plurality of artifacts in the low resolution image;
determining, by the computing system, that a first artifact of the plurality of artifacts is suitable for super-resolution imaging;
determining, by the computing system, that a second artifact of the plurality of artifacts is not suitable for super-resolution imaging; and
based on the determining,
generating, by the computing system, a super-resolution image of a first portion of the specimen that includes the first artifact,
generating, by the computing system, a high resolution image of a second portion of the specimen that includes the second artifact, and
generating, by the computing system, a single coherent image of the specimen by combining the super-resolution image and the high resolution image.

### Claim 29 (depends on 28)

The non-transitory computer readable medium of claim 28, wherein determining, by the computing system, that the first artifact of the plurality of artifacts is suitable for super-resolution imaging comprises:
cross-correlating the first artifact to known artifacts that have been assessed as suitable for super-resolution imaging.

### Claim 30 (depends on 29)

The non-transitory computer readable medium of claim 29, wherein cross-correlating the first artifact to the known artifacts that have been assessed as suitable for super-resolution imaging comprises:
measuring a similarity of the first artifact to each known artifact as a function of a displacement of the first artifact relative to each known artifact.

### Claim 31 (depends on 29)

The non-transitory computer readable medium of claim 29, wherein the known artifacts that have been assessed as suitable for super-resolution imaging comprises artifacts where super-resolution images were generated and determined to be high-confidence super-resolution images.

### Claim 32 (depends on 28)

The non-transitory computer readable medium of claim 28, wherein determining, by the computing system, that the second artifact of the plurality of artifacts is not suitable for super-resolution imaging comprises:
cross-correlating the second artifact to known artifacts that have been assessed as not being suitable for super-resolution imaging.

### Claim 33 (depends on 32)

The non-transitory computer readable medium of claim 32, wherein cross-correlating the second artifact to the known artifacts that have been assessed as not being suitable for super-resolution imaging comprises:
measuring a similarity of the second artifact to each known artifact as a function of a displacement of the second artifact relative to each known artifact.

### Claim 34 (depends on 28)

The non-transitory computer readable medium of claim 28, further comprising:
determining, by the computing system, a total number of artifacts on the specimen based on the single coherent image.

### Claim 35

A system comprising:
a processor; and
a memory having programming instructions stored thereon, which when executed by the processor, causes the system to perform operations comprising:
obtaining a low resolution image of a specimen using a low resolution objective of a microscopy inspection system;
detecting a plurality of artifacts in the low resolution image;
determining that a first artifact of the plurality of artifacts is suitable for super-resolution imaging;
determining that a second artifact of the plurality of artifacts is not suitable for super-resolution imaging; and
based on the determining,
generating a super-resolution image of a first portion of the specimen that includes the first artifact,
generating a high resolution image of a second portion of the specimen that includes the second artifact, and
generating a single coherent image of the specimen by combining the super-resolution image and the high resolution image.

### Claim 36 (depends on 35)

The system of claim 35, wherein determining that the first artifact of the plurality of artifacts is suitable for super-resolution imaging comprises:
cross-correlating the first artifact to known artifacts that have been assessed as suitable for super-resolution imaging.

### Claim 37 (depends on 36)

The system of claim 36, wherein cross-correlating the first artifact to the known artifacts that have been assessed as suitable for super-resolution imaging comprises:
measuring a similarity of the first artifact to each known artifact as a function of a displacement of the first artifact relative to each known artifact.

### Claim 38 (depends on 35)

The system of claim 35, wherein determining that the second artifact of the plurality of artifacts is not suitable for super-resolution imaging comprises:
cross-correlating the second artifact to known artifacts that have been assessed as not being suitable for super-resolution imaging.

### Claim 39 (depends on 38)

The system of claim 38, wherein cross-correlating the second artifact to the known artifacts that have been assessed as not being suitable for super-resolution imaging comprises:
measuring a similarity of the second artifact to each known artifact as a function of a displacement of the second artifact relative to each known artifact.

### Claim 40 (depends on 35)

The system of claim 35, wherein the operations further comprise:
determining a total number of artifacts on the specimen based on the single coherent image.
