# US 2021/0342979 A1 · System, method and apparatus for macroscopic inspection of reflective specimens

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342979 A1
- Document ID: US20210342979A1
- Status: Published application
- Kind: A1
- Application number: 17/375,229
- Filed: 2021-07-14
- Published: 2021-11-04
- Earliest claimed: 2019-08-07
- Assignees: Nanotronics Imaging, Inc.
- Applicants: Nanotronics Imaging, Inc.
- Inventors: Jonathan Lee; Damas Limoge; Matthew C. Putman; John B. Putman; Michael Moskie
- Web page: https://patentgrep.com/patent/US20210342979A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G06T 5/77: Retouching; Inpainting; Scratch removal
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 23/50: Constructional details
- H04N 23/56: provided with illuminating means
- H04N 23/60: Control of cameras or camera modules
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- G06T 2207/10056: Microscopic image
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30024: Cell structures in vitro; Tissue sections in vitro
- G06T 2207/30168: Image quality inspection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An inspection apparatus includes a specimen stage configured to retain a specimen, at least three imaging devices arranged in a triangular array positioned above the specimen stage, each of the at least three imaging devices configured to capture an image of the specimen, one or more sets of lights positioned between the specimen stage and the at least three imaging devices, and a control system in communication with the at least three imaging devices.

## Claims

### Claim 1

An inspection apparatus, comprising:
a specimen stage configured to retain a specimen;
at least three imaging devices arranged in a triangular array positioned above the specimen stage, each of the at least three imaging devices configured to capture an image of the specimen;
one or more sets of lights positioned between the specimen stage and the at least three imaging devices; and
a control system in communication with the at least three imaging devices, the control system comprising:
a processor; and
a memory having programming instructions stored thereon, which, when executed by the processor, performs operations comprising:
initializing a first imaging device of the at least three imaging devices to capture a first image of the specimen;
initializing a second imaging device of the at least three imaging devices to capture a second image of the specimen;
initializing a third imaging device of the at least three imaging devices to capture a third image of the specimen;
receiving the first image from the first imaging device, the second image from the second imaging device, and the third image from the third imaging device;
for each of the first image, the second image, and the third image, identifying an artifact contained therein;
removing, from each of the first image, the second image, and the third image, the artifact; and
generating an artifact-free image of the specimen using remaining portions of the first image, the second image, and the third image.

### Claim 2 (depends on 1)

The inspection apparatus of claim 1, where removing, from each of the first image, the second image, and the third image, the artifact comprises:
identifying a first area within the first image that includes a first set of artifacts;
removing the first area from the first image;
identifying a second area within the second image that includes a second set of artifacts;
removing the second area from the second image;
identifying a third area within the third image that includes a third set of artifacts; and
removing the third area from the third image.

### Claim 3 (depends on 2)

The inspection apparatus of claim 2, wherein generating the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:
stitching together the first image with the first area removed, the second image with the second area removed, and the third image with the third area removed.

### Claim 4 (depends on 1)

The inspection apparatus of claim 1, wherein for each of the first image, the second image, and the third image, identifying the artifact contained therein comprises:
using a computer vision technique to identify pixels in each of the first image, the second image, and the third image that correspond to the artifact.

### Claim 5 (depends on 4)

The inspection apparatus of claim 4, where removing, from each of the first image, the second image, and the third image, the artifact comprises:
removing the identified pixels from each of the first image, the second image, and the third image.

### Claim 6 (depends on 5)

The inspection apparatus of claim 5, wherein generating the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:
blending pixels surrounding the removed pixels to generate the artifact-free image.

### Claim 7 (depends on 1)

The inspection apparatus of claim 1, wherein each artifact corresponds to a reflection of one of the at least three or more imaging devices.

### Claim 8

A method of generating an artifact-free image of a specimen with a macro inspection system, comprising:
receiving, by a computing system from a first imaging device of the macro inspection system, a first image of the specimen;
receiving, by the computing system from a second imaging device of the macro inspection system, a second image of the specimen;
receiving, by the computing system from a third imaging device of the macro inspection system, a third image of the specimen,
wherein the first imaging device, the second imaging device, and the third imaging device are arranged in a triangular array above the specimen;
for each of the first image, the second image, and the third image, identifying, by the computing system, an artifact contained therein;
removing, by the computing system, from each of the first image, the second image, and the third image, the artifact; and
generating, by the computing system, an artifact-free image of the specimen using remaining portions of the first image, the second image, and the third image.

### Claim 9 (depends on 8)

The method of claim 8, where removing, by the computing system, from each of the first image, the second image, and the third image, the artifact comprises:
identifying a first area within the first image that includes a first set of artifacts;
removing the first area from the first image;
identifying a second area within the second image that includes a second set of artifacts;
removing the second area from the second image;
identifying a third area within the third image that includes a third set of artifacts; and
removing the third area from the third image.

### Claim 10 (depends on 9)

The method of claim 9, wherein generating, by the computing system, the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:
stitching together the first image with the first area removed, the second image with the second area removed, and the third image with the third area removed.

### Claim 11 (depends on 8)

The method of claim 8, wherein for each of the first image, the second image, and the third image, identifying, by the computing system, the artifact contained therein comprises:
using a computer vision technique to identify pixels in each of the first image, the second image, and the third image that correspond to an artifact.

### Claim 12 (depends on 11)

The method of claim 11, where removing, by the computing system, from each of the first image, the second image, and the third image, the artifact comprises:
removing the identified pixels from each of the first image, the second image, and the third image.

### Claim 13 (depends on 12)

The method of claim 12, wherein generating, by the computing system, the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:
blending pixels surrounding the removed pixels to generate the artifact-free image.

### Claim 14 (depends on 8)

The method of claim 8, wherein each artifact corresponds to a reflection of one of the first imaging device, the second imaging device, or the third imaging device.

### Claim 15

A non-transitory computer readable medium having sequences of instructions, which, when executed by a processor, causes a computing system to perform operations comprising:
receiving, by the computing system from a first imaging device of a macro inspection system, a first image of a specimen;
receiving, by the computing system from a second imaging device of the macro inspection system, a second image of the specimen;
receiving, by the computing system from a third imaging device of the macro inspection system, a third image of the specimen,
wherein the first imaging device, the second imaging device, and the third imaging device are arranged in a triangular array above the specimen;
for each of the first image, the second image, and the third image, identifying, by the computing system, an artifact contained therein;
removing, by the computing system, from each of the first image, the second image, and the third image, the artifact; and
generating, by the computing system, an artifact-free image of the specimen using remaining portions of the first image, the second image, and the third image.

### Claim 16 (depends on 15)

The non-transitory computer readable medium of claim 15, where removing, by the computing system, from each of the first image, the second image, and the third image, the artifact comprises:
identifying a first area within the first image that includes a first set of artifacts;
removing the first area from the first image;
identifying a second area within the second image that includes a second set of artifacts;
removing the second area from the second image;
identifying a third area within the third image that includes a third set of artifacts; and
removing the third area from the third image.

### Claim 17 (depends on 16)

The non-transitory computer readable medium of claim 16, wherein generating, by the computing system, the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:
stitching together the first image with the first area removed, the second image with the second area removed, and the third image with the third area removed.

### Claim 18 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein for each of the first image, the second image, and the third image, identifying, by the computing system, the artifact contained therein comprises:
using a computer vision technique to identify pixels in each of the first image, the second image, and the third image that correspond to an artifact.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, where removing, by the computing system, from each of the first image, the second image, and the third image, the artifact comprises:
removing the identified pixels from each of the first image, the second image, and the third image.

### Claim 20 (depends on 19)

The non-transitory computer readable medium of claim 19, wherein generating, by the computing system, the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:
blending pixels surrounding the removed pixels to generate the artifact-free image.
