# US 2022/0284549 A1 · System, method and apparatus for macroscopic inspection of reflective specimens

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284549 A1
- Document ID: US20220284549A1
- Status: Published application
- Kind: A1
- Application number: 17/664,535
- Filed: 2022-05-23
- Published: 2022-09-08
- Earliest claimed: 2019-08-07
- Assignees: Nanotronics Imaging, Inc.
- Applicants: Nanotronics Imaging, Inc.
- Inventors: Matthew C. Putman; John B. Putman; John Moffitt; Michael Moskie; Jeffrey Andresen; Scott Pozzi-Loyola; Julie Orlando
- Web page: https://patentgrep.com/patent/US20220284549A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G01N 21/8806: {Specially adapted optical and illumination features}
- G01N 21/8851: {Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges (G01N21/8806 and G01N21/93 - G01N21/95692 take precedence; optical measurement of dimensions G01B11/00; optical scanning G02B26/10; image transformation G06T3/00; computerised image enhancement G06T5/00; image processing per se for flaw detection G06T7/0002)}
- G02B 21/361: {Optical details, e.g. image relay to the camera or image sensor (G02B21/364 takes precedence; illumination details G02B21/06 and subgroups)}
- G02B 21/367: {providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison}
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/77: Retouching; Inpainting; Scratch removal
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06V 10/145: Illumination specially adapted for pattern recognition, e.g. using gratings
- G06V 10/147: Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19)
- G06V 10/24: Aligning, centring, orientation detection or correction of the image
- H04N 23/56: provided with illuminating means
- H04N 23/617: Upgrading or updating of programs or applications for camera control
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- H04N 23/74: by influencing the scene brightness using illuminating means
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G02B 21/06: Means for illuminating specimens
- G06T 2207/10056: Microscopic image
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30024: Cell structures in vitro; Tissue sections in vitro
- G06T 2207/30168: Image quality inspection
- G06V 2201/06: Recognition of objects for industrial automation
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 23/50: Constructional details
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An inspection apparatus includes a specimen stage, one or more imaging devices and a set of lights, all controllable by a control system. By translating or rotating the one or more imaging devices or specimen stage, the inspection apparatus can capture a first image of the specimen that includes a first imaging artifact to a first side of a reference point and then capture a second image of the specimen that includes a second imaging artifact to a second side of the reference point. The first and second imaging artifacts can be cropped from the first image and the second image respectively, and the first image and the second image can be digitally stitched together to generate a composite image of the specimen that lacks the first and second imaging artifacts.

## Claims

### Claim 1

An inspection system, comprising:
a specimen stage configured to retain a specimen;
an imaging device positioned above the specimen stage, the imaging device configured to capture an image of the specimen from the specimen stage;
a set of lights disposed on a platform between the specimen stage and the imaging device; and
a control system in communication with at least one of the specimen stage, the imaging device, and the platform, the control system configured to perform operations comprising:
receiving, via the imaging device, an image of the specimen;
analyzing, via a machine learning model, the image to determine a classification of the specimen;
based on the classification, automatically selecting an illumination profile for the specimen; and
based on the illumination profile, activating and adjusting one or more of an intensity, color, or position of the set of lights to achieve the illumination profile for the specimen.

### Claim 2 (depends on 1)

The inspection system of claim 1, wherein the operations further comprise:
receiving image data associated with the image of the specimen, the image data comprising pixel intensity values.

### Claim 3 (depends on 2)

The inspection system of claim 2, wherein analyzing, via the machine learning model, the image to determine the classification of the specimen comprises:
determining the classification of the specimen based on the image data associated with the image of the specimen.

### Claim 4 (depends on 1)

The inspection system of claim 1, wherein analyzing, via the machine learning model, the image to determine the classification of the specimen comprises:
outputting a classification for a feature of the specimen.

### Claim 5 (depends on 1)

The inspection system of claim 1, wherein automatically selecting the illumination profile comprises:
querying an illumination profile database that comprising a plurality of illumination profiles, each illumination profile of the plurality of illumination profiles is associated with a specimen feature type.

### Claim 6 (depends on 5)

The inspection system of claim 5, wherein the illumination profile comprises:
a configuration for the set of lights; and
a range of distances between the specimen and a lens.

### Claim 7 (depends on 5)

The inspection system of claim 5, wherein automatically selecting the illumination profile for the specimen comprises:
matching the classification of the specimen to the plurality of illumination profiles to identify the illumination profile for the specimen.

### Claim 8

A method comprising:
receiving, by a control system from an imaging device, image data of a specimen positioned on a specimen stage, wherein a set of lights disposed on a platform between the specimen stage and the imaging device illuminates the specimen for generating the image data;
analyzing, by the control system via a machine learning model, the image data to determine a classification of the specimen;
based on the classification, automatically selecting, by the control system, an illumination profile for the specimen; and
based on the illumination profile, activating and adjusting, by the control system, one or more of an intensity, color, or position of the set of lights to achieve the illumination profile for the specimen.

### Claim 9 (depends on 8)

The method of claim 8, wherein the image data comprises an image of the specimen and pixel intensity values of the image.

### Claim 10 (depends on 9)

The method of claim 9, wherein analyzing, by the control system via the machine learning model, the image data to determine the classification of the specimen comprises:
determining the classification of the specimen based on the image and the pixel intensity values associated with the image of the specimen.

### Claim 11 (depends on 8)

The method of claim 8, wherein analyzing, by the control system via the machine learning model, the image data to determine the classification of the specimen comprises:
outputting a classification for a feature of the specimen.

### Claim 12 (depends on 8)

The method of claim 8, wherein automatically selecting, by the control system, the illumination profile comprises:
querying an illumination profile database that comprising a plurality of illumination profiles, each illumination profile of the plurality of illumination profiles is associated with a specimen feature type.

### Claim 13 (depends on 12)

The method of claim 12, wherein the illumination profile comprises:
a configuration for the set of lights; and
a range of distances between the specimen and a lens.

### Claim 14 (depends on 12)

The method of claim 12, wherein automatically selecting, by the control system, the illumination profile for the specimen comprises:
matching the classification of the specimen to the plurality of illumination profiles to identify the illumination profile for the specimen.

### Claim 15

An inspection system, comprising:
a specimen stage configured to retain a specimen;
an imaging device positioned above the specimen stage, the imaging device configured to capture an image of the specimen from the specimen stage; and
a control system in communication with at least one of the specimen stage and the imaging device, the control system configured to perform operations comprising:
receiving, via the imaging device, an image of the specimen;
analyzing, via a machine learning model, the image to determine a classification of the specimen;
based on the classification, automatically selecting an illumination profile for the specimen; and
based on the illumination profile, activating and adjusting an elevation of the specimen stage based on the illumination profile for the specimen.

### Claim 16 (depends on 15)

The inspection system of claim 15, wherein the operations further comprise:
receiving image data associated with the image of the specimen, the image data comprising pixel intensity values.

### Claim 17 (depends on 16)

The inspection system of claim 16, wherein analyzing, via the machine learning model, the image to determine the classification of the specimen comprises:
determining the classification of the specimen based on the image data associated with the image of the specimen.

### Claim 18 (depends on 15)

The inspection system of claim 15, wherein analyzing, via the machine learning model, the image to determine the classification of the specimen comprises:
outputting a classification for a feature of the specimen.

### Claim 19 (depends on 15)

The inspection system of claim 15, wherein automatically selecting the illumination profile comprises:
querying an illumination profile database that comprising a plurality of illumination profiles, each illumination profile of the plurality of illumination profiles is associated with a specimen feature type.

### Claim 20 (depends on 19)

The inspection system of claim 19, wherein automatically selecting the illumination profile for the specimen comprises:
matching the classification of the specimen to the plurality of illumination profiles to identify the illumination profile for the specimen.
