# US 2022/0284561 A1 · Detecting an excursion of a cmp component using time-based sequence of images and machine learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284561 A1
- Document ID: US20220284561A1
- Status: Published application
- Kind: A1
- Application number: 17/678,939
- Filed: 2022-02-23
- Published: 2022-09-08
- Earliest claimed: 2021-03-05
- Assignees: Applied Materials, Inc.
- Applicants: Applied Materials, Inc.
- Inventors: Sidney P. Huey; Thomas Li; Benjamin Cherian
- Web page: https://patentgrep.com/patent/US20220284561A1

## CPC

- G06T 7/001: {using an image reference approach}
- B24B 37/005: Control means for lapping machines or devices
- G06T 7/0004: {Industrial image inspection}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30148: Semiconductor; IC; Wafer
- G06T 2207/30164: Workpiece; Machine component
- G06T 2207/30232: Surveillance
- G06T 2207/30241: Trajectory
- H10P 52/402: {of semiconductor materials}
- H10P 74/203: {Structural properties, e.g. testing or measuring thicknesses, line widths, warpage, bond strengths or physical defects}
- H10P 95/062: {involving a dielectric removal step}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B24B: MACHINES, DEVICES, OR PROCESSES FOR GRINDING OR POLISHING (grinding of gear teeth B23F, of screw-threads B23G1/36; by electro-erosion B23H; abrasive or related blasting B24C; tools for grinding, buffing or sharpening B24D; polishing compositions C09G1/00; abrasives C09K3/14; electrolytic etching or polishing C25F3/00; grinding arrangements for use on assembled railway tracks E01B31/17); DRESSING OR CONDITIONING OF ABRADING SURFACES; FEEDING OF GRINDING, POLISHING, OR LAPPING AGENTS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H10P: GENERIC PROCESSES OR APPARATUS FOR THE MANUFACTURE OR TREATMENT OF DEVICES COVERED BY CLASS H10

## Abstract

Monitoring operations of a polishing system includes obtaining a time-based sequence of reference images of a component of the polishing system performing operations during a test operation of the polishing system, receiving from a camera a time-based sequence of monitoring images of an equivalent component of an equivalent polishing system performing operations during polishing of a substrate, determining a difference value for the time-based sequence of monitoring images by comparing the time-based sequence of reference images to the time-based sequence of monitoring image using an image processing algorithm, determining whether the difference value exceeds a threshold, and in response to determining the difference value exceeds the threshold, indicating an excursion.

## Claims

### Claim 1

A polishing system, comprising:
a platen to support a polishing pad;
a carrier head to hold a substrate against the polishing pad;
a component selected from a group of components including the platen, the carrier head, a conditioner arm, a load cup, or a robot arm;
a camera positioned to capture a time-based sequence of monitoring images of the component; and
a controller configured to
receive from the camera a time-based sequence of monitoring images of the component performing operations during polishing of a substrate, and
analyze the time-based sequence of monitoring images with a machine learning model trained by training examples to detect and indicate excursions of the component from expected operations, wherein the training examples comprise a time-based sequence of reference images of a reference component of a reference polishing system performing operations during a test operation, and
indicate an excursion based on the analysis.

### Claim 2 (depends on 1)

The system of claim 1, wherein the machine learning model is configured to, using an object tracking algorithm, determine motions of the component based on input of the time-based sequence of monitoring images.

### Claim 3 (depends on 1)

The system of claim 1, wherein the machine learning model is configured to predict a physical field profile of the component based on input of the time-based sequence of monitoring images.

### Claim 4 (depends on 3)

The system of claim 3, wherein the physical field profile of the component comprises: a temperature field of a rotating polishing pad, or a pressure field applied on a wafer.

### Claim 5 (depends on 3)

The system of claim 3, wherein the excursion comprises departure of the component from an expected path of motion.

### Claim 6 (depends on 1)

The system of claim 1, wherein the controller is configured to generate an alarm in response to an indication of an excursion.

### Claim 7 (depends on 1)

The system of claim 1, further comprising a display, and wherein the controller is configured to generating a user presentation on the display, wherein the user presentation comprises the time-based sequence of monitoring images and one or more overlays each representing a respective characteristic of the time-based sequence of monitoring images.

### Claim 8

A computer program product, tangibly embodied in computer-readable media, comprising instructions to cause one or more computers to:
receive from a camera a time-based sequence of monitoring images of a component of a polishing system performing operations during polishing of a substrate; and
analyze the time-based sequence of monitoring images with a machine learning model trained by training examples to detect and indicate excursions of the component from expected operations, wherein the training examples comprise a time-based sequence of reference images of a reference component of a reference polishing system performing operations during a test operation.

### Claim 9 (depends on 8)

The computer program product of claim 8, wherein the machine learning model is configured to, using an object tracking algorithm, determine motions of the component based on input of the time-based sequence of monitoring images.

### Claim 10 (depends on 8)

The computer program product of claim 8, wherein the machine learning model is configured to predict a physical field profile of the component based on input of the time-based sequence of monitoring images.

### Claim 11 (depends on 10)

The computer program product of claim 10, wherein the physical field profile of the component comprises: a temperature field of a rotating polishing pad, or a pressure field applied on a wafer.

### Claim 12 (depends on 8)

The computer program product of claim 8, further comprising instructions to:
receive from a camera a time-based sequence of monitoring images encompassing a plurality of components of the polishing system performing operations during polishing of a substrate;
input the time-based sequence of monitoring images analyzing into a machine learning model trained by training examples to detect excursions of the plurality of components from expected operations; wherein the training examples comprise a time-based sequence of reference images of a plurality of reference components of a reference polishing system performing operations during a test operation, wherein the plurality of reference components include at least components equivalent to the plurality of components; and
receive from the machine learning model an indication of an excursion of the component from expected operation.

### Claim 13 (depends on 8)

The computer program product of claim 8, wherein the excursion comprises departure of the component from an expected path of motion.

### Claim 14 (depends on 8)

The computer program product of claim 8, wherein the excursion comprises an overspray of fluid from a fluid dispenser.

### Claim 15 (depends on 8)

The computer program product of claim 8, wherein the excursion comprises a wafer slippage when undergoing polishing.

### Claim 16 (depends on 8)

The computer program product of claim 8, comprising instructions to generate an alarm in response to an indication of an excursion.

### Claim 17 (depends on 8)

The computer program product of claim 8, further comprising instructions to generate a user presentation on a user interface component, wherein the user presentation comprises the time-based sequence of monitoring images and one or more overlays each representing a respective characteristic of the time-based sequence of monitoring images.

### Claim 18

A method for monitoring operation of a polishing system, the method comprising:
receiving from a camera a time-based sequence of monitoring images of a component of a polishing system performing operations during polishing of a substrate;
inputting the time-based sequence of monitoring images analyzing into a machine learning model trained by training examples to detect excursions of the component from expected operations, wherein the training examples comprise a time-based sequence of reference images of a reference component of a reference polishing system performing operations during a test operation and
receiving from the machine learning model an indication of an excursion of the component from expected operations.

### Claim 19 (depends on 18)

The method of claim 18, wherein the excursion comprises departure of the component from an expected path of motion.

### Claim 20 (depends on 19)

The method of claim 19, wherein the component comprises one of a carrier head, a conditioner arm, a load cup, a platen or a robot arm.
