# US 12,002,196 B2 · Electronic device and method for marking defects of products

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,002,196 B2
- Document ID: US12002196B2
- Status: Granted
- Kind: B2
- Application number: 17/395,735
- Filed: 2021-08-06
- Published: 2022-02-10
- Granted: 2024-06-04
- Earliest claimed: 2020-08-07
- Assignees: Hon Hai Precision Industry Co., Ltd.
- Applicants: Hon Hai Precision Industry Co., Ltd.
- Inventors: Chih-Yuan Chuang
- Web page: https://patentgrep.com/patent/US12002196B2

## CPC

- G06T 7/001: {using an image reference approach}
- B25J 9/1687: {Assembly, peg and hole, palletising, straight line, weaving pattern movement}
- B25J 9/1697: {Vision controlled systems}
- G05B 2219/45066: Inspection robot
- G05B 2219/45134: Marking
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20132: Image cropping
- G06T 2207/30164: Workpiece; Machine component
- G06T 2207/30204: Marker
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

A method for marking defects of products implemented in an electronic device is provided. The method includes obtaining at least one detection image of a product to be marked; recognizing a position and a type of at least one defect on the product according to the at least one detection image; transmit the position and the type of the at least one apparent defect to a robot arm; controlling the robot arm to mark the at least one defect on an adhesive film according to the position and the type of the at least one defect; and controlling a film coating unit to apply the adhesive film which is marked to the product.

## Claims

### Claim 1

An electronic device comprising:
at least one processor;
an AOI (Automatic Optical Inspection) system coupled to the at least one processor;
a robot arm coupled to the at least one processor;
a film coating unit coupled to the at least one processor; and
a storage device coupled to the at least one processor and storing instructions for execution by the at least one processor to cause the at least one processor to:
control the AOI system to recognize a position and a type of at least one defect on a product;
obtain parameters of at least one detection image of the product;
compare the parameters of the at least one detection image of the product with parameters of a pre-stored reference image;
detect differences between the parameters of the at least one detection image and the reference image;
determine at least one position where a difference exists and exceeds a preset range, so as to obtain the position of the at least one defect on the product;
transmit the position and the type of the at least one defect to the robot arm;
control the robot arm to mark the at least one defect on an adhesive film according to the position and the type of the at least one defect; and
control the film coating unit to apply the marked adhesive film to the product.

### Claim 2 (depends on 1)

The electronic device according to claim 1, further comprising:
a roller coupled to the at least one processor and configured to calculate a length of the adhesive film required for coating the product.

### Claim 3 (depends on 2)

The electronic device according to claim 2, wherein the at least one processor is further caused to:
control, in response that the robot arm completes marking the at least one defect on the adhesive film and starts to transfer the product to the film coating unit, the roller to start rolling;
control the roller to stop rolling after the product is transferred to the film coating unit;
record the number of turns rolled by the roller; and
calculate the length of the adhesive film required for coating the product by multiplying a circumference of the roller and the recorded number of turns.

### Claim 4 (depends on 1)

The electronic device according to claim 1, wherein in response that the product is placed on an assembly line for being transferred, the adhesive film is arranged on one end of the assembly line, and a traction device is arranged on the other end of the assembly line, the traction device pulls the adhesive film to transfer together with the product, the adhesive film pulled by the traction device is located to be in parallel with the assembly line and above the product.

### Claim 5 (depends on 4)

The electronic device according to claim 4, wherein the at least one processor is further caused to:
crop at least one detection image of the product into a plurality of blocks;
input each of the plurality of blocks to a preset defect recognition model according to the position of each of the plurality of blocks in the at least one detection image;
obtain a defect type of each of the plurality of blocks; and
determine the type of the at least one defect of the product according to the defect type of each of the plurality of blocks.

### Claim 6

A method for marking defects of products implemented in an electronic device comprising:
obtaining at least one detection image of a product to be marked;
recognizing a position and a type of at least one defect on the product according to the at least one detection image;
obtaining parameters of at least one detection image of the product;
comparing the parameters of the at least one detection image of the product with parameters of a pre-stored reference image;
detecting differences between the parameters of the at least one detection image and the reference image;
determining at least one position where a difference exists and exceeds a preset range, so as to obtain the position of the at least one defect on the product;
transmitting the position and the type of the at least one defect to a robot arm;
controlling the robot arm to mark the at least one defect on an adhesive film according to the position and the type of the at least one defect; and
controlling a film coating unit to apply the marked adhesive film to the product.

### Claim 7 (depends on 6)

The method according to claim 6, the method of recognizing a type of at least one defect on the product by a preset defect recognition model detecting the at least one detection image comprises:
cropping at least one detection image of the product into a plurality of blocks;
inputting each of the plurality of blocks to the preset defect recognition model according to the position of each of the plurality of blocks in the at least one detection image;
obtaining a defect type of each of the plurality of blocks; and
determining the type of the at least one defect of the product according to the defect type of each of the plurality of blocks.

### Claim 8 (depends on 6)

The method according to claim 6, further comprising:
controlling, in response that the robot arm completes marking the at least one defect on the adhesive film and starts to transfer the product to the film coating unit, a roller to start rolling;
controlling the roller to stop rolling after the product is transferred to the film coating unit;
recording the number of turns rolled by the roller; and
calculating the length of the adhesive film required for coating the product by multiplying a circumference of the roller and the recorded number of turns.