US 12,223,687 B2Granted

Image processing device, component mounting system, and image processing method

AssigneeFuji Corporation

InventorsKeiichi Ono, Kazuya Kotani, Tomoya Fujimoto

Life of this patent

Estimating the term…

Loading patent…

Abstract

An image processing device that processes a color image in which each pixel has gradation values of three primary colors of RGB includes an image acquiring section to acquire an image; a difference image generating section to use a first primary color image extracted from the color image and a second primary color image in which a gradation value of a second primary color except the first primary color is extracted from the color image, to generate a difference image; a recognition image generating section configured to generate a recognition image having a gradation value obtained by subtracting a gradation value of the difference image from a gradation value of an image in which any one of the three primary colors of RGB is extracted from the color image; and a recognition processing section configured to perform recognition processing of the recognition target using the recognition image.

Claims7

Dependent claims

A component mounting system that mounts a component on a board, comprising:

a camera configured to capture a color image of the board on which the component is mounted;
and
a processor configured to
process the color image including the component mounted on the board as a recognition target in which each pixel of the color image has gradation values of three primary colors of RGB by:
acquiring an image including the recognition target and a similar part of which a main color component is different from a main color component of the recognition target and brightness is similar to brightness of the recognition target, as the color image;
using a first primary color image in which a gradation value of a first primary color that is close to the main color component of the similar part, out of the three primary colors of RGB, is extracted from the color image and a second primary color image in which a gradation value of a second primary color except the first primary color is extracted from the color image, to generate a difference image having a gradation value based on a difference obtained by subtracting the gradation value of the second primary color image from the gradation value of the first primary color image;
generating a recognition image having a gradation value obtained by subtracting the gradation value of the difference image from a gradation value of an image in which any one of the three primary colors of RGB is extracted from the color image;
and
performing recognition processing of the component using the recognition image;
and
inspect a mounting state of the component by comparing mounting information based on the recognition image to target mounting information, and determine that the mounting state of the component is acceptable when a deviation amount of the mounting information with respect to the target mounting information is less than or equal to a predetermined value.

8 more elements

An inspection method of a component mounted on a board comprising:

capturing a color image of the board on which the component is mounted;
performing an image processing method of processing the color image including the component mounted on the board as a recognition target in which each pixel of the color image has gradation values of three primary colors of RGB, the image processing method comprising:
(a) acquiring an image including the recognition target and a similar part of which a main color component is different from a main color component of the recognition target and brightness is similar to brightness of the recognition target, as the color image;
(b) using a first primary color image in which a gradation value of a first primary color that is close to the main color component of the similar part, out of the three primary colors of RGB, is extracted from the color image and a second primary color image in which a gradation value of a second primary color except the first primary color is extracted from the color image, to generate a difference image having a gradation value based on a difference obtained by subtracting the gradation value of the second primary color image from the gradation value of the first primary color image;
(c) generating a recognition image having a gradation value obtained by subtracting the gradation value of the difference image from a gradation value of an image in which any one of the three primary colors of RGB is extracted from the color image;
and
(d) performing recognition processing of the recognition target using the recognition image;
and
inspecting a mounting state of the component by comparing mounting information based on the recognition image to target mounting information, and determine that the mounting state of the component is acceptable when a deviation amount of the mounting information with respect to the target mounting information is less than or equal to a predetermined value.

6 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/770,194Filed 6 Nov 2019
Published: US 2022/0392190 A18 Dec 2022
Granted: 11 Feb 2025
Term ends: Not estimatedThe source records don’t support an estimate.

Classification9 codes

G06T 7/0004
Inspection of images, e.g. flaw detection: industrial image inspection
G06V 10/56
Extraction of image or video features: relating to colour
G06T 5/50
Image enhancement or restoration: using two or more images, e.g. averaging or subtraction
G06T 7/90
Image analysis: determination of colour characteristics

Family

US 2022/0392190 A1Pre-grant publication · published 8 Dec 2022
US 12,223,687 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key