# US 2026/0208361 A1 · Work system and welding system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0208361 A1
- Document ID: US20260208361A1
- Status: Published application
- Kind: A1
- Application number: 19/139,979
- Filed: 2024-01-09
- Published: 2026-07-23
- Earliest claimed: 2023-01-16
- Assignees: Amada Company, Limited; The University of Tokyo
- Applicants: Amada Co., Ltd.; The University of Tokyo
- Inventors: Junichi SAITO; Masashi KANEKO; Ryota FUKUSHIMA; Rui FUKUI; Shinichi WARISAWA; Xianyin HU; Mizuki ISHIGURO; Shangyin ZOU; Shota FUKUI
- Web page: https://patentgrep.com/patent/US20260208361A1

## CPC

- B25J 9/16: Program controls (total factory control, i.e. centrally controlling a plurality of machines, G05B19/418)
- B25J 9/1697: {Vision controlled systems}
- B23K 26/032: {using optical means}
- B23K 26/044: Seam tracking
- B25J 9/1653: {parameters identification, estimation, stiffness, accuracy, error analysis}
- B25J 11/005: {Manipulators for mechanical processing tasks}
- G06T 7/0004: {Industrial image inspection}
- G06T 7/001: {using an image reference approach}
- G06T 7/13: Edge detection
- G06T 7/174: involving the use of two or more images
- G06T 7/74: {involving reference images or patches}
- G06V 10/82: using neural networks
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06T 2207/10024: Color image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30152: Solder
- G06T 2207/30164: Workpiece; Machine component
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- B23K: SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A welding system includes a welding device including a welding head, and configured to move the welding head to a welding position and perform a welding process on a workpiece using the welding head based on an operation program, a control unit configured to execute the operation program to control the welding device, an imaging device configured to image an image of the welding position and its surroundings to output the welding position image, an image processing unit configured to input the welding position image and a reference image at a reference welding position to which the welding head is to be moved according to the operation program, calculate a correction amount between the welding position shown in the welding position image and the reference welding position, and a confidence level of the welding position, and output an image for confirming the welding position, a display unit configured to display the output image, and a program correction unit configured to correct the operation program based on the output correction amount and confidence level.

## Claims

### Claim 1

A work system, comprising:
a work device including a target to be controlled, and configured to move the target to be controlled to a predetermined working position and perform a predetermined work using the target to be controlled based on a work program;
a control unit configured to execute the work program to control the work device;
an imaging device configured to image an image of the working position and surroundings of the working position to output the working position image;
an image processing unit configured to input the working position image and a reference image at a reference working position to which the target to be controlled is to be moved according to the work program, calculate a correction amount of the working position corresponding to a distance between the working position shown in the working position image and the reference working position, and a confidence level of the working position, and output an image for confirming the working position;
a display unit configured to display the image output from the image processing unit; and
a program correction unit configured to correct the work program based on the correction amount and the confidence level output from the image processing unit, wherein
the image processing unit includes:
a first image processing unit configured to generate a first heatmap image showing a distribution of similarity between the working position image and the reference image by matching feature quantities between the working position image and the reference image;
a second image processing unit configured to generate a second heatmap image showing a distribution of likelihood of the working position based on the working position image and a learned model; and
a third image processing unit configured to synthesize the first heatmap image and the second heatmap image to generate a third heatmap image, and calculate the correction amount and the confidence level of the working position, and
the display unit displays the third heatmap image.

### Claim 2

A welding system, comprising:
a welding device including a welding head, and configured to move the welding head to a welding position and perform a welding process on a workpiece using the welding head based on an operation program;
a control unit configured to execute the operation program to control the welding device;
an imaging device configured to image an image of the welding position and surroundings of the welding position to output the welding position image;
an image processing unit configured to input the welding position image and a reference image at a reference welding position to which the welding head is to be moved according to the operation program, calculate a correction amount of the welding position corresponding to a distance between the welding position shown in the welding position image and the reference welding position, and a confidence level of the welding position, and output an image for confirming the welding position;
a display unit configured to display the image output from the image processing unit; and
a program correction unit configured to correct the operation program based on the correction amount and the confidence level output from the image processing unit, wherein
the image processing unit includes:
a first image processing unit configured to generate a first heatmap image showing a distribution of similarity between the welding position image and the reference image by matching feature quantities between the welding position image and the reference image;
a second image processing unit configured to generate a second heatmap image showing a distribution of likelihood of the welding position based on the welding position image and a learned model; and
a third image processing unit configured to synthesize the first heatmap image and the second heatmap image to generate a third heatmap image, and calculate the correction amount and the confidence level of the welding position, and
the display unit displays the third heatmap image.

### Claim 3 (depends on 2)

The welding system according to claim 2, further comprising:
a program creation device configured to create the operation program for instructing movement of the welding head and a welding process performed by the welding head, wherein
the program creation device generates a reference image that includes the workpiece and a welding position of the workpiece from CAM data.

### Claim 4 (depends on 2)

The welding system according to claim 2, wherein
the third image processing unit weights each of the first heatmap image and the second heatmap image and synthesizes the first heatmap image and the second heatmap image, and generates the third heatmap image.

### Claim 5 (depends on 2)

The welding system according to claim 2, wherein
the first image processing unit extracts edge information using a first learned model from the welding position image, creates a template image made up of the edge information including the welding position from the reference image, and performs template matching on the welding position image using the created template image to generate the first heatmap image showing similarity between the welding position image and the template image, and
the second image processing unit generates the second heatmap image indicating likelihood of the welding position based on the welding position image and the second learned model.

### Claim 6 (depends on 5)

The welding system according to claim 5, wherein
the first learned model is generated by machine learning, using the welding position image as an explanatory variable and an edge image corresponding to the welding position image as an objective variable, and
the second learned model is generated by machine learning, using the welding position image as an explanatory variable and a heatmap image indicating likelihood of the welding position corresponding to the welding position image as the objective variable.

### Claim 7 (depends on 6)

The welding system according to claim 6, wherein
texture information is added to the reference image or texture information of the reference image is changed to approximate a texture similar to the texture of the welding position image, and
the second learned model is generated by machine learning, using the welding position image and the reference image as explanatory variables, and heatmap images indicating likelihood of the welding positions corresponding to the welding position image and the reference image as the objective variables.

### Claim 8 (depends on 4)

The welding system according to claim 4, wherein
the display unit displays the third heatmap image, and an operation image for adjusting weights of the first heatmap image and the second heatmap image, and
the third image processing unit changes the weights of the first heatmap image and the second heatmap image based on operation input information through the operation image, and generates the third heatmap image.
