# US 2026/0268469 A1 · Method and system for path planning of binocular vision-based inspection machine for substrates

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0268469 A1
- Document ID: US20260268469A1
- Status: Published application
- Kind: A1
- Application number: 19/642,632
- Filed: 2026-04-09
- Published: 2026-09-10
- Earliest claimed: 2025-06-12
- Assignees: Guangdong University of Technology
- Applicants: Guangdong University of Technology
- Inventors: Hao ZHANG; Qiang LIU; Bozheng HE; Wentao JIANG; Lijun WEI
- Web page: https://patentgrep.com/patent/US20260268469A1

## CPC

- G06T 7/0004: {Industrial image inspection}
- G06T 7/593: from stereo images
- G06T 7/60: Analysis of geometric attributes
- G06T 7/85: {Stereo camera calibration}
- G06T 2207/10012: Stereo images
- G06T 2207/30141: Printed circuit board [PCB]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A path planning method for a binocular vision-based inspection machine for substrates, in which (S1) dimensional data of a printed circuit board (PCB) substrate and two camera lens modules are analyzed and processed; (S2) a division scheme based on hole position characteristics of the PCB substrate and processed dimensional data is designed, and the PCB substrate is divided into regions based on the camera lens modules according to the division scheme; working ranges of the camera lens modules are constrained according to sizes and travel ranges of the camera lens modules; (S3) an integer programming model for task pairing scheduling for the camera lens modules is established; and (S4) a single-region path planning is performed algorithm, where for each of the two camera lens modules, a shortest path connecting all inspection holes within a current region is determined using a variable neighborhood search algorithm.

## Claims

### Claim 1

A path planning method for a binocular vision-based inspection machine for substrates, comprising:
(S1) analyzing and processing dimensional data of a printed circuit board (PCB) substrate and two camera lens modules, wherein the dimensional data comprises parameters of the two camera lens modules and data of the PCB substrate;
(S2) designing a division scheme based on hole position characteristics of the PCB substrate and processed dimensional data, and dividing the PCB substrate into eight working regions based on the two camera lens modules according to the division scheme; constraining working ranges of the two camera lens modules according to sizes and travel ranges of the two camera lens modules; and evaluating collision risks within each of the eight working regions to coordinate movement positions of the two camera lens modules and avoid mutual interference between the two camera lens modules;
(S3) establishing an integer programming model for task pairing scheduling for the two camera lens modules;
according to the eight working regions, assigning a first inspection task set to one of the two camera lens modules, and assigning a second inspection task set to the other of the two camera lens modules, wherein each inspection task in the first inspection task set and the second inspection task set has a determined processing time; and
performing pairing analysis between the first inspection task set and the second inspection task set, wherein two individual tasks without collision risk constitute a process, an individual task that fails to be paired independently forms a process, and a time for each process is determined by a longest processing time of an individual task among tasks within a corresponding process; and
(S4) performing a single-region path planning algorithm, wherein for each of the two camera lens modules, a shortest path connecting all inspection holes within a current region is determined using a variable neighborhood search algorithm;
wherein in step (S3), problem description is as follows:
the two camera lens modules are denoted as a first machine and a second machine, respectively; the first inspection task set does not overlap with the second inspection task set; and the first inspection task set and the second inspection task set are denoted as JA={1, 2 . . . , m} and JB {1, 2 . . . , n}, respectively;
each task is restricted to be executed by one of the two camera lens modules to which it belongs;
a processing time of each task is determined based on a number of inspection points within a corresponding region, such that each task has a predetermined processing time;
a processing time of a task assigned to the first machine is denoted as
p
i
A
,
and a processing time of a task assigned to the second machine is denoted as
p
i
B
;
tasks are executed in a paired mode, wherein one task from the first inspection task set and one task from the second inspection task set are executed simultaneously to form the process, two tasks being referred to as paired tasks;
a duration of the process is determined by one of the paired tasks with a maximum processing time;
tasks that are not paired are executed individually, each forming an independent process, and a duration of the independent process is equal to a processing time of a corresponding task, defined as:
T
i
,
j
=
max
⁡
(
p
i
A
,
p
j
B
)
,
i
∈
J
A
,
j
∈
J
B
;
if a conflict exists between two tasks, the two tasks are not allowed to be paired for inspection; a conflict relationship is given by a conflict matrix C=[Ci,j]∈{0,1}m×n, wherein
C
i
,
j
=
{
1
there
⁢
is
⁢
a
⁢
conflict
⁢
between
⁢
task
⁢
i
⁢
and
⁢
task
⁢
j
0
task
⁢
i
⁢
is
⁢
allowed
⁢
to
⁢
be
⁢
paired
⁢
with
⁢
task
⁢
j
;
decision variables are expressed as:
xi,j∈{0,1}: if task i∈JA is paired with task j∈JB, xi,j=1;
ui∈{0,1}: if task i∈JA is not paired, ui=1; and
vj∈{0,1}: if task j∈JB is not paired, vj=1;
an objective function is designed to minimize a total execution time of all processes, including paired and unpaired processes, defined as:
min
⁢
∑
i
=
1
m
⁢
∑
j
=
1
n
⁢
x
i
,
j
·
max
⁡
(
p
i
A
,
p
j
B
)
+
∑
i
=
1
m
⁢
u
i
·
p
i
A
+
∑
j
=
1
n
⁢
v
j
·
p
j
B
;
constraints are defined as follows:
(1) each task must be executed, and only once:
∑
j
=
1
n
⁢
x
i
,
j
+
u
i
=
1
,
∀
i
∈
J
A
;
and
∑
i
=
1
n
⁢
x
i
,
j
+
v
j
=
1
,
∀
j
∈
J
B
;
paired tasks must satisfy conflict table constraints:
x
i
,
j
≤
1
-
C
i
,
j
,
∀
i
∈
J
A
,
j
∈
J
B
;
and
(2) variables are defined as follows:
x
i
,
j
∈
{
0
,
1
}
;
u
i
∈
{
0
,
1
}
;
v
j
∈
{
0
,
1
}
;
wherein xi,j denotes a task pairing result of the two camera lens modules;
ui denotes a task pairing result of one of the two camera lens modules; and
v1 denotes a task pairing result of the other of the two camera lens modules.

### Claim 2 (depends on 1)

The path planning method of claim 1, wherein in step (S1),
a lower-left vertex of the PCB substrate is defined as an origin of a coordinate system; and the PCB substrate has a length of L along an X axis and a width of W along a Y axis;
each of the two camera lens modules has a lens diameter of D, a length of S and a width of T; and
for each of the two camera lens modules, a distance between a lens inspection point and a side away from a cross-shaped sliding stage is P, wherein the lens inspection point is a lens center.

### Claim 3 (depends on 2)

The path planning method of claim 2, wherein in step (S2),
the two camera lens modules are provided opposite to each other on two sides of an inspection platform, respectively;
each of the two camera lens modules is capable of performing planar movement;
a working range of each of the two camera lens modules is configured to cover the inspection platform;
an X-axis dividing line of the PCB substrate is transversely arranged from a midpoint of the PCB substrate in a Y-axis direction;
a Y-axis dividing line of the PCB substrate is defined such that the PCB substrate is divided into two rectangular regions with equal number of inspection points along the Y-axis direction of the PCB substrate;
a first staggered region and a second staggered region are defined in a front half of the X-axis dividing line of the PCB substrate;
upper ends of the first staggered region and the second staggered region are flush with an upper end of the PCB substrate;
a width of the first staggered region is defined by extending toward a first side of the Y-axis dividing line by a distance of 2P, wherein P is a distance between the lens inspection point and the side of a corresponding one of the two camera lens modules away from the cross-shaped sliding stage;
an edge of the first staggered region away from the Y-axis dividing line is configured as a first dividing line;
upper and lower ends of the first dividing line are connected to upper and lower ends of the PCB substrate, respectively;
a width of the second staggered region is defined by extending toward a second side of the Y-axis dividing line by the distance of 2P;
an edge of the second staggered region away from the Y-axis dividing line is configured as a second dividing line;
upper and lower ends of the second dividing line are connected to the upper and lower ends of the PCB substrate, respectively;
a third staggered region and a fourth staggered region are arranged in a rear half of the PCB substrate, and are respectively mirror-symmetrical to the first staggered region and the second staggered region with respect to the X-axis dividing line;
a third dividing line is transversely arranged at a first coordinate point located at a first side of the X-axis dividing line, and a distance between the first coordinate point and the X-axis dividing line is S/2; a fourth dividing line is transversely arranged at a second coordinate point located at a second side of the X-axis dividing line, and a distance between the second coordinate point and the X-axis dividing line is S/2, wherein S is a length of each of the two camera lens modules;
two ends of the third dividing line are respectively connected to the first dividing line and the second dividing line;
two ends of the fourth dividing line are respectively connected to the first dividing line and the second dividing line;
the first dividing line, the second dividing line, the third dividing line and the fourth dividing line are configured to enclose a rectangular area as a conflict region; and the conflict region is divided by the Y-axis dividing line into two conflict subregions;
an area between the first dividing line and a first edge of the PCB substrate is defined as a first safety region; and an area between the second dividing line and a second edge of the PCB substrate is defined as a second safety region; and
the first staggered region, the second staggered region, the third staggered region, the fourth staggered region, the two conflict subregions, the first safety region and the second safety region together constitute the eight working regions on the PCB substrate.

### Claim 4 (depends on 1)

The path planning method of claim 1, wherein in step (S2),
the Y-axis dividing line of the PCB substrate is configured to divide the PCB substrate into a first region and a second region; one of the two camera lens modules is configured to operate within the first region; and the other of the two camera lens modules is configured to operate within the second region;
when one of the two camera lens modules is positioned within a corresponding safety region, there is no collision risk for the two camera lens modules;
when the two camera lens modules are respectively located in two staggered regions diagonally opposite, rather than two staggered regions on the same side, no collision occurs; and
when one of the two camera lens modules operates within a conflict subregion, no collision occurs as long as the other of the two camera lens modules is located within its corresponding safety region.

### Claim 5 (depends on 1)

The path planning method of claim 1, wherein in step (S3),
in region planning of the two camera lens modules, the two camera lens modules are allowed to perform detection simultaneously;
in order to evaluate efficiency of the path planning method, an equivalent hole count concept is introduced relative to a single-camera detection algorithm, wherein a hole detected simultaneously by the two camera lens modules within the same unit time is counted as one equivalent hole;
when there is a conflict occurring between the detection regions of the two camera lens modules, sequential detection is required, and a hole detected in each of two successive unit times is counted as one equivalent hole, thereby resulting in two equivalent holes;
in the division scheme, a first safety region and a second safety region do not interfere with any other region, whereas a conflict region interferes with non-safety regions, indicating that when one of the two camera lens modules operates in the conflict region, the other of the two camera lens modules is required to operate in a safety region;
considering detection region distribution on the PCB substrate, the conflict region on one side is combined with the safety region on the other side, and such two region combinations are respectively inspected at the beginning and at the end, respectively;
two region-planning combination schemes are provided;
in a first combination scheme, a detection order in a first-side region is set as follows:
a first safety region, a first rear staggered region, a first front staggered region and a first conflict region;
in the first combination scheme, a detection order in a second-side region is set as follows:
a second conflict region, a second front staggered region, a second rear staggered region and a second safety region;
in a second combination scheme, a detection order in the first-side region is set as follows:
the first safety region, the first front staggered region, the first rear staggered region and the first conflict region;
in the second combination scheme, a detection order in the second-side region is set as follows:
the second conflict region, the second rear staggered region, the second front staggered region and the second safety region;
one of the two region-planning combination schemes having a minimum equivalent hole count is selected as a region planning result;
after the region-planning combination scheme is determined, regions are detected according to a corresponding detection order;
since the number of detection holes and sizes of the regions are not necessarily identical, it is assumed that when the first machine completes detection of a current region and proceeds to detect a next region, it is required to check a current region of the second machine;
if a conflict exists, the first machine is temporarily blocked, and waits until the second machine moves to another region for re-evaluation; and
if no conflict exists, the first machine proceeds to inspect the next region.

### Claim 6 (depends on 1)

The path planning method of claim 1, wherein in step (S4), a single-region path planning algorithm is executed, wherein a region detection problem is modeled as a plurality of traveling salesman problems (TSPs), such that the shortest path connecting all detection holes within the current region is calculated;
a starting point is defined at a region vertex to ensure that detection time for each region is maintained constant;
since the PCB substrate is partitioned into a plurality of regions, the number of detection holes within each single region is small, and thus the variable neighborhood search algorithm is applied to solve the plurality of TSPs.

### Claim 7 (depends on 1, 2, 3, 4, 5, 6)

A binocular vision-based inspection system for implementing the path planning method of any one of claims 1-6, and the binocular vision-based inspection system comprising:
a first cross-shaped sliding stage;
a first camera lens module;
an inspection platform;
a second camera lens module;
a second cross-shaped sliding stage; and
a controller;
wherein the first camera lens module is mounted on the first cross-shaped sliding stage;
the second camera lens module is mounted on the second cross-shaped sliding stage;
the first cross-shaped sliding stage and the second cross-shaped sliding stage are arranged in mirror symmetry;
the inspection platform is provided between the first cross-shaped sliding stage and the second cross-shaped sliding stage; and
the first cross-shaped sliding stage, the first camera lens module, the second camera lens module and the second cross-shaped sliding stage are each communicatively connected to the controller.
