# US 2022/0044422 A1 · Monocular vision-based method for measuring displacement and trajectory of planar motion

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044422 A1
- Document ID: US20220044422A1
- Status: Published application
- Kind: A1
- Application number: 17/507,968
- Filed: 2021-10-22
- Published: 2022-02-10
- Earliest claimed: 2020-10-22
- Assignees: Guizhou University; National Institute of Metrology, China
- Applicants: Guizhou University; National Institute of Metrology, China
- Inventors: Ming YANG; Chenguang CAI; Zhihua LIU; Wen YE; Ying ZAHNG; Yan XIA; Lei FU
- Web page: https://patentgrep.com/patent/US20220044422A1

## CPC

- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06V 10/225: {based on a marking or identifier characterising the area}
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30241: Trajectory
- G06V 2201/06: Recognition of objects for industrial automation
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A monocular vision-based method for measuring displacement and trajectory of planar motion. In this method, a sequence image of a motion of a high-contrast feature mark fixed on a moving plane to be measured is collected using a camera. A sub-pixel coordinate of a feature edge of a linear motion of the sequence in an X direction and a Y direction is extracted using a sub-pixel edge detection method, and the sub-pixel coordinate is converted into a corresponding world coordinate. The world coordinate of the feature edge is fitted based on a least squares principle to obtain a straight line of the feature edge to realize decoupling measurement of a displacement in the X direction and the Y direction. The planar motion trajectory is obtained through measuring the displacement in the X direction and the Y direction.

## Claims

### Claim 1

A method for measuring a displacement and a trajectory of a planar motion based on monocular vision, comprising:
(S1) fixing a high-contrast feature mark consisting of a rectangle and four circles around the rectangle on a working surface of a low-frequency two-component shaker such that a displacement of the rectangle in the high-contrast feature mark is consistent with a displacement of the wording surface; and collecting a sequence image of a motion of the high-contrast feature mark using a camera;
(S2) extracting a sub-pixel coordinate of a feature edge of a linear motion of the sequence image of the high-contrast feature mark in an X direction and a Y direction using a Zernike moment-based sub-pixel edge detection method; and according to a relationship between a pixel coordinate and a world coordinate of an image determined through calibration using the camera, converting the sub-pixel coordinate of the feature edge into a corresponding world coordinate;
(S3) respectively performing least-square fitting on the world coordinate of the feature edge of the linear motion in the X direction and Y direction to obtain a straight line of the feature edge; selecting a feature edge of the motion of the sequence image of the high-contrast feature mark at a zero position of the working surface as a zero-displacement reference edge; calculating a distance between the feature edge of the linear motion of the sequence image and the zero-displacement reference edge to obtain a displacement of the working surface in the X direction and a displacement of the working surface in the Y direction; and
(S4) obtaining a planar motion trajectory of the working surface according to the displacement of the working surface in the X direction and the displacement of the working surface in the Y direction; and saving and displaying a measurement result of the displacement and the planar motion trajectory of the working surface.

### Claim 2 (depends on 1)

The method of claim 1, wherein the extraction of the feature edge of the linear motion of the sequence image in the X direction and the Y direction comprises:
(1) determining a rectangular region in the sequence image of the high-contrast feature mark;
wherein template matching is adopted to determine four circular regions in the sequence image of the high-contrast feature mark to improve stability and precision in extracting the feature edge of the linear motion; the rectangle is located in a region of interest formed by centers of the four circular regions; and the feature edge is extracted in the region of interest to avoid a disturbance from an edge with similar background;
(2) extracting a sub-pixel of an edge point of a long edge and a short edge of the rectangle;
extracting the edge point of the long edge and the short edge of a pixel-level rectangle of a sequence image Fj(x,y) of the motion of the high-contrast feature mark using Canny operator, where j=1, 2, . . . , N, and N is the number of collected sequence image;
obtaining a position error compensation of the long edge and the short edge of the rectangle through calculating Zernike moment of the sequence image Fj(x,y) to obtain a sub-pixel coordinate of the long edge and the short edge of the rectangle; and
converting the sub-pixel coordinate of the long edge and the short edge of the rectangle into a corresponding world coordinate according to the relationship between the pixel coordinate and the world coordinate of the image; and
(3) fitting the feature edge of the linear motion in the X direction and the Y direction;
respectively fitting the world coordinate of the feature edge of the X direction and the Y direction based on the least squares principle to obtain a straight line {lj, X} of the feature edge of the linear motion in the X direction and a straight line {lj, Y} of the feature edge of the linear motion in the Y direction, where the sub-pixel coordinate of the long edge and the short edge of the rectangle is the feature edge of the linear motion in the X direction and the Y direction, respectively, and lj, X and lj, Y are equivalent edges of two long edges and two short edges of the rectangle in the sequence image Fj(x,y), respectively; and obtaining a straight line lr, X of the feature edge of linear motion in the X direction and a straight line lr, Y of the feature edge of linear motion in the Y direction of an image Fr(x,y) of the high-contrast feature mark at the zero position of the working surface.

### Claim 3 (depends on 2)

The method of claim 2, wherein a motion of the working surface of the low-frequency two-component shaker is obtained by decoupling an edge displacement in the X direction and the Y direction; and the planar motion is described as a displacement sX(t) in the X direction and a displacement sY(t) in the Y direction:
{
s
X
⁡
(
t
)
=
s
^
X
⁢
⁢
cos
⁡
(
ω
v
⁢
t
+
φ
X
)
s
Y
⁡
(
t
)
=
s
^
Y
⁢
⁢
cos
⁡
(
ω
v
⁢
t
+
φ
Y
)
;
(
1
)
wherein, ωv is an angular frequency of vibration; ŝX and ŝY are peak values of the displacement sX(t) and the displacement sY(t), respectively; and φX and φY are initial phases of the displacement sX(t) and the displacement sY(t), respectively;
the straight line lr, X and the straight line lr, Y of the feature edge of the image Fr(x,y) are selected as the zero-displacement reference edge; a distance dj, X between the straight line lj, X of the feature edge of the image Fj(x,y) and a corresponding edge of the image Fr(x,y) is calculated as the displacement sX(tj) at a collecting moment tj; a distance dj, Y between the straight line lj, Y of the feature edge of the image Fj(x,y) and a corresponding edge of the mark image Fr(x,y) is calculated as the displacement sY(tj) at the collecting moment tj.

### Claim 4 (depends on 3)

The method of claim 3, wherein the displacement sX(tj) and the displacement sY(tj) at the collecting moment tj are respectively fitted using a sine-approximation method shown as follows:
{
s
X
⁡
(
t
j
)
=
A
X
⁢
⁢
cos
⁡
(
ω
v
⁢
t
j
)
-
B
X
⁢
sin
⁡
(
ω
v
⁢
t
j
)
+
C
X
s
Y
(
t
j
⁢
)
=
A
Y
⁢
⁢
cos
(
ω
v
⁢
t
j
⁢
)
-
B
Y
⁢
sin
⁡
(
ω
v
⁢
t
j
)
+
C
Y
;
(
2
)
wherein parameters AX, BX, CX, AY, BY and CY are obtained by solving N corresponding equations, respectively; the peak value ŝX and the initial phase φX of the displacement of the planar motion in the X direction and the peak value ŝY and the initial phase φY of the planar motion in the Y direction are obtained as follows:
{
s
^
X
=
A
X
2
+
B
X
2
⁢
,
φ
X
=
arctan
⁡
(
B
X
⁢
/
⁢
A
X
)
·
180
⁢
/
⁢
π
s
^
Y
=
A
Y
2
+
B
Y
2
⁢
,
φ
Y
=
arctan
⁡
(
B
Y
⁢
/
⁢
A
Y
)
·
180
⁢
/
⁢
π
;
(
3
)
a phase difference PD is defined as follows:
PD=|φX−φY| (4);
when the phase difference PD is 0° or 180°, the planer motion provided by the working surface has a linear trajectory; if and only if ŝX=ŝY and the phase difference PD is 90°, the planar motion provided by the working surface has a circular trajectory; and planar motions under other conditions all have an elliptical trajectory.

### Claim 5 (depends on 1)

A device for implementing the method of claim 1, comprising:
a low-frequency two-component shaker;
a working surface;
a high-contrast feature mark;
an illumination device;
a fixing device;
a camera;
an image transmission device; and
an image processing and displaying unit;
wherein the working surface of the low-frequency two-component shaker is configured to provide a motion of any trajectory in a plane; the high-contrast feature mark is fixed on the working surface such that a motion of the high-contrast feature mark is consistent with a motion of the working surface; the illumination device is configured to provide illumination for the camera; the fixing device is configured for fixing the camera to allow an optical axis of the camera to be perpendicular to the high-contrast feature mark; the camera is configured to collect the sequence image of motion of the high-contrast feature mark; the image transmission device is configured to transmit the sequence image collected by the camera; the image processing and displaying unit is configured to process the sequence image collected by the camera, save and display a measurement result of the displacement and the trajectory of the planar motion.
