# US 2026/0087672 A1 · Monocular high-speed videogrammetry method and system based on dynamic platform

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087672 A1
- Document ID: US20260087672A1
- Status: Published application
- Kind: A1
- Application number: 19/324,200
- Filed: 2025-09-10
- Published: 2026-03-26
- Earliest claimed: 2024-09-25
- Assignees: Beijing University of Civil Engineering and Architecture; Beijing Institute of Engineering Geology
- Applicants: Beijing University of Civil Engineering and Architecture; Beijing Institute of Engineering Geology
- Inventors: Xianglei Liu; Yuqi Zhang; Runjie Wang; Yuxin Chen; Tao Yuan; Yike He; Jing Ma
- Web page: https://patentgrep.com/patent/US20260087672A1

## CPC

- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 3/4007: based on interpolation, e.g. bilinear interpolation (image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403)
- G06T 5/20: using local operators
- G06T 5/40: using histogram techniques
- G06T 5/73: Deblurring; Sharpening
- G06T 5/90: Dynamic range modification of images or parts thereof
- G06T 7/11: Region-based segmentation
- G06T 7/13: Edge detection
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/75: {involving models}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10152: Varying illumination
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/30244: Camera pose
- Y02T 10/40: Engine management systems
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- Y02T: CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION

## Abstract

A monocular high-speed videogrammetry method based on a dynamic platform includes the following steps: collecting a monocular high-frame-rate image sequence of the dynamic platform and performing preprocessing; conducting dynamic image-block data processing on the image sequence based on adaptive brightness compensation and least-squares fitting (LSF) to obtain adjusted images; performing camera-pose calibration on the adjusted images based on sliding-window constraints to obtain calibrated images; and acquiring three-dimensional (3D) coordinates and estimated displacements of tracking points from the calibrated images, and outputting measurement results based on the 3D coordinates and the estimated displacements. Through optimization of the measurement process, the method supports real-time adaptive compensation, dynamic image-block processing, and camera-pose calibration, thereby providing significant application value. Correspondingly, the present disclosure also provides a monocular high-speed videogrammetry system based on a dynamic platform, which includes modules configured to implement the above steps.

## Claims

### Claim 1

A monocular high-speed videogrammetry method based on a dynamic platform, comprising the steps of:
collecting a monocular high-frame-rate image sequence of the dynamic platform and performing preprocessing on the image sequence;
performing dynamic image-block data processing on the image sequence based on adaptive brightness compensation and least-squares fitting (LSF) to obtain adjusted images, the dynamic image-block data processing sequentially comprising four steps: adaptive compensation of target points within image blocks, post-processing with Gaussian blur and adaptive-threshold binarization brightness compensation, LSF-based sub-pixel center localization of target points, and updating the image blocks while acquiring the target point centers of the image sequence;
performing camera-pose calibration on the adjusted images based on sliding-window constraints to obtain calibrated images, the camera-pose calibration sequentially comprising three steps: initial camera-pose estimation using the efficient perspective-n-point (EPnP) algorithm, optimization to minimize the re-projection error, and inter-sequence adjustment within the sliding window; and
acquiring three-dimensional (3D) coordinates and estimated displacements of tracking points from the calibrated images, and outputting measurement results based on the 3D coordinates and the estimated displacements.

### Claim 2 (depends on 1)

The monocular high-speed videogrammetry method based on a dynamic platform according to claim 1, wherein the adaptive compensation of target points in image blocks comprises the steps of:
taking approximate central pixel coordinates of a tracking point of a first frame of the image sequence as I(x,y), and determining a range [(x−(n+m), x+(n+m)), (y−(n+m), y+(n+m))] of an image block by using an extended range pixel n;
setting a search radius to m, and setting a range of the image block as a search area of matching image blocks of subsequent frames;
dividing the target points into standard targets, dark targets and overexposed targets according to characteristics of targets in the image block, where the standard targets are markers collected under normal lighting conditions, the dark targets are markers collected under dark conditions, and the overexposed targets are markers collected under sufficient lighting conditions;
determining empirical grayscale thresholds for the three types of target points based on comprehensive analysis: the average grayscale level of the standard targets ranges from 80 to 200, the average grayscale level of the dark targets is less than 80, and the average grayscale level of the overexposed targets exceeds 200;
enhancing brightness and contrast of the dark targets based on single-scale Retinex, and decomposing an original image into an illumination image and a reflection image, expressed as:
S
⁡
(
x
,
y
)
=
R
⁡
(
x
,
y
)
·
L
⁡
(
x
,
y
)
where a pixel value of the original image is S(x,y), a reflectivity is R(x,y), an illuminance is L(x,y), and an enhanced reflectivity is calculated:
R
enhanced
(
x
,
y
)
=
log
⁡
(
1
+
R
⁡
(
x
,
y
)
)
where the enhanced reflectivity is Renhanced, and an enhanced image is obtained according to the enhanced reflectivity and illuminance:
S
enhanced
(
x
,
y
)
=
R
enhanced
(
x
,
y
)
·
L
⁡
(
x
,
y
)
where the enhanced image is Senhanced(x,y);
dividing, for the overexposure targets, an input image into M×N sub-images of equal size, a height by width of the whole image being H×W, and the number of sub-images being
(
H
M
)
×
(
W
N
)
;
calculating gray histograms of the sub-images, and acquiring a contrast limit threshold by gray stretching, the gray level being cut and excess parts being evenly redistributed to other gray levels if a frequency of a gray level exceeds the contrast limit threshold, expressed as:
H
′
(
k
)
=
{
λ
,
if
⁢
H
⁡
(
k
)
>
λ
H
⁡
(
k
)
,
otherwise
where the contrast limit threshold is λ, the number of pixels of a k-th gray level is H(k), and the number of updated pixels of the k-th gray level is {acute over (H)}(k);
reallocating an extra part, expressed as:
Δ
⁢
H
=
∑
k
(
H
⁡
(
k
)
-
λ
)
,
for
⁢
H
⁡
(
k
)
>
λ
where the extra part is ΔH; and an additional frequency is calculated:
H
*
(
k
)
=
H
′
(
k
)
+
Δ
⁢
H
L
where an additional frequency of the k-th gray level is H*(k), and an upper limit of a gray range is L; and cumulative distribution of a truncated histogram is calculated:
CDF
⁡
(
k
)
=
∑
i
=
0
k
H
*
(
i
)
where a cumulative distribution of the k-th gray level is CDF(k), an additional frequency of an i-th gray level is H*(i), and an upper limit of the gray level is k; and
normalizing the cumulative distribution, expressed as:
C
⁢
D
⁢
F
norm
(
k
)
=
CDF
⁡
(
k
)
-
CDF
min
M
·
N
-
CDF
min
⁢
(
L
-
1
)
where a minimum non-zero value of cumulative distribution function (CDF) is CDFmin, a height of the sub-image is M, and a width of the sub-image is N; and a gray value of an original sub-image is mapped to an enhanced gray value according to the normalized cumulative distribution:
S
′
tile
(
x
,
y
)
=
CDF
min
(
S
tile
(
x
,
y
)
)
where a pixel value of the original sub-image is Stile(x,y), and a pixel value of an enhanced sub-image is Śtile(x,y); and for a boundary area between adjacent sub-images, bilinear interpolation is used to achieve smooth transition, and an initial compensated image is obtained.

### Claim 3 (depends on 1)

The monocular high-speed videogrammetry method based on a dynamic platform according to claim 1, wherein the post-processing of Gaussian blur and adaptive threshold binarization brightness compensation comprises the steps of:
using a Gaussian function as a convolution kernel, performing weighted averaging on pixels in the initial compensated image, and calculating two dimensional (2D) Gaussian values:
G
⁡
(
x
,
y
)
=
1
2
⁢
πσ
2
⁢
exp
⁢
(
-
x
2
+
y
2
2
⁢
σ
2
)
where a coordinate relative to a center of the convolution kernel is (x,y), the 2D Gaussian function of the coordinates is G(x,y), and a standard deviation of Gaussian distribution is σ;
obtaining the convolution kernel by discretizing the Gaussian function, and performing convolution on an image using the convolution kernel; and
adopting an adaptive threshold method based on a neighborhood mean to determine a threshold value of each pixel by averaging gray values in a local area of the image block, and outputting a compensated image.

### Claim 4 (depends on 1)

The monocular high-speed videogrammetry method based on a dynamic platform according to claim 1, wherein the LSF-based sub-pixel center localization of target points, as well as the update of the image blocks and acquisition of a target point center of the image sequence comprise the steps of:
using the Canny operator to identify edge points of a circle in the compensated image, and utilizing the LSF to fit a center of an ellipse for subpixel localization, an ellipse equation being expressed as:
(
x
-
x
c
)
2
a
2
+
(
y
-
y
c
)
2
b
2
=
1
where a central coordinate of the ellipse is (xc,yc), a major axis of the ellipse is a, and a minor axis of the ellipse is b; and
a set of pixels on an edge of the ellipse is M=[(x1,y1), (x2,y2), . . . , (xn,yn)]; and a root mean square error (RMSE) is calculated:
ε
2
=
∑
i
=
1
n
[
(
x
-
x
c
)
2
a
2
+
(
y
-
y
c
)
2
b
2
-
1
]
2
x
st
,
c
=
max
⁡
(
x
i
)
+
min
⁡
(
x
i
)
2
y
st
,
c
=
max
⁡
(
y
i
)
+
min
⁡
(
y
i
)
2
where an initial center coordinate of the ellipse is (xst,c,yst,c), an initial length of the major axis is
a
o
=
max
⁡
(
x
i
)
-
min
⁡
(
x
i
)
2
,
and an initial length of the minor axis is
b
o
=
max
⁡
(
y
i
)
-
min
⁡
(
y
i
)
2
;
using Levenberg-Marquardt method for nonlinear optimization based on the RMSE, and calculating an ellipse center Ic(xc,yc) with sub-pixel accuracy; and
taking an integer part of Ic(xc,yc) as an initial center approximate pixel coordinate, repeating operation to calculate an accurate center approximate pixel coordinate of a next frame tracking target, and outputting a compensated image after the accurate center approximate pixel coordinate as the adjusted image.

### Claim 5 (depends on 1)

The monocular high-speed videogrammetry method based on a dynamic platform according to claim 1, wherein the initial camera pose estimation based on EPnP comprises the steps of:
estimating an initial camera pose of the frame using the EPnP algorithm, a projection model expression of 3D points being:
p
i
=
K
[
R
/
T
]
⁢
P
i
where K is a camera intrinsic matrix, R is a rotation matrix, T is a translation vector, and a 2D coordinate of an i-th frame control point is pi;
using four virtual control points to represent all 3D points, as employed in EPnP:
P
i
=
∑
j
=
1
4
a
ij
⁢
C
j
where
∑
j
=
1
4
a
ij
=
1
,
all 3D points of an 1-th control point are Pi, a j-th frame weight coefficient of the i-th control point is aij, and a j-th virtual control point is Cj; and a projection of the control point on an adjusted image plane being expressed as:
c
i
=
K
[
R
/
T
]
⁢
C
i
where the i-th control point of the control point on the adjustment image plane is projected as ci; and a linear equation is obtained by representing the 3D points as a linear combination of control points, expressed as:
p
i
=
K
[
R
/
T
]
⁢
(
∑
j
=
1
4
a
ij
⁢
C
j
)
=
∑
j
=
1
4
a
ij
⁢
c
j
transforming the linear equation into a linear least squares problem, and solving for R and T.

### Claim 6 (depends on 1)

The monocular high-speed videogrammetry method based on a dynamic platform according to claim 1, wherein the optimization for minimizing the re-projection error and the inter-sequence adjustment within the sliding window comprise the following steps:
combining the EPnP algorithm with the Levenberg-Marquardt nonlinear optimization algorithm, and using the results of the EPnP algorithm as initial values to calculate the minimized re-projection error:
error
=
∑
i
=
1
n

p
i
-
p
ˆ
i

2
where an actual 2D coordinate of the i-th control point is pi, and an i-th 2D coordinate of a currently estimated external parameter projected from the 3D points is {circumflex over (p)}i;
gradually adjusting the camera pose until the minimized re-projection error converges to a minimum;
using sliding window adjustment to optimize the camera pose by using inter-frame information, and selecting a size of a sliding window N based on accuracy and efficiency requirements;
performing triangulation for each control point in the field of view using the camera pose information in each pair of frames in the window, calculating 3D coordinates thereof, and adjusting an error function, expressed as:
error
=
∑
i
=
t
-
N
+
1
t
∑
j
=
1
M

X
i
,
j
-
X
^
i
,
j

2
where a true 3D coordinate of the i-th control point in the j-th frame is Xi,j, and a 3D coordinate estimated by triangulation is {circumflex over (X)}i,j; and
using the Levenberg-Marquardt algorithm to minimize the error function, sliding the window forward by one frame, repeating bundle adjustment optimization until all frames of the adjusted images are traversed, and outputting the calibrated images.

### Claim 7 (depends on 1)

The monocular high-speed videogrammetry method based on a dynamic platform according to claim 1, wherein the acquiring 3D coordinates and estimated displacements of tracking points according to the calibrated images comprises the steps of:
reconstructing spatial positions of the tracking points in the calibrated images within a camera field of view based on a camera projection model, and converting 2D coordinates (u,v) into normalized camera coordinates (xc,yc,zc), expressed as:
(
x
c
,
y
c
,
z
c
)
=
s
·
K
-
1
·
(
u
,
v
,
1
)
where the camera intrinsic matrix is K; and a relationship between pixel coordinates and real-world coordinates is established according to a scale factor, expressed as:
s
=
d
w
d
p
where the scale factor is s, an actual physical size of a measurement target surface is dw, and a corresponding pixel size on an image plane is dp;
converting normalized camera coordinates to world coordinates:
(
X
,
Y
,
Z
)
=
R
·
(
x
c
,
y
c
,
z
c
)
+
T
where R is the rotation matrix and T is the translation vector; and displacements of corresponding tracking points are calculated in three directions:
{
S
X
n
=
X
n
-
X
1
S
Y
n
=
Y
n
-
Y
1
S
Z
n
=
Z
n
-
Z
1
where coordinates of the tracking point of the first frame in X, Y, and Z directions are X1, Y1 and Z1, and coordinates of the corresponding points of the n-th frame in the X, Y, and Z directions are Xn, Yn and Zn; and
determining vibration state and maximum amplitude of a target structure under load based on dynamic displacements, and outputting 3D coordinates of the tracking points and estimated displacements.

### Claim 8

A monocular high-speed videogrammetry system based on a dynamic platform, comprising:
a data-collection module, configured to collect a monocular high-frame-rate image sequence of the dynamic platform and to perform preprocessing on the image sequence;
an image-block processing module, configured to perform dynamic image-block data processing on the image sequence based on adaptive brightness compensation and LSF to obtain adjusted images, the dynamic image-block data processing sequentially comprising four steps: adaptive compensation of target points within image blocks, post-processing with Gaussian blur and adaptive-threshold binarization brightness compensation, LSF-based sub-pixel center localization of target points, and updating the image blocks while acquiring the target point centers of the image sequence;
a pose-calibration module, configured to perform camera-pose calibration on the adjusted images based on sliding-window constraints to obtain calibrated images, the camera-pose calibration sequentially comprising three steps: initial camera-pose estimation using the EPnP algorithm, optimization to minimize the re-projection error, and inter-sequence adjustment within the sliding window; and
a measurement-output module, configured to acquire 3D coordinates and estimated displacements of tracking points from the calibrated images, and to output measurement results based on the 3D coordinates and the estimated displacements.
