# US 2019/0171862 A1 · Method of extracting image of port wharf through multispectral interpretation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171862 A1
- Document ID: US20190171862A1
- Status: Published application
- Kind: A1
- Application number: 16/205,251
- Filed: 2018-11-30
- Published: 2019-06-06
- Earliest claimed: 2017-12-05
- Assignees: Transport Planning and Research Institute Ministry of Transport
- Applicants: Transport Planning and Research Institute Ministry of Transport
- Inventors: Yue QI; Yaping MAO; Yun FENG; Jun HAO; Jun HUANG; Hanbing SUN; Yi YANG; Wentao DING; Haiyuan YAO; Chen SHEN
- Web page: https://patentgrep.com/patent/US20190171862A1

## CPC

- G06V 10/30: Noise filtering
- G06F 18/21342: {using statistical independence, i.e. minimising mutual information or maximising non-gaussianity}
- G06F 18/2135: based on approximation criteria, e.g. principal component analysis
- G06F 18/217: {Validation; Performance evaluation; Active pattern learning techniques}
- G06V 10/34: Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/50: by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
- G06V 10/7715: {Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods}
- G06V 20/13: Satellite images
- G06V 20/194: {using hyperspectral data, i.e. more or other wavelengths than RGB}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method of extracting an image of a port wharf through multispectral interpretation includes: first, extracting a blurred coastline by assigning values to grayscale values; then, performing a smoothing and noise removal processing on a remote sensing image in a targeted area to extract edge information; sequentially, establishing a multi spectral database of a targeted port wharf; and extracting a port wharf using a projected eigenvector, performing an MAF transformation on the regularized kernel function again, projecting multivariate observed values to original eigenvectors, and identifying a remote sensing image area corresponding to the original eigenvector smaller than a transformation variance as a port wharf to be extracted, and then carrying out a validation operation.

## Claims

### Claim 1

A method of extracting an image of a port wharf through multispectral interpretation, comprising the following steps:
S100: assigning values to grayscale values to divide a coastline: performing a grayscale processing on an original remote sensing image, assigning the values to the grayscale values, and extracting a blurred coastline according to a distribution of the grayscale values;
S200: smoothing the original remote sensing image and removing noise: performing a smoothing processing on an area of the blurred coastline in the original remote sensing image according to a range limited by the blurred coastline and removing interference noise to extract edge information;
S300: establishing a multispectral database of a targeted port wharf: linearly combining multivariate observed values among different edge information, regularizing a linear combination to obtain a kernel function, as multispectral data, and repeating to obtain the multispectral database,
wherein an MAF transformation is performed on an image in an edge region before an operation of the linear combination is performed, in order to obtain an autocorrelation factor, and a specific algorithm is as follows:
αTx(r) is set as the autocorrelation factor, x(r) as a first multivariate observed value at a point r, x(r+δ) as a second multivariate observed value at a point r+δ, and δ as a spatial displacement vector, then an auto-covariance R of a linear combination αTx(r) of x(r) is calculated according to the following formula: R=Cov{αTx(r), αTx(r+δ)}, and the autocorrelation factor is obtained after an inverse operation is performed on the auto-covariance R;
the linear combination and a regularization of the linear combination comprises the following steps:
S301: transforming the auto-covariance R to obtain the following equation: αTCδα=αT(Cδ+CδT)α/2, where Cδ is a transformation-related matrix;
S302: setting, an autocorrelation coefficient ρ of the linear combination as follows: ρ=1−(αTSδα)/(2αTSα), where a difference covariance matrix Sδ is calculated according to the following formula: Sδ=2S−(C67 +CδT), and S=XTX/(n−1) is set as a covariance matrix of x:
and S303: selecting an optional form of the autocorrelation coefficient as following: ρ=1−½[(αTXTAα)/(αT[(1−k)XδTXδ+kIp)]α]−1, transforming the optional form to obtain a kernel function form as following: ρ=1−½[(bTK2b )/(bT[(1−k)KδK67 T+kK)]b]−1, where XTb=α, A is a transformation factor, k is a transformation coefficient, Ip is a unit vector of a eigenvector P, and K is a correlation matrix of the transformation coefficient: and
S400: extracting a port wharf using a projected eigenvector: performing an MAF transformation on the kernel function after being regularized, projecting the multivariate observed values to original eigenvectors, and identifying a remote sensing image area corresponding to a validated original eigenvector as a port wharf to be extracted.

### Claim 2 (depends on 1)

The method of extracting the image of the port wharf through multispectral interpretation according to claim 1, wherein
in step S100: different values are assigned to remote sensing images of different grayscales, and a value ‘0’ is assigned to a grayscale value of a water area in a remote sensing image and a value ‘10’ to a part on land having a maximum grayscale value.

### Claim 3 (depends on 1)

The method of extracting the image of the port wharf through multispectral interpretation according to claim 1, wherein
in step S100: extracting a coastline by assigning the values to the grayscale values specifically comprises the following steps:
S101: first, performing a uniform grayscale processing on the original remote sensing image and dividing areas having different grayscale values, then calculating grayscale value variances for the areas after being divided to obtain a grayscale distribution uniformity coefficient;
S102: checking the grayscale value variances calculated in S101, selecting and determining a variance contrast value, identifying an area where a grayscale value is smaller than the variance contrast value as a water area and an area where a grayscale value is greater than the variance contrast value as a land area; and
S103: restoring distinct boundary lines existing between the water area and the land area to a continuous boundary line to be as the blurred coastline by an interpolation method, wherein the distinct boundary lines are identified through S101 and S102.

### Claim 4 (depends on 1)

The method of extracting the image of the port wharf through multispectral interpretation according to claim 1, wherein
after the blurred coastline is extracted by assigning the values to the grayscale values, a preprocessing is carried out for the remote sensing image, and the preprocessing includes geometric correction, atmospheric correction and radiation correction.

### Claim 5 (depends on 1)

The method of extracting the image of the port wharf through multispectral interpretation according to claim 1, wherein
in step S200, the original remote sensing image is smoothed by using any one of mean value smoothing, median filtering or Gaussian blur filtering, wherein, the median filtering and the Gaussian blur filtering both employ a normalized ratio method and use the following specific calculation formula:
NDWI=(Green−NIR)/(Green+NIR), where Green represents a green light waveband image, NIR represents a near-infrared waveband image, and NDWI represents a combination of wavebands.

### Claim 6 (depends on 1)

The method of extracting the image of a the port wharf through multispectral interpretation according to claim 1, wherein, in step 400, an original eigenvector is set to be ai after the regularization is performed, then, a projection algorithm of the original eigenvector is as follows:
φ(x)Tai=φ(x)TφTbi=[k(x, x1), k(x, x2), . . . , k(x, xN)]bi.

### Claim 7 (depends on 1)

The method of extracting the image of the port wharf through multispectral interpretation according to claim 1, wherein, a validation method comprises: comparing an original eigenvector with a transformation variance, and determining that the original eigenvector smaller than the transformation variance meets a requirement, wherein a specific algorithm of the transformation variance is as follows:
a column of a matrix A is set as ai and that of a matrix B is set as bi, then φA=KB, in this case, the transformation variance is calculated according to the following formula:
Var

{
a
i
δ
T

ϕ

(
x
)
}
=
a
i
δ
T

ϕ
T

a
i
/
(
n
-
1
)
=
b
i

ϕϕ
T

ϕϕ
T

b
i
/
(
n
-
1
)
=
b
i
δ
T

K
2

b
i
/
(
n
-
1
)
=
1
/
(
n
-
1
)
,
where n is the number of times the extraction is performed.

### Claim 8 (depends on 1)

The method of extracting the image of the port wharf through multispectral interpretation according to claim 1, further comprising:
a step S500 of validating a first spatial correlation relationship, which specifically comprises:
based on steps S100 and S200, obtaining a second spatial correlation relationship of the blurred coastline obtained through an assignment of the values to the grayscales and an image processing operation, and validating the first spatial correlation relationship for the port wharf recognized in the step S400 by using the second spatial correlation relationship.

### Claim 9

(canceled)

### Claim 10

(canceled)
