# US 2026/0030852 A1 · Power vision dataset augmentation method and system based on physical system characteristics

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0030852 A1
- Document ID: US20260030852A1
- Status: Published application
- Kind: A1
- Application number: 18/995,633
- Filed: 2024-12-05
- Published: 2026-01-29
- Earliest claimed: 2023-12-05
- Assignees: State Grid Shanxi Electric Power Research Institute; State Grid ShanXi Electric Power Company
- Applicants: State Grid Shanxi Electric Power Research Institute; State Grid Shanxi Electric Power Company
- Inventors: Na ZHANG; Fan HU; Gang YANG; Zeyuan MA; Hua YU; Jizhong LIANG; Jingjing FAN; Hui YUAN; Jingjin CAO; Jin ZHAO; Minjie CHAI; Changwen SUN; Haiqi WANG; Guodong LI; Yang BAI; Siqing XU
- Web page: https://patentgrep.com/patent/US20260030852A1

## CPC

- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/11: Region-based segmentation
- G06T 15/506: {Illumination models}
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06V 10/54: relating to texture
- G06V 10/56: relating to colour
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G06V 10/762: using clustering, e.g. of similar faces in social networks
- G06T 2207/20221: Image fusion; Image merging
- G06T 2219/2016: Rotation, translation, scaling
- Y04S 10/50: Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- Y04S: SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS

## Abstract

A power vision dataset augmentation method includes acquiring an initial three-dimensional structure point cloud of a power device, preprocessing the initial three-dimensional structure point cloud to obtain a three-dimensional structure point cloud, and determining point clouds of power device vertices and edges based on the three-dimensional structure point cloud; partitioning point clouds of the non-significant vertices and edges in the three-dimensional structure point cloud and replacing partitions with geometric plane primitives to obtain a three-dimensional structure represented by the geometric plane primitives; determining light and shadow information of the power device based on a captured image; matching the three-dimensional structure with the captured image; determining a three-dimensional true-color structure of the power device based on the light and shadow information of the power device after the three-dimensional structure matches the captured image; and constructing a dataset based on the three-dimensional true-color structure and the captured image.

## Claims

### Claim 1

A power vision dataset augmentation method based on physical system characteristics, comprising:
acquiring an initial three-dimensional structure point cloud of a power device, preprocessing the initial three-dimensional structure point cloud to obtain a three-dimensional structure point cloud, and determining point clouds of power device vertices and edges based on the three-dimensional structure point cloud;
partitioning point clouds of non-significant vertices and edges in the three-dimensional structure point cloud and replacing partitions with geometric plane primitives to obtain a three-dimensional structure represented by the geometric plane primitives, wherein the point clouds of the non-significant vertices and edges are point clouds with a feature degree lower than a preset percentage;
acquiring a captured image of the power device and determining light and shadow information of the power device based on the captured image;
matching the three-dimensional structure with the captured image by transforming an angle and a scale of the three-dimensional structure;
determining a three-dimensional true-color structure of the power device based on the light and shadow information of the power device after the three-dimensional structure matches the captured image; and
constructing a dataset based on the three-dimensional true-color structure and the captured image.

### Claim 2 (depends on 1)

The power vision dataset augmentation method based on physical system characteristics according to claim 1, wherein acquiring the initial three-dimensional structure point cloud of the power device, preprocessing the initial three-dimensional structure point cloud to obtain the three-dimensional structure point cloud, and determining the point clouds of the power device vertices and edges based on the three-dimensional structure point cloud comprises:
acquiring the initial three-dimensional structure point cloud of the power device, performing point cloud registration and point cloud filtering on the initial three-dimensional structure point cloud to obtain the three-dimensional structure point cloud, performing a voxel gradient solution on the three-dimensional structure point cloud based on point cloud voxels, and calculating a gradient change rate maximum value to obtain coordinates of the power device vertices and edges in the three-dimensional structure point cloud; and
for edge coordinates of the power device in the three-dimensional structure point cloud, segmenting a point cloud at a position of the edge coordinates based on a clustering algorithm to obtain several cluster subsets, detecting a curvature change and a normal direction change of a local space point set in the several cluster subsets, and calculating an edge representation of the three-dimensional structure point cloud based on an RANSAC algorithm.

### Claim 3 (depends on 1)

The power vision dataset augmentation method based on physical system characteristics according to claim 1, wherein partitioning the point clouds of the non-significant vertices and edges in the three-dimensional structure point cloud and replacing the partitions with the geometric plane primitives to obtain the three-dimensional structure represented by the geometric plane primitives comprises:
performing partition on regions of the point clouds of the non-significant vertices and edges in the three-dimensional structure point cloud based on a clustering algorithm, wherein a partition equivalent diameter is less than 0.5 times a minimum length of a point cloud detection line; and replacing partitions obtained by the clustering algorithm with triangle plane primitives to obtain a three-dimensional structure represented by the triangle plane primitives.

### Claim 4 (depends on 1)

The power vision dataset augmentation method based on physical system characteristics according to claim 1, wherein acquiring the captured image of the power device and determining the light and shadow information of the power device based on the captured image comprises:
acquiring the captured image of the power device and separating illumination information of the power device in the captured image based on a surface reflection method: setting different regions of the power device to have specular reflection or diffuse reflection based on material characteristics, wherein the specular reflection is generated by a smooth resin material of the power device, and the diffuse reflection is generated by a paint surface or a metal surface of the power device; and acquiring illumination information of the power device in a corresponding region based on an illumination model of the specular reflection or the diffuse reflection to obtain illumination-material key-value pairs;
performing region segmentation on color information in the captured image based on a K-means algorithm, pairing and recording material information and the color information of the power device to form material-color key-value pairs, and setting regions of a same material but different colors as shadow-color key-value pairs;
detecting texture information of the captured image through a Gabor filter and constructing texture-material key-value pairs based on material distribution of the power device; and
constituting the light and shadow information of the power device by the illumination-material key-value pairs, the material-color key-value pairs, the shadow-color key-value pairs, and the texture-material key-value pairs.

### Claim 5 (depends on 4)

The power vision dataset augmentation method based on physical system characteristics according to claim 4, wherein matching the three-dimensional structure with the captured image by transforming the angle and the scale of the three-dimensional structure comprises: calculating a matching degree between corner and edge features in the captured image and the three-dimensional structure by transforming the angle and the scale of the three-dimensional structure, determining the angle and the scale of the three-dimensional structure at a minimum matching error by optimizing the matching error, regarding the captured image as a projection of the three-dimensional structure at the angle and the scale, and regarding illumination information, color information, and texture information of the captured image as two-dimensional image information of an orthogonal projection of the three-dimensional structure at the angle and the scale.

### Claim 6 (depends on 5)

The power vision dataset augmentation method based on physical system characteristics according to claim 5, wherein determining the three-dimensional true-color structure of the power device based on the light and shadow information of the power device after the three-dimensional structure matches the captured image comprises:
determining illumination information, color information, and texture information of the three-dimensional structure at the angle and the scale by using inverse orthogonal projection and considering shadow projection mapping under depth information after the three-dimensional structure matches the captured image; and
fitting and complementing illumination information, color information, and texture information of a rest of the three-dimensional structure under constraint of the geometric plane primitives based on the extracted illumination-material key-value pairs, material-color key-value pairs, shadow-color key-value pairs and texture-material key-value pairs to obtain the three-dimensional true-color structure with the illumination information, the color information, and the texture information.

### Claim 7 (depends on 1)

The power vision dataset augmentation method based on physical system characteristics according to claim 1, wherein constructing the dataset based on the three-dimensional true-color structure and the captured image comprises: orthogonally projecting the three-dimensional true-color structure at different angles and scales to obtain two-dimensional image data in any direction and size;
determining an image set A of the power device with partially occlusion based on angle transformation;
adjusting illumination to obtain an image set B under strong light and weak light;
conducting angle transformation by a preset amplitude for a location of a specified component or defect of the power device to obtain an image set C of a target at different viewing angles;
scaling up and down a specified target of the power device to obtain a local image set D and an image set E with a small proportion of target pixels; and
combining the captured image, the image set A, the image set B, the image set C, the image set D, and the image set E into the dataset.

### Claim 8

(canceled)

### Claim 9

An electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor is configured to, when executing the computer program, perform the following steps:
acquiring an initial three-dimensional structure point cloud of a power device, preprocessing the initial three-dimensional structure point cloud to obtain a three-dimensional structure point cloud, and determining point clouds of power device vertices and edges based on the three-dimensional structure point cloud;
partitioning point clouds of non-significant vertices and edges in the three-dimensional structure point cloud and replacing partitions with geometric plane primitives to obtain a three-dimensional structure represented by the geometric plane primitives, wherein the point clouds of the non-significant vertices and edges are point clouds with a feature degree lower than a preset percentage;
acquiring a captured image of the power device and determining light and shadow information of the power device based on the captured image;
matching the three-dimensional structure with the captured image by transforming an angle and a scale of the three-dimensional structure;
determining a three-dimensional true-color structure of the power device based on the light and shadow information of the power device after the three-dimensional structure matches the captured image; and
constructing a dataset based on the three-dimensional true-color structure and the captured image.

### Claim 10

A non-transitory computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to perform the following steps:
acquiring an initial three-dimensional structure point cloud of a power device, preprocessing the initial three-dimensional structure point cloud to obtain a three-dimensional structure point cloud, and determining point clouds of power device vertices and edges based on the three-dimensional structure point cloud;
partitioning point clouds of non-significant vertices and edges in the three-dimensional structure point cloud and replacing partitions with geometric plane primitives to obtain a three-dimensional structure represented by the geometric plane primitives, wherein the point clouds of the non-significant vertices and edges are point clouds with a feature degree lower than a preset percentage;
acquiring a captured image of the power device and determining light and shadow information of the power device based on the captured image;
matching the three-dimensional structure with the captured image by transforming an angle and a scale of the three-dimensional structure;
determining a three-dimensional true-color structure of the power device based on the light and shadow information of the power device after the three-dimensional structure matches the captured image; and
constructing a dataset based on the three-dimensional true-color structure and the captured image.

### Claim 11 (depends on 2)

The power vision dataset augmentation method based on physical system characteristics according to claim 2, wherein constructing the dataset based on the three-dimensional true-color structure and the captured image comprises:
orthogonally projecting the three-dimensional true-color structure at different angles and scales to obtain two-dimensional image data in any direction and size;
determining an image set A of the power device with partially occlusion based on angle transformation;
adjusting illumination to obtain an image set B under strong light and weak light;
conducting angle transformation by a preset amplitude for a location of a specified component or defect of the power device to obtain an image set C of a target at different viewing angles;
scaling up and down a specified target of the power device to obtain a local image set D and an image set E with a small proportion of target pixels; and
combining the captured image, the image set A, the image set B, the image set C, the image set D, and the image set E into the dataset.

### Claim 12 (depends on 3)

The power vision dataset augmentation method based on physical system characteristics according to claim 3, wherein constructing the dataset based on the three-dimensional true-color structure and the captured image comprises:
orthogonally projecting the three-dimensional true-color structure at different angles and scales to obtain two-dimensional image data in any direction and size;
determining an image set A of the power device with partially occlusion based on angle transformation;
adjusting illumination to obtain an image set B under strong light and weak light;
conducting angle transformation by a preset amplitude for a location of a specified component or defect of the power device to obtain an image set C of a target at different viewing angles;
scaling up and down a specified target of the power device to obtain a local image set D and an image set E with a small proportion of target pixels; and
combining the captured image, the image set A, the image set B, the image set C, the image set D, and the image set E into the dataset.

### Claim 13 (depends on 4)

The power vision dataset augmentation method based on physical system characteristics according to claim 4, wherein constructing the dataset based on the three-dimensional true-color structure and the captured image comprises:
orthogonally projecting the three-dimensional true-color structure at different angles and scales to obtain two-dimensional image data in any direction and size;
determining an image set A of the power device with partially occlusion based on angle transformation;
adjusting illumination to obtain an image set B under strong light and weak light;
conducting angle transformation by a preset amplitude for a location of a specified component or defect of the power device to obtain an image set C of a target at different viewing angles;
scaling up and down a specified target of the power device to obtain a local image set D and an image set E with a small proportion of target pixels; and
combining the captured image, the image set A, the image set B, the image set C, the image set D, and the image set E into the dataset.

### Claim 14 (depends on 5)

The power vision dataset augmentation method based on physical system characteristics according to claim 5, wherein constructing the dataset based on the three-dimensional true-color structure and the captured image comprises:
orthogonally projecting the three-dimensional true-color structure at different angles and scales to obtain two-dimensional image data in any direction and size;
determining an image set A of the power device with partially occlusion based on angle transformation;
adjusting illumination to obtain an image set B under strong light and weak light;
conducting angle transformation by a preset amplitude for a location of a specified component or defect of the power device to obtain an image set C of a target at different viewing angles;
scaling up and down a specified target of the power device to obtain a local image set D and an image set E with a small proportion of target pixels; and
combining the captured image, the image set A, the image set B, the image set C, the image set D, and the image set E into the dataset.

### Claim 15 (depends on 6)

The power vision dataset augmentation method based on physical system characteristics according to claim 6, wherein constructing the dataset based on the three-dimensional true-color structure and the captured image comprises:
orthogonally projecting the three-dimensional true-color structure at different angles and scales to obtain two-dimensional image data in any direction and size;
determining an image set A of the power device with partially occlusion based on angle transformation;
adjusting illumination to obtain an image set B under strong light and weak light; conducting angle transformation by a preset amplitude for a location of a specified component or defect of the power device to obtain an image set C of a target at different viewing angles;
scaling up and down a specified target of the power device to obtain a local image set D and an image set E with a small proportion of target pixels; and
combining the captured image, the image set A, the image set B, the image set C, the image set D, and the image set E into the dataset.

### Claim 16 (depends on 9)

The device according to claim 9, wherein acquiring the initial three-dimensional structure point cloud of the power device, preprocessing the initial three-dimensional structure point cloud to obtain the three-dimensional structure point cloud, and determining the point clouds of the power device vertices and edges based on the three-dimensional structure point cloud comprises:
acquiring the initial three-dimensional structure point cloud of the power device, performing point cloud registration and point cloud filtering on the initial three-dimensional structure point cloud to obtain the three-dimensional structure point cloud, performing a voxel gradient solution on the three-dimensional structure point cloud based on point cloud voxels, and calculating a gradient change rate maximum value to obtain coordinates of the power device vertices and edges in the three-dimensional structure point cloud; and
for edge coordinates of the power device in the three-dimensional structure point cloud, segmenting a point cloud at a position of the edge coordinates based on a clustering algorithm to obtain several cluster subsets, detecting a curvature change and a normal direction change of a local space point set in the several cluster subsets, and calculating an edge representation of the three-dimensional structure point cloud based on an RANSAC algorithm.

### Claim 17 (depends on 9)

The device according to claim 9, wherein partitioning the point clouds of the non-significant vertices and edges in the three-dimensional structure point cloud and replacing the partitions with the geometric plane primitives to obtain the three-dimensional structure represented by the geometric plane primitives comprises:
performing partition on regions of the point clouds of the non-significant vertices and edges in the three-dimensional structure point cloud based on a clustering algorithm, wherein a partition equivalent diameter is less than 0.5 times a minimum length of a point cloud detection line; and replacing partitions obtained by the clustering algorithm with triangle plane primitives to obtain a three-dimensional structure represented by the triangle plane primitives.

### Claim 18 (depends on 9)

The device according to claim 9, wherein acquiring the captured image of the power device and determining the light and shadow information of the power device based on the captured image comprises:
acquiring the captured image of the power device and separating illumination information of the power device in the captured image based on a surface reflection method: setting different regions of the power device to have specular reflection or diffuse reflection based on material characteristics, wherein the specular reflection is generated by a smooth resin material of the power device, and the diffuse reflection is generated by a paint surface or a metal surface of the power device; and acquiring illumination information of the power device in a corresponding region based on an illumination model of the specular reflection or the diffuse reflection to obtain illumination-material key-value pairs;
performing region segmentation on color information in the captured image based on a K-means algorithm, pairing and recording material information and the color information of the power device to form material-color key-value pairs, and setting regions of a same material but different colors as shadow-color key-value pairs;
detecting texture information of the captured image through a Gabor filter and constructing texture-material key-value pairs based on material distribution of the power device; and
constituting the light and shadow information of the power device by the illumination-material key-value pairs, the material-color key-value pairs, the shadow-color key-value pairs, and the texture-material key-value pairs.

### Claim 19 (depends on 18)

The device according to claim 18, wherein matching the three-dimensional structure with the captured image by transforming the angle and the scale of the three-dimensional structure comprises:
calculating a matching degree between corner and edge features in the captured image and the three-dimensional structure by transforming the angle and the scale of the three-dimensional structure, determining the angle and the scale of the three-dimensional structure at a minimum matching error by optimizing the matching error, regarding the captured image as a projection of the three-dimensional structure at the angle and the scale, and regarding illumination information, color information, and texture information of the captured image as two-dimensional image information of an orthogonal projection of the three-dimensional structure at the angle and the scale.

### Claim 20 (depends on 19)

The device according to claim 19, wherein determining the three-dimensional true-color structure of the power device based on the light and shadow information of the power device after the three-dimensional structure matches the captured image comprises:
determining illumination information, color information, and texture information of the three-dimensional structure at the angle and the scale by using inverse orthogonal projection and considering shadow projection mapping under depth information after the three-dimensional structure matches the captured image; and
fitting and complementing illumination information, color information, and texture information of a rest of the three-dimensional structure under constraint of the geometric plane primitives based on the extracted illumination-material key-value pairs, material-color key-value pairs, shadow-color key-value pairs and texture-material key-value pairs to obtain the three-dimensional true-color structure with the illumination information, the color information, and the texture information.

### Claim 21 (depends on 9)

The device according to claim 9, wherein constructing the dataset based on the three-dimensional true-color structure and the captured image comprises:
orthogonally projecting the three-dimensional true-color structure at different angles and scales to obtain two-dimensional image data in any direction and size;
determining an image set A of the power device with partially occlusion based on angle transformation;
adjusting illumination to obtain an image set B under strong light and weak light;
conducting angle transformation by a preset amplitude for a location of a specified component or defect of the power device to obtain an image set C of a target at different viewing angles;
scaling up and down a specified target of the power device to obtain a local image set D and an image set E with a small proportion of target pixels; and
combining the captured image, the image set A, the image set B, the image set C, the image set D, and the image set E into the dataset.
