Methods and apparatuses for vehicle appearance feature recognition, methods and apparatuses for vehicle retrieval, storage medium, and electronic devices
AssigneeBeijing Sensetime Technology Development Co., Ltd.
InventorsShuai Yi, Chongdao Wang, Luming Tang, Junjie Yan, Xiaogang Wang
Life of this patent
Estimating the term…
Abstract
The method for vehicle appearance feature recognition includes: multiple region segmentation results of a target vehicle are obtained from an image to be recognized; global feature data and multiple pieces of region feature data are extracted from the image to be recognized based on the multiple region segmentation results; and the global feature data and the multiple pieces of region feature data are fused to obtain appearance feature data of the target vehicle.
Claims19
A method for vehicle appearance feature recognition, comprising:
- obtaining a plurality of region segmentation results of a target vehicle from an image to be recognized;
- extracting global feature data and a plurality of pieces of region feature data from the image to be recognized based on the plurality of region segmentation results;
- and
- fusing the global feature data and the plurality of pieces of region feature data to obtain appearance feature data of the target vehicle,
- wherein the obtaining a plurality of region segmentation results of a target vehicle from an image to be recognized comprises:
- obtaining the plurality of region segmentation results of the target vehicle from the image to be recognized by means of a first neural network for region extraction,
- wherein the first neural network has a first feature extraction layer and a first computing layer connected to a tail end of the first feature extraction layer,
- wherein the obtaining a plurality of region segmentation results of the target vehicle from the image to be recognized by means of a first neural network for region extraction comprises:
- performing feature extraction on the image to be recognized by means of the first feature extraction layer to obtain a plurality of key points of the target vehicle;
- and
- classifying the plurality of key points by means of the first computing layer to obtain a plurality of key point clusters, and respectively fusing feature maps of key points in the plurality of key point clusters, to obtain region segmentation results corresponding to the plurality of key point clusters.
An apparatus for vehicle appearance feature recognition, comprising:
- a memory storing processor-executable instructions;
- and
- a processor arranged to execute the stored processor-executable instructions to perform steps of:
- obtaining a plurality of region segmentation results of a target vehicle from an image to be recognized;
- extracting global feature data and a plurality of pieces of region feature data from the image to be recognized based on the plurality of region segmentation results;
- and
- fusing the global feature data and the plurality of pieces of region feature data to obtain appearance feature data of the target vehicle,
- wherein the obtaining a plurality of region segmentation results of a target vehicle from an image to be recognized comprises:
- obtaining the plurality of region segmentation results of the target vehicle from the image to be recognized by means of a first neural network for region extraction,
- wherein the first neural network has a first feature extraction layer and a first computing layer connected to a tail end of the first feature extraction layer,
- wherein the obtaining a plurality of region segmentation results of the target vehicle from the image to be recognized by means of a first neural network for region extraction comprises:
- performing feature extraction on the image to be recognized by means of the first feature extraction layer to obtain a plurality of key points of the target vehicle;
- and
- classifying the plurality of key points by means of the first computing layer to obtain a plurality of key point clusters, and respectively fusing feature maps of key points in the plurality of key point clusters, to obtain region segmentation results corresponding to the plurality of key point clusters.
A non-transitory computer readable storage medium having stored thereon computer program instructions that, when executed by a processor, cause the processor to implement steps of a method for vehicle appearance feature recognition, the method comprising:
- obtaining a plurality of region segmentation results of a target vehicle from an image to be recognized;
- extracting global feature data and a plurality of pieces of region feature data from the image to be recognized based on the plurality of region segmentation results;
- and fusing the global feature data and the plurality of pieces of region feature data to obtain appearance feature data of the target vehicle,
- wherein the obtaining a plurality of region segmentation results of a target vehicle from an image to be recognized comprises:
- obtaining the plurality of region segmentation results of the target vehicle from the image to be recognized by means of a first neural network for region extraction,
- wherein the first neural network has a first feature extraction layer and a first computing layer connected to a tail end of the first feature extraction layer,
- wherein the obtaining a plurality of region segmentation results of the target vehicle from the image to be recognized by means of a first neural network for region extraction comprises:
- performing feature extraction on the image to be recognize by means of the first feature extraction layer to obtain a plurality of key points of the target vehicle, and classifying the plurality of key points by means of the first computing layer to obtain a plurality of key point clusters, and respectively fusing feature maps of key points in the plurality of key point clusters, to obtain region segmentation results corresponding to the plurality of key point clusters.
Dependencies are inferred from the claim text.