Image processing method in remote control, device, apparatus and program product
AssigneeBeijing Baidu Netcom Science Technology Co., Ltd.
InventorsQingrui Sun, Jingchao Feng, Liming Xia, Zhuo Chen
Life of this patent
Estimating the term…
Abstract
An image processing method in remote control, a device, an apparatus and a program product are provided and related to the field of automatic driving technologies. The specific implementation solution includes receiving image information sent by a vehicle, wherein the image information includes multiple-channel image data collected by the vehicle; performing a stitching process on the multiple-channel image data, to obtain a stitched image; sending the stitched image to a remote cockpit apparatus for controlling the vehicle.
Claims10
An image processing method in remote control, performed by a cloud apparatus, comprising:
- receiving image information sent by a vehicle, wherein the image information comprises multiple-channel image data collected by the vehicle;
- performing a stitching process on the multiple-channel image data to obtain a stitched image;
- and
- sending the stitched image to a remote cockpit apparatus for controlling the vehicle;
- wherein the multiple-channel image data comprises a first channel image data, a second channel image data and a third channel image data, the performing the stitching process on the multiple-channel image data to obtain the stitched image comprises:
- extracting a first common pixel point of the first channel image data and the second channel image data;
- creating a first coordinate system based on the first common pixel point, mapping the first channel image data to the first coordinate system to obtain first image mapping data, and mapping the second channel image data to the first coordinate system to obtain second image mapping data;
- replicating the first image mapping data and the second image mapping data into a first blank image, respectively, and performing weighted fusion of overlapping image data of the first image mapping data and the second image mapping data in the first blank image to obtain a first stitched sub-image;
- extracting a second common pixel point of the third channel image data and the second channel image data;
- creating a second coordinate system based on the second common pixel point, mapping the third channel image data to the second coordinate system to obtain third image mapping data, and mapping the second channel image data to the second coordinate system to obtain fourth image mapping data;
- replicating the third image mapping data and the fourth image mapping data into a second blank image, respectively, and performing weighted fusion of overlapping image data of the third image mapping data and the fourth image mapping data in the second blank image to obtain a second stitched sub-image;
- and
- stitching the first stitched sub-image and the second stitched sub-image to obtain the stitched image.
An electronic apparatus, comprising:
- at least one processor;
- and
- a storage communicatively connected to the at least one processor, wherein,
- instructions executable by the at least one processor are stored in the storage, the instructions are performed by the at least one processor to cause the at least one processor to perform an image processing method in remote control, the method comprising,
- receiving image information sent by a vehicle, wherein the image information comprises multiple-channel image data collected by the vehicle;
- performing a stitching process on the multiple-channel image data to obtain a stitched image;
- sending the stitched image to a remote cockpit apparatus for controlling the vehicle;
- wherein the multiple-channel image data comprises a first channel image data, a second channel image data and a third channel image data, the performing the stitching process on the multiple-channel image data to obtain the stitched image comprises:
- extracting a first common pixel point of the first channel image data and the second channel image data;
- creating a first coordinate system based on the first common pixel point, mapping the first channel image data to the first coordinate system to obtain first image mapping data, and mapping the second channel image data to the first coordinate system to obtain second image mapping data;
- replicating the first image mapping data and the second image mapping data into a first blank image, respectively, and performing weighted fusion of overlapping image data of the first image mapping data and the second image mapping data in the first blank image to obtain a first stitched sub-image;
- extracting a second common pixel point of the third channel image data and the second channel image data;
- creating a second coordinate system based on the second common pixel point, mapping the third channel image data to the second coordinate system to obtain third image mapping data, and mapping the second channel image data to the second coordinate system to obtain fourth image mapping data;
- replicating the third image mapping data and the fourth image mapping data into a second blank image, respectively, and performing weighted fusion of overlapping image data of the third image mapping data and the fourth image mapping data in the second blank image to obtain a second stitched sub-image;
- and
- stitching the first stitched sub-image and the second stitched sub-image to obtain the stitched image.
A non-transitory computer readable storage medium, storing therein computer instructions to cause a computer to perform an image processing method in remote control, the method comprising:
- receiving image information sent by a vehicle, wherein the image information comprises multiple-channel image data collected by the vehicle;
- performing a stitching process on the multiple-channel image data to obtain a stitched image;
- and
- sending the stitched image to a remote cockpit apparatus for controlling the vehicle;
- wherein the multiple-channel image data comprises a first channel image data, a second channel image data and a third channel image data, the performing the stitching process on the multiple-channel image data to obtain the stitched image comprises:
- extracting a first common pixel point of the first channel image data and the second channel image data;
- creating a first coordinate system based on the first common pixel point, mapping the first channel image data to the first coordinate system to obtain first image mapping data, and mapping the second channel image data to the first coordinate system to obtain second image mapping data;
- replicating the first image mapping data and the second image mapping data into a first blank image, respectively, and performing weighted fusion of overlapping image data of the first image mapping data and the second image mapping data in the first blank image to obtain a first stitched sub-image;
- extracting a second common pixel point of the third channel image data and the second channel image data;
- creating a second coordinate system based on the second common pixel point, mapping the third channel image data to the second coordinate system to obtain third image mapping data, and mapping the second channel image data to the second coordinate system to obtain fourth image mapping data;
- replicating the third image mapping data and the fourth image mapping data into a second blank image, respectively, and performing weighted fusion of overlapping image data of the third image mapping data and the fourth image mapping data in the second blank image to obtain a second stitched sub-image;
- and
- stitching the first stitched sub-image and the second stitched sub-image to obtain the stitched image.
Dependencies are inferred from the claim text.