Computer device and method for controlling robotic arm to grasp and place objects
AssigneeChiun Mai Communication Systems, Inc.
InventorTUNG-CHUN HSIEH
Life of this patent
Estimating the term…
Abstract
A method for controlling a robotic arm to grasp and place objects includes acquiring a plurality of sets of images each of which including an RGB image and a depth image. The RGB image and the depth image of each set are associated with each other. A plurality of fused images are obtained by fusing of depth information on each RGB image based on depth information of corresponding depth image. Once a three-dimensional map is constructed based on the plurality of fused images, a robotic arm is controlled to grasp and place objects based on the three-dimensional map.
Claims18
A method of controlling a robotic arm to grasp and place objects comprising:
- obtaining a plurality of sets of images, the plurality of sets of images comprising a plurality of RGB images and a plurality of depth images taken by a depth camera module of the robotic arm, and each set of the plurality of sets of images comprises one RGB image and one depth image;
- associating the one RGB image with the one depth image of the each set of the plurality of sets of images;
- processing the plurality of RGB images by a preset image processing algorithm;
- fusing of depth information on the processed RGB images based on the depth information of the plurality of depth images to obtain a plurality of fused images;
- constructing a three-dimensional map based on the plurality of fused images;
- and
- controlling the robotic arm to grasp objects and place objects based on the three-dimensional map.
A computer device comprising:
- a storage device;
- at least one processor;
- and
- the storage device storing one or more programs, which when executed by the at least one processor, cause the at least one processor to:
- obtain a plurality of sets of images, wherein the plurality of sets of images comprise a plurality of RGB images and a plurality of depth images taken by a depth camera module of a robotic arm, and each set of the plurality of sets of images comprises one RGB image and one depth image;
- associate the one RGB image with the one depth image of the each set of the plurality of sets of images;
- process the plurality of RGB images by a preset image processing algorithm;
- fuse of depth information on the processed RGB images based on the depth information of the plurality of depth images, to obtain a plurality of fused images;
- construct a three-dimensional map based on the plurality of fused images;
- and
- control the robotic arm to grasp objects and place objects based on the three-dimensional map.
A non-transitory storage medium having instructions stored thereon, when the instructions are executed by a processor of a computer device, the processor is configured to perform a method of controlling a robotic arm to grasp and place an object, wherein the method comprises:
- obtaining a plurality of sets of images, wherein the plurality of sets of images comprise a plurality of RGB images and a plurality of depth images taken by a depth camera module of the robotic arm, and each set of the plurality of sets of images comprises one RGB image and one depth image;
- associating the one RGB image with the one depth image of the each set of the plurality of sets of images;
- processing the plurality of RGB images by a preset image processing algorithm;
- fusing of depth information on the processed RGB images based on the depth information of the plurality of depth images to obtain a plurality of fused images;
- constructing a three-dimensional map based on the plurality of fused images;
- and
- controlling the robotic arm to grasp objects and place objects based on the three-dimensional map.
Dependencies are inferred from the claim text.