System and method of using multi-resolution camera clusters input data for controlling autonomous vehicles

An autonomous vehicle comprising:

• a set of multi-resolution cameras disposed on at least one side of the autonomous vehicle, Wherein the set of multi-resolution cameras comprises a first central camera having a first resolution, and multiple first cameras having one or more resolutions that are lower than the first resolution and disposed around the first central camera, and wherein the set of multi-resolution cameras comprise multi-spectral cameras with multiple field of views, and wherein the multiple first cameras are disposed around the first central camera in multiple camera clusters, each camera cluster having:
• a second central camera;
• and
• multiple second cameras, having one or more resolutions that are different from a. resolution of the second central camera and disposed around the second central camera, wherein the second central camera has a higher resolution than the one or more resolutions of the multiple second cameras;
• at least one processor communicatively coupled to the set of multi-resolution cameras;
• and
• memory coupled to the processor, wherein the memory comprises an image processing unit and a central processing and control unit, wherein the image processing unit, when executed by the at least one processor, is to:
• receive two-dimensional (2D) images of scenes using the first central camera and the multiple first cameras of the set of Multi-resolution :cameras;
• generate a low-resolution depth map for each scene of the scenes using the received 2D images using given depths;
• generate a high-resolution depth map for each scene of the scenes for a wide depth range by iteratively refining the low-resolution depth map for each scene;
• generate a three-dimensional (3D) video based on the high-resolution depth map corresponding to each scene of the scenes and the received 2D images of the first central camera;
• and
• send the 3D video to the central processing and control unit in the autonomous vehicle, wherein the central processing and control unit is to utilize includes an artificial intelligence unit that utilizes an artificial intelligence to:
• compute a distance, a velocity, and an acceleration of one or more objects. relative to the autonomous vehicle by analyzing multiple frames of the 3D video, wherein analyzing the multiple frames of the 3D video comprises analyzing each frame of the multiple frames that includes a 2D image of the received 2D images of the first central camera and a corresponding 1Ugh-resolution depth map associated with the 2D image;
• and
• control the autonomous vehicle based on the computed distance, velocity and acceleration of the one or more objects.

A non-transitory machine-readable storage medium encoded with instructions that, when executed by a processor of a container host, cause the processor to:

• receive two-dimensional (2D) images of scenes using a first central camera and multiple first cameras of a set of multi-resolution cameras, wherein the set of multi-resolution cameras comprises the first central camera having a first resolution, and the multiple first cameras having one or more resolutions that are lower than the first resolution and disposed around the first central camera, and wherein the set of multi-resolution cameras comprise multi-spectral cameras with multiple field of views, and wherein the multiple first cameras are disposed around the first central camera in multiple camera cluster, each camera cluster having:
• a second central camera;
• and
• multiple second cameras, having one or More resolutions that are different from a resolution of the second central camera and disposed around the second central camera, wherein the second central camera has a higher resolution than the one or more resolutions of the multiple second cameras;
• generate a. low-resolution depth map for each scene of the scenes using the received 2D images using given depths;
• generate a high-resolution depth map for each scene of the scenes for a wide depth range by iteratively refining the low-resolution depth map for each scene;
• generate a three-dimensional (3D) video based on the high-resolution depth map corresponding to each scene of the scenes and the received 2D images of the first central camera;
• and
• send the 3D video to a central processing and control unit of the autonomous vehicle, wherein the central processing and control unit includes an artificial intelligence unit that utilizes an artificial intelligence to:
• compute a distance a velocity, and an acceleration of one or more objects relative to the autonomous vehicle by analyzing multiple frames of the 3D video, wherein analyzing the multiple frames of the 3D video comprises analyzing each frame of the multiple frames that includes a 2D image of the received 2D images of the first central camera and a corresponding high-resolution depth map associated with the 2D image;
• and
• control the autonomous vehicle based on the computed distance, velocity, and acceleration of the one or more objects.