3-D image system for vehicle control

A control system for controlling a machine having 1) a first sensor comprising a camera, 2) a second sensor that is different than the first sensor, and 3) an auto-steering system, the control system comprising:

• one or more hardware processors configured to:
• obtain map information indicative of a desired predefined path generated by a path generator, the desired predefined path extending along rows in a field;
• receive image data for a row of the rows and identify two maps, including:
• a localization map usable by the machine when the machine is able to localize itself within the row;
• and
• an additional map usable by the machine when the machine is not able to localize itself within the row;
• generate visual odometry (VO) data from the image data, wherein the VO data comprises non-localized data;
• use the non-localized data or the additional map to identify a position of the machine while moving along a physical path next to the row;
• and
• use the non-localized data or the additional map to detect the machine reaching an end of the row, and if sensor data is collected by the second sensor, localize VO calculations of the non-localized data in response to collection of the sensor data;
• and
• wherein the localized VO calculations comprise localized data, and the one or more hardware processors are further configured to:
• use the localized data, if available, or otherwise use the non-localized data, to turn the machine around from a first position at the end of the row to a second position at a start of another row of the rows.