Management of sensor failure in a facility

A method comprising:

• acquiring first sensor data from a first sensor, wherein the first sensor comprises a depth sensor and the first sensor data comprises three-dimensional (3D) data, and wherein the first sensor has a first field of view that includes a first region of a facility;
• acquiring second sensor data from a second sensor, wherein the second sensor comprises an imaging sensor and the second sensor data comprises two-dimensional (2D) image data, and wherein the second sensor has a second field of view that includes at least a portion of the first region of the facility;
• generating, using a first algorithm, first output data using the first sensor data, wherein the first output data is indicative of a location of an object in 3D space within the facility;
• accessing first sensor status data, the first sensor status data indicative of a number of frame delivery failures by the first sensor over a period of time;
• accessing threshold data specifying a maximum number of frame delivery failures permitted for the first sensor to be operational;
• determining that the number of frame delivery failures specified in the first sensor status data exceeds the maximum number of frame delivery failures specified in the threshold data;
• determining failure of the first sensor and a blackout region due to the failure of the first sensor, the blackout region corresponding to the first region of the facility within the first field of view;
• and
• responsive to the determining the failure of the first sensor:
• decreasing a confidence value assigned to the first output data;
• determining the second field of view of the second sensor includes at least a portion of the blackout region;
• and
• generating, using a second algorithm, second output data indicative of an approximate location of the object in 3D space as determined from the 2D image data, wherein the approximate location of the object in 3D space is determined by determining that a portion of the object is in the 2D image data and associating a position of the portion of the object in the 2D image data to a particular location in the facility.

A system comprising:

• a first sensor comprising a depth sensor with a first field of view that includes a first region of a facility;
• a second sensor comprising an imaging sensor with a second field of view that includes at least a portion of the first region of the facility;
• a memory storing computer-executable instructions;
• and
• a hardware processor to execute the computer-executable instructions to:
• acquire first sensor data from the first sensor, wherein the first sensor data comprises three-dimensional (3D) data;
• acquire second sensor data from the second sensor, wherein the second sensor data comprises two-dimensional (2D) image data;
• generate first output data using the first sensor data, wherein the first output data is indicative of a location of an object in 3D space within the facility;
• access first sensor status data indicative of at least a frame rate of delivery for the first sensor;
• access threshold data indicative of at least a threshold frame rate of delivery for the first sensor;
• determine that the frame rate of delivery specified in the first sensor status data is less than the threshold frame rate of delivery specified in the threshold data;
• determine a failure of the first sensor and a blackout region due to the failure of the first sensor, the blackout region corresponding to the first region of the facility within the first field of view;
• determine, based on layout data, that the second field of view of the second sensor senses at least a portion of the blackout region;
• disregard the first sensor data;
• and
• generate second output data indicative of an approximate location of the object within the facility using the second sensor data, wherein the second output data is determined based on a detection of at least a portion of the object in the 2D image data and a determination of motion of the object between two points in time.