Image synchronization for multiple image sensors

A non-transitory machine readable medium comprising instructions which, when executed by one or more processors, causes the one or more processors to perform operations comprising:

• capturing sensor data using a sensor of a device, wherein the sensor comprises an image sensor and the sensor data comprises image data;
• obtaining a result of a process performing a processing of the sensor data, wherein the process comprises at least one of a gesture detector, a hand tracker, or an object detector;
• identifying, by the device, a frame identifier that applies to both the sensor data and the result;
• receiving, by the device, a request for time-aligned data;
• providing, based on the frame identifier that applies to both the sensor data and the result and responsive to the request, the sensor data and the result to another process at the device or another device;
• and
• determining an input to the device or an output of the device based at least in part a result of the other process performing a processing of the sensor data and the result of the process.

A device comprising:

• a first sensor;
• a second sensor;
• a memory;
• and
• at least one processor configured to:
• obtain first sensor data the first sensor, wherein the first sensor comprises an image sensor, the first sensor data comprises image data;
• obtain second sensor data using the second sensor;
• identify a frame identifier that applies to both the first sensor data and the second sensor data;
• receive a request for time-aligned data;
• provide, based on the frame identifier that applies to both the first sensor data and the second sensor data and responsive to the request, the first sensor data and the second sensor data to a process at the device or another device, wherein the process comprises at least one of a gesture detector, a hand tracker, or an object detector;
• provide, to at least one additional process at the device, the frame identifier and a result of the process performing a processing of the first sensor data and the second sensor data;
• and
• determine an input to the device or an output of the device based at least in part on a result of the at least one additional process performing a processing of the result of the process.