Multi-camera dataset assembly and management with high precision timestamp requirements

A device comprising:

• a plurality of interfaces operable to receive streaming data from each of a plurality of image and non-image capture devices;
• and
• timestamping logic implemented, at least in part, in hardware and coupled to the plurality of interfaces to generate and assign timestamp information to each set of data captured by individual capture devices of the plurality of image and non-image capture devices to indicate when the data was captured, wherein the timestamp information is synchronized to a single timestamp reference clock, wherein the timestamping logic is operable to apply timestamp information to a plurality of samples captured by one or more non-image sensors of the plurality of capture devices based on a time when a first of the plurality of samples is received by timestamping logic after a start of frame indicator has been received;
• and
• a processing logic coupled to the timestamping logic to group image data from image capture devices with data from non-image capture devices using the timestamp information.

A method comprising:

• assigning timestamp information to data in each of a plurality of streaming video stream streams, the timestamps generated in hardware and synchronized to a single reference timestamp clock;
• applying timestamp information to a plurality of samples captured by one or more non-image sensors;
• and
• identifying frames from each of the plurality of streaming video streams and data in one or more non-video streams for inclusion into framesets based on assigned timestamps, wherein identifying frames from each of the plurality of streaming video streams and data in one or more non-video streams for inclusion into framesets based on assigned timestamps comprises identifying frames from each of the plurality of streaming video streams and data in one or more non-video streams that have a timestamp that is within a threshold time value from a reference time stamp value of a frameset for inclusion in the frameset.

A method comprising:

• assigning timestamp information to data in each of a plurality of streaming video stream streams, the timestamps generated in hardware and synchronized to a single reference timestamp clock;
• applying timestamp information to a plurality of samples captured by one or more non-image sensors;
• and
• identifying frames from each of the plurality of streaming video streams and data in one or more non-video streams for inclusion into framesets based on assigned timestamps, wherein identifying frames from each of the plurality of streaming video streams and data in one or more non-video streams for inclusion into framesets based on assigned timestamps comprises discarding a newly arrived frame for a capture window if a timestamp of the newly arrived frame is older than a reference timestamp for the capture window by an amount equal to a threshold.

An article of manufacture having one or more non-transitory computer readable media storing instructions which, when executed by a system, cause the system to perform a method comprising:

• assigning timestamp information to data in each of a plurality of streaming video stream streams, the timestamps generated in hardware and synchronized to a single reference timestamp clock;
• applying timestamp information to a plurality of samples captured by one or more non-image sensors;
• and
• identifying frames from each of the plurality of streaming video streams and data in one or more non-video streams for inclusion into framesets based on assigned timestamps, wherein identifying frames from each of the plurality of streaming video streams and data in one or more non-video streams for inclusion into framesets based on assigned timestamps comprises identifying frames from each of the plurality of streaming video streams and data in one or more non-video streams that have a timestamp that is within a threshold time value from a reference time stamp value of a frameset for inclusion in the frameset.

A system comprising:

• a plurality of image and non-image capture devices;
• a device comprising
• a plurality of interfaces operable to receive streaming data from each of a plurality of image and non-image capture devices;
• and
• timestamping logic implemented, at least in part, in hardware and coupled to the plurality of interfaces to generate and assign timestamp information to each set of data captured by individual capture devices of the plurality of image and non-image capture devices to indicate when the data was captured, wherein the timestamp information is synchronized to a single timestamp reference clock;
• and
• a processing logic coupled to the timestamping logic to group image data from image capture devices with data from non-image capture devices using the timestamp information, wherein the timestamping logic is operable to assign timestamp information to data in each of a plurality of streaming video stream streams and to apply timestamp information to a plurality of samples captured by one or more non-image capture devices, and further wherein the processing logic is operable to identify frames from each of the plurality of streaming video streams and data in one or more non-video streams for inclusion into framesets based on assigned timestamps.