Method for Temporal Correction of Multimodal Data

A method (1000) for the chronological correction of multimodal data, with the aim of identifying a chronological offset between the measurement timepoints of data sets from different non synchronous sensors, and relating the data sets to common reference timepoints, the method comprising the following steps:

• receiving a first data set from a reference sensor with measurements at different measurement timepoints;
• receiving a second data set from a second sensor with measurements at different measurement timepoints, each of the different measurement timepoints not exactly matching those of the reference sensor;
• reading the first and the second data sets by a neural network and identifying a respective plurality of feature vectors for the first and second (20) data sets at the respective measurement timepoints;
• merging and comparing the respective pluralities of feature vectors by the neural network so that parameters of a chronological correction are identified;
• and
• identifying a chronological offset between the respective measurement timepoints of the reference sensor and the second sensor, and/or a corrected data set from the second sensor based on the measurement timepoints of the reference sensor.