Continuous flow estimation for dynamic scenes

A method for flow estimation by an apparatus, comprising:

• obtaining a first time series sequence of sample sets of a scene over a first period of time associated with a reference time, wherein the first time series sequence comprises a first set of samples and a second set of samples;
• processing, with a spatial-temporal attention module trained for sample partitioning, the first time series sequence, to generate a modified first time series sequence of sample sets of the scene comprising the first set of samples and not the second set of samples;
• processing, with a first neural ordinary differential equation (ODE) trained to model flow estimation and a first ODE solver, the modified first time series sequence to predict a second time series sequence of sample sets of the scene over a second period of time;
• and
• generating a first output indicating a predicted flow of the scene from the reference time to a first selected time based on the modified first time series sequence and the second time series sequence.

One or more non-transitory computer-readable media comprising executable instructions that, when executed by one or more processors of an apparatus, cause the apparatus to perform operations comprising:

• obtaining a first time series sequence of sample sets of a scene over a first period of time associated with a reference time, wherein the first time series sequence comprises a first set of samples and a second set of samples;
• processing, with a spatial-temporal attention module trained for sample partitioning, the first time series sequence, to generate a modified first time series sequence of sample sets of the scene comprising the first set of samples and not the second set of samples;
• processing, with a first neural ordinary differential equation (ODE) trained to model flow estimation and a first ODE solver, the modified first time series sequence to predict a second time series sequence of sample sets of the scene over a second period of time;
• and
• generating a first output indicating a predicted flow of the scene from the reference time to a first selected time based on the modified first time series sequence and the second time series sequence.