US 2022/0036579 A1 · Systems and Methods for Simulating Dynamic Objects Based on Real World Data

Abstract

Systems and methods for generating simulation data based on real-world dynamic objects are provided. A method includes obtaining two- and three-dimensional data descriptive of a dynamic object in the real world. The two- and three-dimensional information can be provided as an input to a machine-learned model to receive object model parameters descriptive of a pose and shape modification with respect to a three-dimensional template object model. The parameters can represent a three-dimensional dynamic object model indicative of an object pose and an object shape for the dynamic object. The method can be repeated on sequential two- and three-dimensional information to generate a sequence of object model parameters over time. Portions of a sequence of parameters can be stored as simulation data descriptive of a simulated trajectory of a unique dynamic object. The parameters can be evaluated by an objective function to refine the parameters and train the machine-learned model.

Claims20

Dependent claims

A computing system comprising:

one or more processors;
and
one or more computer-readable medium storing instructions that when executed by the one or more processors cause the computing system to perform operations, the operations comprising:
obtaining sensor data indicative of a dynamic object, wherein the sensor data comprises three-dimensional data and two-dimensional data associated with the dynamic object;
providing input data descriptive of the sensor data indicative of the dynamic object as an input to a machine-learned object parameter estimation model;
receiving as an output of the machine-learned object parameter estimation model, in response to receipt of the input data, a plurality of object model parameters indicative of at least one of a pose or a shape modification with respect to a template object model, wherein the plurality of object model parameters represent a three-dimensional dynamic object model indicative of an object pose and an object shape for the dynamic object;
and
generating at least a portion of simulation data based, at least in part, on the plurality of object model parameters.

5 more elements

A computer-implemented method comprising:

obtaining sensor data indicative of a dynamic object, wherein the sensor data comprises three-dimensional data and two-dimensional data associated with the dynamic object;
providing input data descriptive of the sensor data indicative of the dynamic object as an input to a machine-learned object parameter estimation model;
receiving as an output of the machine-learned object parameter estimation model, in response to receipt of the input data, a plurality of object model parameters indicative of at least one of a pose or a shape modification with respect to a template object model, wherein the plurality of object model parameters represent a three-dimensional dynamic object model indicative of an object pose and an object shape for the dynamic object;
and
generating at least a portion of simulation data based, at least in part, on the plurality of object model parameters.

2 more elements

One or more tangible, non-transitory, computer readable media that store instructions that when executed by one or more processors cause the one or more processors to perform operations comprising:

obtaining sensor data indicative of a dynamic object, wherein the sensor data comprises three-dimensional data and two-dimensional data associated with the dynamic object;
providing input data descriptive of the sensor data indicative of the dynamic object as an input to a machine-learned object parameter estimation model;
receiving as an output of the machine-learned object parameter estimation model, in response to receipt of the input data, a plurality of object model parameters indicative of at least one of a pose or a shape modification with respect to a template object model, wherein the plurality of object model parameters represent a three-dimensional dynamic object model indicative of an object pose and an object shape for the dynamic object;
and
generating at least a portion of simulation data based, at least in part, on the plurality of object model parameters.

2 more elements

Dependencies are inferred from the claim text.

Systems and Methods for Simulating Dynamic Objects Based on Real World Data

Life of this patent

Systems and Methods for Simulating Dynamic Objects Based on Real World Data

Life of this patent

Abstract

Claims20