US 12,662,135 B1 · Generating synthetic driving scenes including temporary traffic control zones

Abstract

Techniques are described herein for generating, using diffusion models and/or other generative models, synthetic driving scenes including traffic control zones. In various examples, a driving scene generator may provide the generative model with map data representing a driving environment, and input data representing attributes or objects of a traffic control zone (e.g., a construction zone). The diffusion model may be trained to populate the driving scene by generating agents and objects inside and outside of the traffic control zone in a realistic manner, consistent with the input data, to generate a synthetic driving scene. Synthetic driving scenes generated using generative models may be used to execute realistic simulations targeting specific driving scenarios that include construction zones and other traffic control zones.

Claims20

Dependent claims

A system comprising:

one or more processors;
and
one or more non-transitory computer-readable media storing computer-executable instructions that, when executed, cause the one or more processors to perform operations comprising:
receiving data representing a driving environment;
determining a first token representing an attribute of a first object associated with a temporary traffic control zone;
providing, to a diffusion model trained to output a synthetic driving scene, the data representing the driving environment and the first token;
generating, based at least in part on an output of the diffusion model, the synthetic driving scene including the temporary traffic control zone and the first object within the temporary traffic control zone, wherein the diffusion model is trained to generate the first object based at least in part on the first token;
and
performing a driving simulation based at least in part on the synthetic driving scene.

6 more elements

One or more non-transitory computer-readable media storing instructions executable by a processor, wherein the instructions, when executed, cause the processor to perform operations comprising:

receiving, by a scene generator, map data representing a driving environment;
receiving, by the scene generator, first input data associated with a temporary traffic control zone;
and
generating, using a diffusion model trained to output a driving scene based at least in part on the map data, scene data representing the driving scene, wherein the driving scene includes the temporary traffic control zone and a first object associated with the temporary traffic control zone, and wherein the diffusion model is trained to generate the first object based at least in part on the first input data.

1 more element

Dependencies are inferred from the claim text.

Generating synthetic driving scenes including temporary traffic control zones

Life of this patent

Generating synthetic driving scenes including temporary traffic control zones

Life of this patent

Abstract

Claims20