Simulation of viewpoint capture from environment rendered with ground truth heuristics

A method, comprising:

• retrieving, by a processor, a camera feed of an ego object navigating within a physical environment;
• generating, by the processor according to one or more first environment metrics based on the camera feed, a three-dimensional (3D) model including a first surface corresponding to one or more physical ways through the physical environment, the one or more first environment metrics indicative of boundaries of the one or more physical ways;
• generating, by the processor according to one or more second environment metrics, one or more geometric two-dimensional (2D) objects on the first surface, the second environment metrics indicative of the one or more physical ways;
• identifying, by the processor according to one or more viewpoint metrics indicative of cameras of a physical object configured to move along the one or more physical ways, one or more viewpoints oriented to capture corresponding portions of the 3D model;
• rendering, by the processor, from the one or more corresponding portions of the 3D model of the physical environment, one or more simulated environment 2D images each corresponding to respective ones of the viewpoints;
• and
• training, by the processor, an artificial intelligence model in accordance with the camera feed and the one or more simulated environment 2D images.

A non-transitory computer readable medium including one or more instructions stored thereon and executable by a processor to:

• retrieve, by a processor, a camera feed of an ego object navigating within a physical environment;
• generate, by the processor and according to one or more first environment metrics based on the camera feed, a three-dimensional (3D) model including a first surface corresponding to one or more physical ways through the physical environment, the one or more first environment metrics indicative of boundaries of the one or more physical ways;
• generate, by the processor and according to one or more second environment metrics, one or more geometric two-dimensional (2D) objects on the first surface, the second environment metrics indicative of the one or more physical ways;
• identify, by the processor and according to one or more viewpoint metrics indicative of cameras of a physical object configured to move along the one or more physical ways, one or more viewpoints oriented to capture corresponding portions of the 3D model;
• render, by the processor and from the one or more corresponding portions of the 3D model of the physical environment, one or more simulated environment 2D images each corresponding to respective ones of the viewpoints;
• and
• training, by the processor, an artificial intelligence model in accordance with the camera feed and the one or more simulated environment 2D images.