Temporal fusion for perception in autonomous systems and applications
AssigneeNVIDIA Corporation
InventorsJingyu Song, Xudong Chen, Liupei Lu, Jie Li, Langechuan Liu
Life of this patent
Estimating the term…
Loading patent…
AssigneeNVIDIA Corporation
InventorsJingyu Song, Xudong Chen, Liupei Lu, Jie Li, Langechuan Liu
Estimating the term…
In various examples, temporal memory fusion in scene perception for autonomous and/or semi-autonomous systems and applications is described herein. Systems and methods are disclosed that use a temporal fusion model (e.g., the model) to generate representations—such as BEV images-associated with an environment. For instance, a working memory buffer may maintain working memory features, such as in a fixed-lag manner. A temporal overlap heatmap—such as a temporal overlap image—may then be temporally propagated to indicate a number of times individual grid cells fall within fields of view associated with temporal features. As such, to generate a representation using the model's temporal reasoning capabilities, the model may fuse the heatmap with the working memory features and/or the current features using one or more neural networks. The model may then process the fused output using one or more decoders to generate the representation.
A system comprising:
A method comprising:
One or more processors comprising processing circuitry to:
Dependencies are inferred from the claim text.