Self-improving data engine for autonomous vehicles
AssigneeNEC Laboratories America, Inc.
InventorsJong-Chyi Su, Sparsh Garg, Samuel Schulter, Manmohan Chandraker, Mingfu Liang
Life of this patent
Estimating the term…
Loading patent…
AssigneeNEC Laboratories America, Inc.
InventorsJong-Chyi Su, Sparsh Garg, Samuel Schulter, Manmohan Chandraker, Mingfu Liang
Estimating the term…
Systems and methods for a self-improving data engine for autonomous vehicles is presented. To train the self-improving data engine for autonomous vehicles (SIDE), multi-modality dense captioning (MMDC) models can detect unrecognized classes from diversified descriptions for input images. A vision-language-model (VLM) can generate textual features from the diversified descriptions and image features from corresponding images to the diversified descriptions. Curated features, including curated textual features and curated image features, can be obtained by comparing similarity scores between the textual features and top-ranked image features based on their likelihood scores. Generate annotations, including bounding boxes and labels, can be generated for the curated features by comparing the similarity scores of labels generated by a zero-shot classifier and the curated textual features. The SIDE can be trained using the curated features, annotations, and feedback.
A computer-implemented method for training a self-improving data engine for autonomous vehicles (SIDE), comprising:
A system for training a self-improving data engine for autonomous vehicles (SIDE), comprising:
A non-transitory computer program product comprising a computer-readable storage medium including program code for training a self-improving data engine for autonomous vehicles (SIDE), wherein the program code when executed on a computer causes the computer to:
Dependencies are inferred from the claim text.