Ai agentic systems for scene understanding
AssigneeNVIDIA Corporation
InventorRafal WYTRYKUS
Life of this patent
Estimating the term…
Abstract
Embodiments of the present disclosure relate to an AI agentic system for scene understanding. Some embodiments perform such scene understanding by extracting, indexing, and iteratively refining scene data through an AI agent that autonomously generates and refines queries in a continuous loop until a predefined completeness threshold is met. This ensures that scene data is not only captured but also refined over time, producing a fully indexed and queryable representation of the scene.
Claims20
One or more processors comprising one or more processing units to:
- in response to an extraction of the scene data, index the scene data to cause the scene data to be queryable;
- based at least on the extraction of the scene data and the scene data being indexed, detect first information associated with the scene by generating a first query via an AI agent;
- and
- in response to the first query being generated, automatically detect second information associated with the scene by generating a second query via the AI agent.
A data center system comprising a plurality of computing nodes, wherein two or more computing nodes of the plurality of computing nodes comprises one or more graphics processing units (GPUs) to:
- obtain extracted scene data of a scene;
- store, in response to the obtaining of the extracted scene data, the extracted scene data using an index to cause the scene data to be queryable;
- based at least on the extracted scene data being obtained and stored using the index, automatically generate, via an AI agent, a plurality of queries until a threshold of at least one of spatial information, semantic information, or dependency-based information associated with the scene is met;
- and
- based at least on the generating of the plurality of queries and the threshold being met, update the index with at least one of the spatial information, semantic information, or dependency-based information.
A method comprising:
- extracting scene data of a scene;
- detecting, based at least on the extracting the scene data, first information associated with the scene by generating a first query via an AI agent;
- and
- automatically detecting, in response to the detecting of at least one of the first information of the scene by generating the first query, second information associated with the scene by generating a second query via the AI agent.
Dependencies are inferred from the claim text.