Machine learning-based processing of environmental data with temporal dynamics and spatial awareness information
AssigneeDell Products L.P.
InventorsZijia Wang, Sanping Li, Tianlu Fei, Zhen Jia, Linye Li
Life of this patent
Estimating the term…
Loading patent…
AssigneeDell Products L.P.
InventorsZijia Wang, Sanping Li, Tianlu Fei, Zhen Jia, Linye Li
Estimating the term…
An apparatus comprises at least one processing device configured to generate, based on an input prompt, a first data structure comprising a textual task description associated with tasks to be performed in an environment, and to generate, based on video data of the environment, a second data structure comprising temporal dynamics information characterizing changes in spatial features of the environment over time. The at least one processing device is also configured to generate, based on images of the environment, a third data structure comprising spatial relationship information characterizing spatial relationships between objects in the environment, and to determine, utilizing at least one machine learning model that takes as input at least portions of the first, second and third data structures, actions to execute in the environment to achieve the tasks. The at least one processing device is further configured to execute the determined actions in the environment.
An apparatus comprising:
A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device:
A method comprising:
Dependencies are inferred from the claim text.