Intent detection with a computing device
AssigneeGoogle Inc.
InventorsArchana Kannan, Roza Chojnacka, Jamieson Kerns, Xiyang Luo, Meltem Oktem, Nada Elassal
Life of this patent
Estimating the term…
Abstract
A method can perform a process with a method including capturing an image, determining an environment that a user is operating a computing device, detecting a hand gesture based on an object in the image, determining, using a machine learned model, an intent of a user based on the hand gesture and the environment, and executing a task based at least on the determined intent.
Claims20
A method, comprising:
- determining an environment in which a user is operating a computing device;
- detecting a verbal command using the computing device;
- and
- determining, using a machine learned model, an intent of the user based on the verbal command and the environment;
- executing a first task based on the intent of the user, the first task including:
- capturing an image;
- and
- detecting an object in the image;
- and
- executing a second task based on the verbal command and a feature of the object.
A system comprising:
- a memory storing a set of instructions;
- and
- a processor configured to execute the set of instructions to cause the system to:
- determining an environment in which a user is operating a computing device;
- detecting a verbal command using the computing device;
- determining, using a machine learned model, an intent of the user based on the verbal command and the environment;
- executing a first task based on the intent of the user, the first task including:
- capturing an image;
- and
- detecting an object in the image;
- and
- executing a second task based on the verbal command and a feature of the object.
A non-transitory computer readable storage medium containing instructions that when executed by a processor of a computer system cause the processor to perform steps comprising:
- determining an environment in which a user is operating a computing device;
- detecting a verbal command using the computing device;
- determining, using a machine learned model, an intent of the user based on the verbal command and the environment;
- executing a first task based on the intent of the user, the first task including:
- capturing an image;
- and
- detecting an object in the image;
- and
- executing a second task based on the verbal command and a feature of the object.
Dependencies are inferred from the claim text.