Task Execution Based on Real-world Text Detection for Assistant Systems
AssigneeMeta Platforms, Inc.
InventorsElizabeth Kelsey Santoro, Denis Savenkov, Koon Hui Geoffrey Goh, Ruchir Srivastava, Kshitiz Malik
Life of this patent
Estimating the term…
Loading patent…
AssigneeMeta Platforms, Inc.
InventorsElizabeth Kelsey Santoro, Denis Savenkov, Koon Hui Geoffrey Goh, Ruchir Srivastava, Kshitiz Malik
Estimating the term…
In one embodiment, a method includes accessing visual signals comprising images portraying textual content in a real-world environment associated with a first user from a client system associated with the first user, recognizing the textual content based on machine-learning models and the visual signals, determining a context associated with the first user with respect to the real-world environment based on the visual signals, executing tasks determined based on the textual content and the determined context for the first user, and sending instructions for presenting execution results of the tasks to the first user to the client system.
(canceled)
A method comprising, by one or more computing systems:
One or more computer-readable non-transitory non-volatile storage media embodying software that is operable when executed by one or more processors to:
A system comprising:
Dependencies are inferred from the claim text.