Multimodal entity and coreference resolution for assistant systems
AssigneeMeta Platforms Technologies, LLC
InventorsShivani Poddar, Seungwhan Moon, Paul Anthony Crook, Rajen Subba
Life of this patent
Estimating the term…
Loading patent…
AssigneeMeta Platforms Technologies, LLC
InventorsShivani Poddar, Seungwhan Moon, Paul Anthony Crook, Rajen Subba
Estimating the term…
In one embodiment, a method includes receiving, at a client system, an audio input, where the audio input comprises a coreference to a target object, accessing visual data from one or more camera associated with the client system, where the visual data comprises images portraying one or more objects, resolving the coreference to the target object from among the one or more objects, resoling the target object to a specific entity, and providing, at the client system, a response to the audio input, where the response comprises information about the specific entity.
A method for operating a head-word device, the method comprising:
A non-transitory computer-readable storage medium including executable instructions that, when executed by one or more processors, causes the one or more processors to:
A head-wearable device including a camera and a microphone, the head-wearable device configured to:
Dependencies are inferred from the claim text.