Localization using Audio and Visual Data
AssigneesNiantic International Technology Limited, Niantic, Inc.
InventorsKarren Dai Yang, Michael David Firman, Eric Brachmann, Clément Godard
Life of this patent
Estimating the term…
Abstract
A reference image and recorded sound of an environment of a client device are obtained. The recorded sound may be captured by a microphone of the client device in a period of time after generation of a localization sound by the client device. The location of the client device in the environment may be determined using the reference image and the recorded sound.
Claims20
A computer-implemented method for localization, the method comprising:
- obtaining a reference image of an environment of a client device;
- obtaining recorded sound of the environment of the client device, the recorded sound captured by a microphone of the client device in a period of time after generation of a localization sound by the client device;
- and
- determining a location of the client device in the environment using the reference image and the recorded sound.
A non-transitory computer-readable medium storing computer-executable instructions for localization that, when executed by a computing system, cause the computing system, to perform operations comprising:
- obtaining a reference image of an environment of a client device;
- obtaining recorded sound of the environment of the client device, the recorded sound captured by a microphone of the client device in a period of time after generation of a localization sound by the client device;
- and
- determining a location of the client device in the environment using the reference image and the recorded sound.
Dependencies are inferred from the claim text.