Personal vehicle linear sensor data for ar odometry sensor fusion
AssigneeSnap Inc.
InventorsEdmund Graves Brown, Benjamin Lucas, Jonathan M. Rodriguez, II, Richard Zhuang
Life of this patent
Estimating the term…
Abstract
A method of providing an interactive personal mobility system, performed by one or more processors, comprises determining an initial pose by visual-inertial odometry performed on images and inertial measurement unit (IMU) data generated by a wearable augmented reality device. Sensor data transmitted from a personal mobility system is received, and sensor fusion is performed on the data received from the personal mobility system to provide an updated pose. Augmented reality effects are displayed on the wearable augmented reality device based on the updated pose.
Claims18
A method of providing an interactive personal mobility system, performed by one or more processors, comprising:
- determining an initial pose by visual-inertial odometry performed on images and inertial measurement unit (IMU) data generated by a wearable augmented reality device moving through a real-world environment;
- receiving linear motion sensor data transmitted from a personal mobility system;
- performing sensor fusion on the linear motion sensor data received from the personal mobility system and data for the initial pose thereby to generate an updated pose;
- and
- displaying a particular augmented reality effect on the wearable augmented reality device based on the updated pose, the display of the particular augmented reality effect being fixed relative to a frame of reference of the real-world environment.
A computing apparatus for enabling interactive personal mobility systems comprising:
- a processor;
- and
- a memory storing instructions that, when executed by the processor, configure the computing apparatus to perform operations comprising:
- determining an initial pose by visual-inertial odometry performed on images and inertial measurement unit (IMU) data generated by a wearable augmented reality device moving through a real-world environment;
- receiving linear motion sensor data transmitted from a personal mobility system;
- performing sensor fusion on the linear motion sensor data received from the personal mobility system and data for the initial pose thereby to generate an updated pose;
- and
- displaying a particular augmented reality effect on the wearable augmented reality device based on the updated pose, the display of the particular augmented reality effect being fixed relative to a frame of reference of the real-world environment.
A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:
- determining an initial pose by visual-inertial odometry performed on images and inertial measurement unit (IMU) data generated by a wearable augmented reality device moving through a real-world environment;
- receiving linear motion sensor data transmitted from a personal mobility system;
- performing sensor fusion on the linear motion sensor data received from the personal mobility system and data for the initial pose thereby to generate an updated pose;
- and
- displaying a particular augmented reality effect on the wearable augmented reality device based on the updated pose, the display of the particular augmented reality effect being fixed relative to a frame of reference of the real-world environment.
Dependencies are inferred from the claim text.