Back to results
US 11,360,731 B2Granted
Sharing neighboring map data across devices
AssigneeMicrosoft Technology Licensing, LLC
InventorsEthan Eade, Jeroen Vanturennout, Jonathan Lyons, David Fields, Gavin Dean Lazarow, Tushar Cyril Bhatnagar
Life of this patent
Estimating the term…
Abstract
A computing device and method are provided for transmitting a relevant subset of map data, called a neighborhood, to enable mutual spatial understanding by multiple display devices around a target virtual location to display a shared hologram in the same exact location in the physical environment at the same moment in time. The computing device may comprise a processor, a memory operatively coupled to the processor, and an anchor transfer program stored in the memory and executed by the processor.
Claims16
A first computing device operated by a first user, networked with a second computing device, the first computing device comprising:
- a processor;
- a memory operatively coupled to the processor and storing local map data including at least a first pose graph created by sensor measurements of the first computing device;
- a first display operatively coupled to the memory and the processor;
- and
- an anchor transfer program stored in the memory and executed by the processor to be configured to receive first anchor data causing the first display to display one or more holograms to the first user at a first virtual place-located anchor at a first target virtual location from a vantage point of the first user, and further configured to execute an import anchor mode, wherein
- in the import anchor mode, the anchor transfer program is configured to:
- receive, from the second computing device, neighboring map data of a neighborhood around a second virtual place-located anchor at a second target virtual location including a second pose graph created by sensor measurements of the second computing device;
- incorporate, via a stitching process, the neighboring map data into the local map data of the first computing device to create integrated map data comprising keyframes, each keyframe including feature matching data, the stitching process including stitching together the second pose graph of the neighboring map data and the first pose graph of the local map data by connecting the first pose graph and the second pose graph based on a spatial relationship determined by the anchor transfer program of at least one point of the first pose graph and at least one point of the second pose graph, wherein the spatial relationship comprises the first pose graph, the second pose graph, and a third pose graph connecting the first virtual place-located anchor to the second virtual place-located anchor;
- determine a pose of the first computing device with predictive corrective localization based on the feature matching data in the keyframes of the integrated map data;
- and
- cause the first display to display one or more holograms at the second virtual place-located anchor at the second target virtual location from the vantage point of the first user based on the integrated map data and the determined pose.
8 more elements
A method for a first computing device operated by a first user, networked with a second computing device, the method comprising:
- storing local map data including at least a first pose graph created by sensor measurements of the first computing device;
- receiving first anchor data causing a first display of the first computing device to display one or more holograms to the first user at a first virtual place-located anchor at a first target virtual location from a vantage point of the first user, and executing an import anchor mode, wherein
- in the import anchor mode:
- neighboring map data is received from the second computing device of a neighborhood around a second virtual place-located anchor at a second target virtual location including a second pose graph created by sensor measurements of the second computing device;
- via a stitching process, the neighboring map data is incorporated into the local map data of the first computing device to create integrated map data comprising keyframes, each keyframe including feature matching data, the stitching process including stitching together the second pose graph of the neighboring map data and the first pose graph of the local map data by connecting the first pose graph and the second pose graph based on a spatial relationship of at least one point of the first pose graph and at least one point of the second pose graph, wherein the spatial relationship comprises the first pose graph, the second pose graph, and a third pose graph connecting the first virtual place-located anchor to the second virtual place-located anchor;
- a pose of the first computing device is determined with predictive corrective localization based on the feature matching data in the keyframes of the integrated map data;
- and
- the first display is caused to display one or more holograms at the second virtual place-located anchor at the second target virtual location from the vantage point of the first user based on the integrated map data and the determined pose.
5 more elements
Dependencies are inferred from the claim text.