Cross reality system with wireless fingerprints

A non-transitory computer-readable medium storing computer executable instructions configured to, when executed by at least one processor, perform a method for operating a portable device comprising an image sensor and wireless hardware and configured to operate within a three-dimensional (3D) environment and display virtual content of a cross reality system, the 3D environment comprising a plurality of locations associated with a plurality of features extracted from image data and a wireless fingerprint linked with a location of the plurality of locations, the wireless fingerprint comprising first network access point information obtained from one or more network access points at a first time, the method comprising:

• obtaining second network access point information from the one or more network access points at a second time different than the first time using the wireless hardware;
• extracting one or more features from image data obtained by the image sensor;
• identifying the location from among the plurality of locations of the 3D environment based on correspondence between the one or more features extracted from the image data obtained by the image sensor and features of the plurality of features of the 3D environment;
• and
• based on selecting the location, updating the wireless fingerprint linked with the location of the 3D environment by merging the second network access point information obtained at the second time with the first network access point information obtained at the first time.

A portable device configured to operate within a three-dimensional (3D) environment and display virtual content of a cross reality system, the 3D environment comprising a plurality of features, the portable device comprising:

• at least one processor;
• an image sensor;
• wireless hardware;
• and
• computer executable instructions configured to, when executed by the at least one processor, perform a method comprising:
• creating a tracking map of the 3D environment by extracting a plurality of features from image data obtained by the image sensor, the tracking map comprising a plurality of locations, each location of the plurality of locations linked with at least one feature of the plurality of features extracted from the image data obtained by the image sensor;
• repeatedly identifying a location from the plurality of locations of the tracking map using the plurality of features extracted from the image data obtained by the image sensor and updating a wireless fingerprint linked with the location using first network access point information obtained with the wireless hardware at a first time, the wireless fingerprint comprising second network access point information obtained at a second time prior to the first time.