Cross reality system with buffering for localization accuracy

An electronic device for rendering virtual content with dynamic buffering in a cross reality environment, comprising:

• a sensor that captures image information about a three-dimensional (3D) environment, the information comprising a plurality of images;
• a processor that executes computer executable instructions, wherein the computer executable instructions comprise instructions, when executed by the processor, cause the processor to perform a set of acts, the set of acts comprising:
• generating a local coordinate frame for representing an object or a portion thereof in the 3D environment;
• determining a set of features from the image information of the 3D environment;
• forwarding the set of features expressed in the local coordinate frame to a localization service on a remote server;
• and
• receiving, from the localization service, at least one transform that localizes the local coordinate frame to a separate coordinate frame of a canonical map of a shareable world model.

A method for localizing an electronic device with dynamic buffering, comprising:

• identifying, from the buffer, a first set of features that is extracted from a first image captured by the electronic device;
• receiving, at the system, a second set of features that is extracted from a second image captured by the electronic device;
• determining a first characteristic for the first set of features and a second characteristic for the second set of features;
• and
• determining whether a triggering condition for dynamically changing a size of the buffer is satisfied based at least in part upon the first characteristic for the first set of features and the second characteristic for the second set of features.