Miscalibration detection for virtual reality and augmented reality systems

A computer-implemented method, comprising:

• receiving sensor data from each of multiple sensors of a device in a system configured to provide augmented reality or mixed reality output to a user;
• determining, as determined feature values, feature values based on the sensor data for a predetermined set of features;
• processing the determined feature values using a miscalibration detection model that has been trained, based on examples of captured sensor data from one or more devices, to predict whether a miscalibration condition of one or more of the multiple sensors has occurred;
• and
• determining, based on output of the miscalibration detection model, whether to initiate recalibration of extrinsic parameters for at least one of the multiple sensors or to bypass recalibration of the extrinsic parameters.

A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform one or more operations, comprising:

• receiving sensor data from each of multiple sensors of a device in a system configured to provide augmented reality or mixed reality output to a user;
• determining, as determined feature values, feature values based on the sensor data for a predetermined set of features;
• processing the determined feature values using a miscalibration detection model that has been trained, based on examples of captured sensor data from one or more devices, to predict whether a miscalibration condition of one or more of the multiple sensors has occurred;
• and
• determining, based on output of the miscalibration detection model, whether to initiate recalibration of extrinsic parameters for at least one of the multiple sensors or to bypass recalibration of the extrinsic parameters.

A computer-implemented system, comprising:

• one or more computers;
• and
• one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform one or more operations, comprising:
• receiving sensor data from each of multiple sensors of a device in a system configured to provide augmented reality or mixed reality output to a user;
• determining, as determined feature values, feature values based on the sensor data for a predetermined set of features;
• processing the determined feature values using a miscalibration detection model that has been trained, based on examples of captured sensor data from one or more devices, to predict whether a miscalibration condition of one or more of the multiple sensors has occurred;
• and
• determining, based on output of the miscalibration detection model, whether to initiate recalibration of extrinsic parameters for at least one of the multiple sensors or to bypass recalibration of the extrinsic parameters.