Display resource management

A method for managing resources in a head-mounted display device, comprising:

• providing the head-mounted display device configured to be worn by a user and operatively connected to a computing device, the head-mounted display device including a plurality of sensors and a display system for presenting holographic objects;
• operating a selected sensor of the plurality of sensors in a default power mode to achieve a selected level of sensor fidelity;
• receiving user-related information from one or more of the plurality of sensors, the user-related information selected from the group consisting of audio information, user gaze information, user location information, user movement information, user image information, and user physiological information;
• determining whether target information is detected in the user-related information;
• when the target information is detected, among the plurality of sensors adjusting only the selected sensor to operate in a reduced power mode that uses less power than the default power mode, thereby achieving a reduced level of sensor fidelity;
• and
• adjusting the selected sensor to operate in a fast response mode in response to a transition of the head-mounted display device into a new environment, the fast response mode using more power than the reduced power mode, thereby achieving an increased level of sensor fidelity;
• wherein the plurality of sensors includes an outward facing image sensor, an eye-tracking sensor, and a position sensor, and
• wherein adjusting only the selected sensor to operate in the reduced power mode includes:
• in response to detecting the target information in the user-related information received from the outward facing image sensor, one or more of reducing a refresh rate and a resolution of the outward facing image sensor,
• in response to detecting the target information received from the eye-tracking sensor, reducing a refresh rate of the eye-tracking sensor, and
• in response to detecting the target information received from the position sensor, reducing a sampling rate of the position sensor.

A resource management system, comprising:

• a head-mounted display device configured to be worn by a user and operatively connected to a computing device, the head-mounted display device comprising a display system for presenting holographic objects and a plurality of sensors including an outward facing image sensor, a position sensor, an eye-tracking sensor, and a microphone;
• and
• a resource management program executed by a processor of the computing device, the resource management program configured to:
• operate a selected sensor of the plurality of sensors in a default power mode to achieve a selected level of sensor fidelity;
• receive user-related information from one or more of the plurality of sensors, the user-related information selected from the group consisting of audio information, user gaze information, user location information, user movement information, user image information, and user physiological information;
• receive physical environment information from one or more of the plurality of sensors;
• determine whether target information is detected in the user-related information or the physical environment information;
• and
• when the target information is detected, among the plurality of sensors adjust only the selected sensor to operate in a reduced power mode that uses less power than the default power mode, thereby achieving a reduced level of sensor fidelity;
• wherein adjusting only the selected sensor to operate in the reduced power mode includes:
• in response to detecting the target information in the user-related information received from the outward facing image sensor, one or more of reducing a refresh rate and a resolution of the outward facing image sensor,
• in response to detecting the target information received from the eye-tracking sensor, reducing a refresh rate of the eye-tracking sensor, and
• in response to detecting the target information received from the position sensor, reducing a sampling rate of the position sensor,
• wherein the resource management system is configured to override the resource management program and adjust the selected sensor to operate in a fast response mode in response to a transition of the head-mounted display device into a new environment, the fast response mode using more power than the reduced power mode, thereby achieving an increased level of sensor fidelity.