Mixed reality display method, mixed reality device, and storage medium

A mixed reality apparatus, comprising:

• a display screen;
• an eye tracker on a display surface of the display screen;
• an image sensor array on a non-display surface of the display screen, wherein a corresponding relation is between image sensors in the image sensor array and a plurality of display sub-regions in the display screen;
• and
• a driving circuit configured to:
• control the eye tracker to track an eyeball of a user, so as to determine a gaze point of the user on the display screen after receiving a mixed display signal;
• determine, according to a corresponding relation between gaze points and display sub-regions in the display screen and the corresponding relation between display sub-regions and image sensors in the image sensor array, at least one first image sensor corresponding to the gaze point;
• adjust the at least one first image sensor, so as to increase a resolution of an image generated by the at least one first image sensor, wherein a distance between a center point of a display sub-region corresponding to the first image sensor and the gaze point is less than a set distance, and fields of view of two adjacent image sensors in the image sensor array partially overlap each other;
• and superimpose and render an environment image output by the image sensor array and a virtual image, so as to obtain and display an MR image.

A non-transitory readable storage medium, comprising a memory, wherein

• the memory is configured to store instructions, and the instructions, when executed by a processor, cause an apparatus comprising the readable storage medium to perform:
• after receiving a mixed display signal, determining a gaze point of a user on a display screen by tracking an eyeball of the user through an eye tracker;
• determining a display sub-region at which the user gazes according to a corresponding relation between gaze points and display sub-regions in the display screen;
• determining at least one first image sensor according to a corresponding relation between display sub-regions and image sensors in an image sensor array, and adjusting the at least one first image sensor to increase a resolution of an image generated by the at least one first image sensor, wherein a distance between a center point of a display sub-region corresponding to the first image sensor and the gaze point is less than a set distance;
• and
• obtaining and displaying an MR image by superimposing and rendering an environment image output by the image sensor array and a virtual image.