Binocular See-Through AR Head-Mounted Display Device and Information Display Method Therefor

An information display method for a binocular see-through AR head-mounted display device, wherein a mapping relationship η of pupil center coordinates and stared point screen coordinates, and a mapping relationship δ between stared point coordinates in a scene depth image within a user visual field and the stared point screen coordinates are pre-stored in the binocular see-through AR head-mounted display device;

• wherein the information display method comprises steps of:
• measuring the pupil center coordinates when a user stares at a target object;
• processing the scene depth image with target detection, so as to extract a plurality of optional targets;
• calculating the stared point screen coordinates when staring at the target object according to the mapping relationship η and the pupil center coordinates when staring at the target object;
• calculating the stared point coordinates in the scene depth image according to the mapping relationship δ and the stared point screen coordinates when staring at the target object;
• defining the optional targets containing the stared point coordinates in the scene depth image as stared targets;
• mapping stared target coordinates onto screen coordinates according to the mapping relationship δ, so as to obtain screen coordinate areas;
• and
• using the screen coordinate areas as reference positions, and respectively displaying an information source image of virtual information to be displayed on a left and a right of an image display source.

An information display method for a binocular see-through AR head-mounted display device, wherein a mapping relationship η of pupil center coordinates and stared point screen coordinates, and a mapping relationship δ between stared point coordinates in a scene depth image within a user visual field and the stared point screen coordinates are pre-stored in the binocular see-through AR head-mounted display device;

• wherein the information display method comprises steps of:
• measuring the pupil center coordinates when a user stares at a target object;
• dividing areas with different depths in the scene depth image into a plurality of optional stared areas;
• mapping optional stared area coordinates onto screen coordinates in sequence according to the mapping relationship δ, so as to obtain optional stared screen areas respectively corresponding to the optional stared areas;
• calculating the stared point screen coordinates when staring at the target object according to the mapping relationship η and the pupil center coordinates when staring at the target object;
• and defining the optional stared screen areas containing the stared point screen coordinates as stared screen areas;
• and
• using the stared screen areas as reference positions, and respectively displaying an information source image of virtual information to be displayed on a left and a right of an image display source.

An information display method for a binocular see-through AR head-mounted display device, wherein a mapping relationship η of pupil center coordinates and stared point screen coordinates, and a mapping relationship δ between stared point coordinates in a scene depth image within a user visual field and the stared point screen coordinates are pre-stored in the binocular see-through AR head-mounted display device;

• wherein the information display method comprises steps of:
• measuring the pupil center coordinates when a user stares at a target object;
• processing the scene depth image with target detection, so as to extract a plurality of optional targets;
• mapping optional target area coordinates onto screen coordinates in sequence according to the mapping relationship δ, so as to obtain optional stared screen areas respectively corresponding to the optional targets;
• calculating the stared point screen coordinates when staring at the target object according to the mapping relationship η and the pupil center coordinates when staring at the target object;
• and defining the optional stared screen areas containing the stared point screen coordinates as stared screen areas;
• and
• using the stared screen areas as reference positions, and respectively displaying an information source image of virtual information to be displayed on a left and a right of an image display source.

A binocular see-through AR head-mounted display device, comprising:

• an image display source, an eye movement tracing module, and a data processing module;
• wherein a mapping relationship η of pupil center coordinates and stared point screen coordinates, and a mapping relationship δ between stared point coordinates in a scene depth image within a user visual field and the stared point screen coordinates are pre-stored in the data processing module;
• wherein the eye movement tracing module is adopted for measuring the pupil center coordinates when a user stares at a target object;
• wherein the data processing module is adopted for calculating the stared point screen coordinates when staring at the target object according to the mapping relationship and the pupil center coordinates when staring at the target object;
• calculating the stared point coordinates in the scene depth image according to the mapping relationship δ and the stared point screen coordinates when staring at the target object;
• dividing out an area around a stared point which coincides with a depth of the stared point from the scene depth image according to the stared point coordinates in the scene depth image;
• and mapping divided area coordinates onto screen coordinates according to the mapping relationship δ, so as to obtain screen coordinate areas;
• wherein the image display source is adopted for using the screen coordinate areas as reference positions, and respectively displaying an information source image of virtual information to be displayed on a left and a right of the image display source.