Binocular see-through AR head-mounted display device and information displaying method thereof

2:

• The method, as recited in claim 1, wherein displaying the information source image of virtual information to be displayed onto the image display source on the left and the right respectively, wherein the coordinates of the left and the right pixel pair of the target object is a reference position, comprises steps of:
• displaying the information source image of virtual information to be displayed onto the image display source on left and right respectively, wherein the coordinates of the left and right pixel pair of the target object is a center;
• or
• displaying the information source image of virtual information to be displayed onto the image display source on left and right respectively, which is at a shifted position of the coordinates of the left and right pixel pair of the target object.

4:

• The method, as recited in claim 3, wherein modification method of η comprises steps of:
• controlling the image display source to display each pixel pair of a left and a right modified bitmap in sequence to project a virtual bitmap corresponding to each pixel pair in front of the user eyes;
• capturing the line-of-sight information data in eye-centered coordinate while the user stares at every virtual bitmap to calculate the line-of-sight information data in eye-centered coordinate corresponding to the virtual bitmap;
• and
• modifying η by using the line-of-sight information data in eye-centered coordinate corresponding to all the virtual bitmap.

6:

• The method, as recited in claim 3, wherein the modification of η comprises steps of:
• controlling the image display source to display multiple sets of a left and a right modified image in sequence to project a virtual overlap image corresponding to every set of the modified image in front of the user eyes;
• capturing line-of-sight information data in eye-centered coordinate while the user stares at every virtual overlap image to obtain the line-of-sight information data in eye-centered coordinate corresponding to the virtual overlap image;
• and
• modifying η by using the line-of-sight information data in eye-centered coordinate corresponding to all of the virtual overlap images.

10:

• A binocular see-through AR head-mounted display device comprises an image display source, a line-of-sight tracking system and a data processing module, wherein the data processing module stores a line-of-sight mapping relationship η;
• η is a mapping relationship between line-of-sight information data in eye-centered coordinate and coordinates of a left and a right pixel pair of the image display source on the head-mounted device, wherein
• the line-of-sight tracking system is for capturing line-of-sight information data in eye-centered coordinate while a user stares at a target object;
• the data processing module is for obtaining coordinates of the left and the right pixel pair of the target object according to η and the line-of-sight information data in eye-centered coordinate of the target object;
• the image display source is for displaying an information source image of virtual information to be displayed on left and right respectively, wherein the coordinates of the left and the right pixel pair of the target object is a reference position.

11:

• The head-mounted display device, as recited in claim 10, wherein the image display source is for:
• displaying the information source image of the virtual information to be displayed on the left and the right of the image display source respectively, wherein the coordinates of the left and the right pixel pair of the target object as a center;
• or
• displaying the information source image of the virtual information to be displayed on the left and the right of the image display source respectively, which is at a shifted position of the coordinates of the left and the right pixel pair of the target object.

13:

• The head-mounted display device, as recited in claim 12, wherein the adapter module is for:
• controlling the image display source to display each pixel pair in a left and a right modified bitmap in sequence to project a virtual bitmap corresponding to each pixel pair in front of the user eyes;
• controlling the line-of-sight tracking system to capture the line-of-sight information data in eye-centered coordinate when the user stares at each virtual bitmap to obtain the line-of-sight information data in eye-centered coordinate corresponding to the virtual bitmap;
• controlling the data processing module to modify η by using the line-of-sight information data in eye-centered coordinate corresponding to all the virtual bitmaps.

15:

• The head-mounted display device, as recited in claim 12, wherein the adapter module is for:
• controlling the image display source to display multiple sets of modified images on the left and the right in sequence to project a virtual overlapped image corresponding to each set of the modified image in front of the user eyes;
• controlling the line-of-sight tracking system to capture the line-of-sight information data in eye-centered coordinate while the user stares at each virtual overlapped image to obtain line-of-sight information data in eye-centered coordinate corresponding to the virtual overlapped image;
• controlling the data processing module to modify η by using the human space line-of-sight information data corresponding to all the virtual overlapped image.

17:

• The method, as recited in claim 1 wherein an offline constructing method of η comprises steps of:
• capturing multiple sets of the left and the right bitmaps;
• testing a test user in multiple test users by using all the left and right bitmaps in sequence to obtain test data of the test user;
• and
• constructing η according to the test data of all the test users;
• wherein, testing the test user by using all the left and the right bitmap to calculate the test data of the test user comprises steps of:
• controlling the image display source to display each pixel pair of the left and the right bitmap in sequence for each set of the left and the right bitmap of the multiple sets of the left and the right bitmaps in sequence to project the virtual bitmap corresponding to the coordinates of the pixel pair in front of the test user eyes;
• capturing the line-of-sight information data in eye-centered coordinate while the user stares at the virtual bitmap to obtain the line-of-sight information data in eye-centered coordinate corresponding to the pixel pair;
• and
• determining the test data of the test user and building a mapping relationship between the test data comprising the coordinates of each pixel pair of all the left and the right bitmap and the corresponding line-of-sight information data in eye-centered coordinate.

18:

• The method, as recited in claim 2, wherein an offline constructing method of η comprises steps of:
• capturing multiple sets of the left and the right bitmaps;
• testing a test user in multiple test users by using all the left and right bitmaps in sequence to obtain test data of the test user;
• and
• constructing η according to the test data of all the test users;
• wherein, testing the test user by using all the left and the right bitmap to calculate the test data of the test user comprises steps of:
• controlling the image display source to display each pixel pair of the left and the right bitmap in sequence for each set of the left and the right bitmap of the multiple sets of the left and the right bitmaps in sequence to project the virtual bitmap corresponding to the coordinates of the pixel pair in front of the test user eyes;
• capturing the line-of-sight information data in eye-centered coordinate while the user stares at the virtual bitmap to obtain the line-of-sight information data in eye-centered coordinate corresponding to the pixel pair;
• and
• determining the test data of the test user and building a mapping relationship between the test data comprising the coordinates of each pixel pair of all the left and the right bitmap and the corresponding line-of-sight information data in eye-centered coordinate.

19:

• The method, as recited in claim 17, wherein capturing the multiple sets of the left and the right bitmaps comprise steps of:
• capturing an initial left and right bitmap;
• and
• obtaining the multiple sets of the left and the right bitmaps according to the initial left and right bitmap and shorten a center to center distance of the calculated multiple sets of the left and the right bitmaps in sequence.

20:

• The method, as recited in claim 1, wherein η fulfils:
• (ELnm1,ERnm2)θ(SLnm1,SRnm2);
• wherein (ELnm1,ERnm2) is the line-of-sight information data in eye-centered coordinate;
• (SLnm1,SRnm2) are the coordinates of the left and the right pixel pair of the image display source on the head-mounted device, wherein nε[1,N], m1ε[1,M] m2ε[1,M];
• N and M are a vertical resolution and a horizontal resolution of a left and a right image display source of the head-mounted device respectively;
• ƒ is a fitting function.

21:

• The method, as recited in claim 2, wherein η fulfils:
• (ELnm1,ERnm2)ƒ(SLnm1,SRnm2);
• wherein (ELnm1,ERnm2) is the line-of-sight information data in eye-centered coordinate;
• (SLnm1,SRnm2) are the coordinates of the left and the right pixel pair of the image display source on the head-mounted device, wherein nε[1,N], m1ε[1,M], m2ε[1,M];
• N and M are a vertical resolution and a horizontal resolution of a left and a right image display source of the head-mounted device respectively;
• ƒ is a fitting function.

22:

• The method, as recited in claim 5, wherein η fulfils:
• (ELnm1,ERnm2)ƒ(SLnm1,SRnm2);
• wherein (ELnm1,ERnm2) is the line-of-sight information data in eye-centered coordinate;
• (SLnm1,SRnm2) are the coordinates of the left and the right pixel pair of the image display source on the head-mounted device, wherein nε[1,N], m1ε[1,M], m2ε[1,M];
• N and M are a vertical resolution and a horizontal resolution of a left and a right image display source of the head-mounted device respectively;
• ƒ is a fitting function.

23:

• The method, as recited in claim 6, wherein η fulfils:
• (ELnm1,ERnm2)ƒ(SLnm1,SRnm2);
• wherein (ELnm1,ERnm2) is the line-of-sight information data in eye-centered coordinate;
• (SLnm1, SRnm2) are the coordinates of the left and the right pixel pair of the image display source on the head-mounted device, wherein nε[1,N], m1ε[1,M], m2ε[1,M];
• N and M are a vertical resolution and a horizontal resolution of a left and a right image display source of the head-mounted device respectively;
• ƒ is a fitting function.

24:

• The head-mounted device, as recited in claim 10, wherein η fulfills:
• (ELnm1,ERnm2)ƒ(SLnm1,SRnm2);
• wherein (ELnm1,ERnm2) is the line-of-sight information data in eye-centered coordinate;
• (SLnm1,SRnm2) are coordinates of the left and the right pixel pair of the image display source on the head-mounted device;
• wherein nε[1,N], m1ε[1,M], m2ε[1,M];
• N and M are a vertical resolution and a horizontal resolution of a left and a right image display source on the head-mounted device respectively;
• ƒ is a fitting function.