Method and display system for information display based on positions of human gaze and object

A method for information display, applicable to a display system having a light-transmissive display, at least one first information extraction device comprising an image sensor, and at least one second information extraction device comprising an image sensor, wherein the method comprises:

• capturing a user image of a user to generate position information of the user by using the at least one first information extraction device;
• capturing an object image of an object to generate position information of the object by using the at least one second information extraction device;
• transforming the position information of the user and the position information of the object to a same coordinate system;
• generating human eye gaze information and stereo scene calibration information of a scene in which the object is located according to a result of a coordinate transformation comprising the transformed position information of the user and the transformed position information of the object;
• compute a gaze point of the user on the display according to the human eye gaze information, and perform image recognition on the object according to the object image to generate an image recognition result;
• generating fused information between the user and the target according to the human eye gaze information, the image recognition result, and the stereo scene calibration information, wherein the fused information is a displaying position of the display;
• and
• displaying related information of the object on the display according to the fused information.

A display system, connected to at least one first information extraction device comprising an image sensor and at least one second information extraction device comprising an image sensor, comprising:

• a light-transmissive display;
• a processing device, configured to:
• obtain position information of a user according to a user image of the user captured by the at least one first information extraction device;
• obtain position information of an object according to an object image of the user captured by the at least one second information extraction device;
• transform the position information of the user and the position information of the object to a same coordinate system;
• generate human eye gaze information and stereo scene calibration information of a scene in which the object is located according to a result of a coordinate transformation comprising the transformed position information of the user and the transformed position information of the object;
• compute a gaze point of the user on the display according to the human eye gaze information, and perform image recognition on the object according to the object image to generate an image recognition result;
• generate fused information between the user and the target according to the human eye gaze information, the image recognition result, and the stereo scene calibration information, wherein the fused information is a displaying position on the display;
• and
• display related information of the object on the display according to the fused information.