US 2018/0007350 A1Published application

Binocular See-Through AR Head-Mounted Display Device and Information Display Method Therefor

AssigneeChengdu Idealsee Technology Co., Ltd.

InventorsYinqiu Liu, Qinhua Huang, Yang Liu, Xinyu Li, Haitao Song

Life of this patent

Estimating the term…

Loading patent…

Abstract

A binocular see-through AR head-mounted display device is disclosed. Based on that the mapping relationships fc→s and fd→i are pre-stored in the head-mounted device, the position of the target object in the camera image is obtained through an image tracking method, and is mapped to the screen coordinate system of the head-mounted device for calculating the left/right image display position. Through a monocular distance finding method, the distance between the target object and the camera is real-time calculated referring to the imaging scale of the camera, so as to calculate a left-right image distance, thereby calculating the right or the right image display position. Correspondingly, the present invention also provides an information display method for a binocular see-through AR head-mounted display device and an augmented reality information display system. The present invention is highly reliable with low cost. The conventional depth of field adjustment is to change an image distance of an optical element. However, the present invention breaks conventional thinking, which calculates the left and the right image display positions for depth of field adjustment without changing a structure of an optical device. The present invention is novel and practical compared to changing an optical focal length.

Claims21

Dependent claims

An information display method for a binocular see-through AR (augmented reality) head-mounted display device, wherein a camera-screen mapping relationship fc→s, and a mapping relationship fd→i between a left-right image equivalent-center spacing dt and a virtual image-eye distance Ln are pre-stored in the binocular see-through AR head-mounted display device;

wherein the information display method comprises steps of:
uploading a camera image to a server for image retrieving;
receiving a retrieving result from the server, wherein if the image retrieving succeeds, then the retrieving result comprises position data (x0, y0), an actual size Sr, and virtual information of a target object which is successfully searched;
using (x0, y0) as an initial position for tracking the target object in a camera real-time image;
and recording a position (xt, yt) and a pixel size Spt of the target object in a current image if the target object is successfully tracked;
according to fc→s, mapping the position (xt, yt) to a screen coordinate system for obtaining a left/right image display position on a screen;
according Sr and Spt, calculating a distance Dt between the target object and a camera referring to an imaging scale of the camera;
assigning Dt to Ln, and calculating the left-right image equivalent-center spacing dt according to fd→i;
according to the left/right image display position on the screen and the left-right image equivalent-center spacing dt, calculating a right/left image display position on the screen;
and
respectively displaying the virtual information of the target object at the left and the right image display positions on the screen, or respectively displaying the virtual information of the target object with a calculated position of either left or right image and a certain shift between them.

8 more elements

A binocular see-through AR (augmented reality) head-mounted display device, comprising:

an optical module, an image displayer, an image acquisition module, a data communication module, a tracking module and a data processing module;
wherein a camera-screen mapping relationship fc→s, and a mapping relationship fd→i between a left-right image equivalent-center spacing dt and a virtual image-eye distance Ln are pre-stored in the data processing module;
wherein the optical module comprises an optical lens;
a user synchronically sees an external environment and virtual information on the image displayer through the optical module;
wherein the image acquisition module obtains a camera image;
wherein the data communication module is adopted for uploading the camera image to a server for image retrieving and receiving a retrieving result from the server, wherein if the image retrieving succeeds, then the retrieving result comprises position data (x0, y0), an actual size Sr, and virtual information of a target object which is successfully searched;
wherein the tracking module is adopted for using (x0, y0) as an initial position for tracking the target object in a camera real-time image;
and recording a position (xt, yt) and a pixel size Spt of the target object in a current image if the target object is successfully tracked;
wherein the data processing module is adopted for according to fc→s, mapping the position (xt, yt) to a screen coordinate system for obtaining a left/right image display position on a screen;
according Sr and Spt, calculating a distance Dt between the target object and a camera referring to an imaging scale of the camera;
assigning Dt to Ln, and calculating the left-right image equivalent-center spacing dt according to fd→i;
and according to the left/right image display position on the screen and the left-right image equivalent-center spacing dt, calculating a right/left image display position on the screen;
wherein the image displayer is adopted for respectively displaying the virtual information of the target object at the left and the right image display positions on the screen, or respectively displaying the virtual information of the target object at shifted positions based on the left and the right image display positions on the screen with a certain shift.

10 more elements

Dependencies are inferred from the claim text.