Simulated 3D image display method and display device
AssigneeSuperd Co. Ltd.
InventorsYanqing Luo, Peiyun Jian, Ning Liu
Life of this patent
Estimating the term…
Abstract
A simulated 3D image display method is provided for a display device. The method includes capturing at least two images of a scene for 3D scene reconstruction; extracting depth and color information from the at least two images of the scene for 3D scene reconstruction; continuously tracking movement of a user to determine a relative position between the user and the display device; and, based on the relative position, reconstructing the image of the scene corresponding to a current viewpoint of the user from a plurality of view images of a plurality of viewpoints generated based on the at least two images and using an interpolation algorithm for display on a display screen of the display device.
Claims19
A simulated 3D image display method for a display device, comprising:
- capturing at least two images of a scene for 3D scene reconstruction;
- extracting depth and color information from the at least two images of the scene for 3D scene reconstruction;
- continuously tracking movement of a user to determine a relative position between the user and the display device;
- and
- based on the relative position, reconstructing the image of the scene corresponding to a current viewpoint of the user from a plurality of view images of a plurality of viewpoints generated based on the at least two images and using an interpolation algorithm for display on a display screen of the display device,
- wherein the interpolation algorithm comprises:
- when the user is tracked in a viewpoint having range of 0°<θ<60°, a corresponding display image is generated by using:
- Q+kD′=Q′, and k=1−θ/60;
- wherein Q is the relative position of a pixel in a left image of the at least two images of the scene, Q′ is the relative position of a same pixel in a reconstructed image corresponding to the viewpoint of the user, D′ is a parallax value at the relative position Q in a parallax image produced from the left image and a right image of the at least two images of the scene;
- when the user is tracked in the viewpoint having range of 60°≤θ<120°, the corresponding display image is generated by using:
- −kD′Lp1+(1−k)D′Rp2=p′, and k=(θ−90)/60;
- wherein p1 is a column coordinate of the pixel in the left image, p2 is a column coordinate of the same pixel in the right image, p′ is a column coordinate of the same pixel in the reconstructed image, corresponding row coordinates to p1, p2, and p′ are the same, D′L is the parallax value in the parallax image produced with reference to the left image, D′R is the parallax value in the parallax image produced with reference to the right image;
- and
- when the user is tracked in the viewpoint having range of 120°≤θ<180°, the corresponding display image is generated by using:
- F+kD′=F′, and k=(θ−120)/60;
- wherein F is the relative position of the pixel in the right image, F′ is the relative position of the same pixel in the first image that is reconstructed and inserted to the right of the right image, D′ is the parallax value at the relative position F in the parallax image produced from the left image and the right image.
A display device, comprising:
- a camera configured to capture at least two images of a scene for 3D scene reconstruction;
- a position detector configured to continuously track movement of a user to determine a relative position between the user and the display device;
- a mass storage;
- a processor coupled to the mass storage;
- and
- a plurality of program units stored in the mass storage to be executed by the processor, wherein the processor is configured to:
- extract depth and color information of the scene for 3D scene reconstruction based on the at least two images of the scene captured by the camera;
- and
- based on the relative position determined by the position detector, reconstructing the image of the scene corresponding to a current viewpoint of the user from a plurality of view images of a plurality of viewpoints generated based on the at least two images and using an interpolation algorithm for display on a display screen of the display device,
- wherein the interpolation algorithm comprises:
- when the user is tracked in a viewpoint having range of 0°<θ<60°, a corresponding display image is generated by using:
- Q+kD′=Q′, and k=1−θ/60;
- wherein Q is the relative position of a pixel in a left image of the at least two images of the scene, Q′ is the relative position of a same pixel in a reconstructed image corresponding to the viewpoint of the user, D′ is a parallax value at the relative position Q in a parallax image produced from the left image and a right image of the at least two images of the scene;
- when the user is tracked in the viewpoint having range of 60°≤θ<120°, the corresponding display image is generated by using:
- −kD′Lp1+(1−k)D′Rp2=p′, and k=(θ−90)/60;
- wherein p1 is a column coordinate of the pixel in the left image, p2 is a column coordinate of the same pixel in the right image, p′ is a column coordinate of the same pixel in the reconstructed image, corresponding row coordinates to p1, p2, and p′ are the same, D′L is the parallax value in the parallax image produced with reference to the left image, D′R is the parallax value in the parallax image produced with reference to the right image;
- and
- when the user is tracked in the viewpoint having range of 120°≤θ<180°, the corresponding display image is generated by using:
- F+kD′=, and k=(θ−120)/60;
- wherein F is the relative position of the pixel in the right image, F′ is the relative position of the same pixel in the first image that is reconstructed and inserted to the right of the right image, D′ is the parallax value at the relative position F in the parallax image produced from the left image and the right image.
Dependencies are inferred from the claim text.