US 12,225,180 B2Granted

Method and apparatus for generating stereoscopic display contents

AssigneeOrbbec 3D Technology International, Inc.

InventorsXin Xie, Nan Xu, Xu Chen

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method of generating stereoscopic display contents includes obtaining, from a Red, Green, Blue plus Distance (RGB-D) image using a processor, a first Red, Green, and Blue (RGB) image and a depth image; determining, based on depth values in the depth image, a first disparity map in accordance with the RGB-D image; determining a second disparity map and a third disparity map by transforming the first disparity map using a disparity distribution ratio; and generating, by the processor, the pair of stereoscopic images comprising a second RGB image and a third RGB image, wherein the second RGB image is generated by shifting a first set of pixels in the first RGB image based on the second disparity map, and the third RGB image is generated by shifting a second set of pixels in the first RGB image based on the third disparity map.

Claims16

Dependent claims

A method of generating stereoscopic display contents, comprising:

obtaining, from a Red, Green, Blue plus Distance (RGB-D) image using a processor, a first Red, Green, and Blue (RGB) image and a depth image;
determining, based on depth values in the depth image, a first disparity map in accordance with the RGB-D image using at least one of a focal length f or an interpupillary distance b, wherein the first disparity map comprises a plurality of disparity values for the first RGB image to be transformed to a pair of stereoscopic images;
determining a left disparity map and a right disparity map by transforming the first disparity map using a disparity distribution ratio k, wherein the left disparity map is determined based on
d
L
(
x
,
y
)
=
k
*
d
⁡
(
x
,
y
)
=
k
*
(
f
*
b
z
⁡
(
x
,
y
)
)
,
and the right disparity map is determined based on
d
R
(
x
,
y
)
=
(
k
-
1
)
*
d
⁡
(
x
,
y
)
=
(
k
-
1
)
*
(
f
*
b
z
⁡
(
x
,
y
)
)
,
wherein z(x,y) represents the depth value of a pixel (x,y) in the RGB-D image, d(x, y) represents the disparity value in the first disparity map, dL(x, y) represents the disparity value in the left disparity map, dR(x, y) represents the disparity value in the right disparity map, and k is a constant value indicative of a position of an observation point between left and right eye;
and
generating, by the processor, the pair of stereoscopic images from the first RGB image, the pair of stereoscopic images comprising a left eye image and a right eye image, wherein the left eye image is generated by shifting a first set of pixels in the first RGB image based on the left disparity map, and the right eye image is generated by shifting a second set of pixels in the first RGB image based on the disparity map.

78 more elements

An apparatus for generating stereoscopic display contents, comprising:

a non-transitory memory;
and
a processor, wherein the non-transitory memory includes instructions executable by the processor to:
obtain, from a Red, Green, Blue plus Distance (RGB-D) image, a first Red, Green, and Blue (RGB) image and a depth image;
determine, based on depth values in the depth image, a first disparity map in accordance with the RGB-D image using at least one of a focal length f or an interpupillary distance b, wherein the first disparity map comprises a plurality of disparity values for the first RGB image to be transformed to a pair of stereoscopic images;
determine a left disparity map and a right disparity map by transforming the first disparity map using a disparity distribution ratio k, wherein the left disparity map is determined based on
d
L
(
x
,
y
)
=
k
*
d
⁡
(
x
,
y
)
=
k
*
(
f
*
b
z
⁡
(
x
,
y
)
)
,
and the right disparity map is determined based on
d
R
(
x
,
y
)
=
(
k
-
1
)
*
d
⁡
(
x
,
y
)
=
(
k
-
1
)
*
(
f
*
b
z
⁡
(
x
,
y
)
)
,
wherein z(x,y) is the depth value of a pixel (x,y) in the RGB-D image, d(x, y) is the disparity value in the first disparity map, dL(x, y) is the disparity value in the left disparity map, dR(x, y) is the disparity value in the right disparity map, and k is a constant value indicative of a position of an observation point between left and right eye;
and
generate the pair of stereoscopic images from the first RGB image, the pair of stereoscopic images comprising a left eye image and a right eye image, wherein the left eye image is generated by shifting a first set of pixels in the first RGB image based on the left disparity map, and the right eye image is generated by shifting a second set of pixels in the first RGB image based on the right disparity map.

81 more elements

A non-transitory computer-readable storage medium configured to store computer programs for generating stereoscopic display contents, the computer programs comprising instructions executable by a processor to:

obtain, from a Red, Green, Blue plus Distance (RGB-D) image, a first Red, Green, and Blue (RGB) image and a depth image;
determine, based on depth values in the depth image, a first disparity map in accordance with the RGB-D image using at least one of a focal length f or an interpupillary distance b, wherein the first disparity map comprises a plurality of disparity values for the first RGB image to be transformed to a pair of stereoscopic images;
determine a left disparity map and a right disparity map by transforming the first disparity map using a disparity distribution ratio k, wherein the left disparity map is determined based on
d
L
(
x
,
y
)
=
k
*
d
⁡
(
x
,
y
)
=
k
*
(
f
*
b
z
⁡
(
x
,
y
)
)
,
and the right disparity map is determined based on
d
R
(
x
,
y
)
=
(
k
-
1
)
*
d
⁡
(
x
,
y
)
=
(
k
-
1
)
*
(
f
*
b
z
⁡
(
x
,
y
)
)
,
wherein z(x, y) is the depth value of a pixel (x,y) in the RGB-D image, d(x, y) is the disparity value in the first disparity map, dL(x, y) is the disparity value in the left disparity map, dR(x, y) is the disparity value in the right disparity map, and k is a constant value indicative of a position of an observation point between left and right eye;
and
generate, by the processor, the pair of stereoscopic images comprising a left eye image and a right eye image, wherein the left eye image is generated by shifting a first set of pixels in the first RGB image based on the left disparity map, and the right eye image is generated by shifting a second set of pixels in the first RGB image based on the right disparity map.

78 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/973,086Filed 25 Oct 2022
Published: US 2024/0137481 A125 Apr 2024
Granted: 11 Feb 2025
Term ends: Not estimatedThe source records don’t support an estimate.

Classification4 codes

H04N 13/332
Image reproducers: displays for viewing with the aid of special glasses or head-mounted displays [HMD]
H04N 13/128
Processing image signals: adjusting depth or disparity
H04N 13/207
Using stereoscopic image cameras: using a single two-dimensional [2D] image sensor
H04N
Pictorial communication

Family

US 2024/0137481 A1Pre-grant publication · published 25 Apr 2024
US 2024/0236288 A9Pre-grant publication · published 11 Jul 2024
US 12,225,180 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key