Back to results
US 12,762,794 B2Granted
Energy and compute optimization of real time image converter using 2D to 3D rendering
AssigneeDell Products L.P.
InventorsQing Ye, Zhisong Liu, Rowland Shaw
Life of this patent
Estimating the term…
Abstract
An image conversion device includes an image capture device and a renderer. The image capture device captures a plurality of two-dimensional (2D) images. The renderer receives the 2D images and renders a 3D model of an object captured in the 2D images. In rendering the 3D model, the renderer first renders a binary edge map of the object, and next models textures for the 3D model.
Claims16
An image conversion device, comprising:
- a hardware image capture device configured to capture a plurality of two-dimensional (2D) images;
- and
- a hardware renderer configured to receive the 2D images and to render a three-dimensional (3D) model of an object captured in the 2D images, wherein in rendering the 3D model, the hardware renderer first renders a binary edge map of the object, and next models textures for the 3D model;
- wherein in rendering the binary edge map, the hardware renderer minimizes a cross entropy (L) from the 2D images as:
- L
- =
- ∑
- r
- ∈
- R
-
- C
-
- (
- r
- )
- ·
- log
- [
- α
-
- (
- C
- ~
- (
- r
- )
- )
- ]
- +
- (
- 1
- -
- C
-
- (
- r
- )
- )
- ·
- log
- [
- 1
- -
- α
- [
- C
- ~
- (
- r
- )
- ]
- ]
-
- 2
- ,
- where R is a set of rays in each batch of 2D images, α[{tilde over (C)}(r)] and C(r) are predicted and ground truth RGB (red, green, blue) colors for ray r, and α is a sigmoid function to map a binary value (i.e., to zero (0) or one (1) [0,1]).
54 more elements
A method, comprising:
- providing, in an image conversion device, an image capture device;
- capturing, by the image capture device, a plurality of two-dimensional (2D) images;
- providing, in the image conversion device, a renderer;
- receiving, by the renderer, the 2D images;
- and
- rendering, by the renderer, a three-dimensional (3D) model of an object captured in the 2D images;
- wherein in rendering the 3D model, the renderer first renders a binary edge map of the object, and next models textures for the 3D model and in rendering the binary edge map, the renderer minimizes a binary cross entropy (L) from the 2D images as:
- L
- =
- ∑
- r
- ∈
- R
-
- C
-
- (
- r
- )
- ·
- log
- [
- α
-
- (
- C
- ~
- (
- r
- )
- )
- ]
- +
- (
- 1
- -
- C
-
- (
- r
- )
- )
- ·
- log
- [
- 1
- -
- α
- [
- C
- ~
- (
- r
- )
- ]
-
- 2
- ,
- where R is a set of rays in each batch of images, α[{tilde over (C)}(r)] and C(r) are predicted and ground truth RGB (red, green, blue) colors for ray r, and α is a sigmoid function to map a binary value (i.e., to zero (0) or one (1) [0,1]).
56 more elements
An image conversion device, comprising:
- a hardware image capture device configured to capture a plurality of two-dimensional (2D) images;
- a hardware renderer configured to receive the 2D images and to render a three-dimensional (3D) model of an object captured in the 2D images, wherein in rendering the 3D model, the hardware renderer first renders a binary edge map of the object, and next models textures for the 3D model;
- and
- a hardware data storage device including a repository to store the 3D model;
- wherein in rendering the binary edge map, the hardware renderer minimizes a cross entropy (L) from the 2D images, and in modeling the textures for the 3D model, the hardware renderer further recalculates the binary cross entropy (L) as:
- L
- =
- ∑
- r
- ∈
- R
-
- C
-
- (
- r
- )
- ·
- log
- [
- α
-
- (
- C
- ~
- (
- r
- )
- )
- ]
- +
- (
- 1
- -
- C
-
- (
- r
- )
- )
- ·
- log
- [
- 1
- -
- α
- [
- C
- ~
- (
- r
- )
- ]
-
- 2
- ,
- where R is a set of rays in each batch of 2D images, α[{tilde over (C)}(r)] and C(r) are predicted and ground truth RGB (red, green, blue) colors for ray r, and α is a sigmoid function to map a binary value (i.e., to zero (0) or one (1) [0,1]).
54 more elements
Dependencies are inferred from the claim text.