Back to results
US 9,961,330 B2Granted
Device and method of generating multi-view immersive content
AssigneeElectronics and Telecommunications Research Institute
InventorsJeung Chul Park, Hyung Jae Son, Beom Ryeol Lee, Il Kwon Jeong
Life of this patent
Estimating the term…
Abstract
Provided is a method of generating multi-view immersive content. The method includes obtaining a multi-view background image from a plurality of cameras arranged in a curved shape, modeling the obtained multi-view background image to generate a codebook corresponding to the multi-view background image, obtaining a multi-view image including an object from the plurality of cameras and separating a foreground and a background from the obtained multi-view image by using the generated codebook, and synthesizing the object included in the separated foreground with a virtual background to generate multi-view immersive content.
Claims14
A method of generating multi-view immersive content, the method comprising:
- obtaining a multi-view background image from a plurality of cameras arranged in a curved shape;
- modeling the obtained multi-view background image to generate a codebook corresponding to the multi-view background image;
- obtaining a multi-view image including an object from the plurality of cameras and separating a foreground and a background from the obtained multi-view image by using the generated codebook;
- and
- synthesizing the object included in the separated foreground with a virtual background to generate multi-view immersive content,
- wherein the separating of the foreground and the background comprises:
- converting an RGB color value of the multi-view image into an HSV color value expressed in an HSV color space;
- calculating a hue difference between a first HSV color value of the multi-view background image and a second HSV color value of the multi-view image which are stored in the codebook;
- and
- comparing the calculated hue difference with a threshold value to separate the foreground and the background from the multi-view image, and
- wherein the calculating of the hue difference comprises calculating an area of a triangle formed between a first hue value of the first HSV color value and a second hue value of the second HSV color value on an RGB-HSV spectrum graph that includes an abscissa axis indicating a hue and an ordinate axis indicating intensity.
8 more elements
A method of generating multi-view immersive content, the method comprising:
- obtaining a multi-view background image from a plurality of cameras arranged in a curved shape;
- modeling the obtained multi-view background image to generate a codebook corresponding to the multi-view background image;
- obtaining a multi-view image including an object from the plurality of cameras and separating a foreground and a background from the obtained multi-view image by using, the generated codebook;
- and
- synthesizing the object included in the separated foreground with a virtual background to generate multi-view immersive content,
- wherein the separating of the foreground and the background comprises:
- converting an RGB color value of each of pixels of the multi-view image into an HSI color value in a cone-shaped HSI color space with intensity as a center axis;
- calculating a corrected saturation value by dividing a saturation value of an arbitrary pixel in the HSI color space by a maximum saturation value expressible in the HSI color space;
- and
- comparing the corrected saturation value with the saturation value of the arbitrary pixel stored in the codebook to separate the foreground and the background from the multi-view image.
7 more elements
A multi-view immersive content generating device comprising:
- a background model generator configured to model a multi-view background image obtained from a plurality of cameras arranged in a curved shape to generate a codebook corresponding to the multi-view background image;
- a foreground/background separator configured to separate a foreground and a background from a multi-view image obtained from the plurality of cameras by using the codebook;
- and
- a synthesizer configured to synthesize the separated foreground with a virtual background to generate multi-view immersive content,
- wherein the foreground/background separator comprises:
- a color spacer converter configured to convert an RGB color value of the multi-view image into an HSV color value expressed in an HSV color space;
- a hue difference calculator configured to calculate a hue difference between a first HSV color value of the multi-view background image and a second HSV color value of the multi-view image which are stored in the codebook;
- and
- a comparison unit configured to compare the calculated hue difference with a threshold value to separate the foreground and the background from the multi-view image, and
- wherein the hue difference calculator calculates, as the hue difference, an area of a triangle formed between a first hue value of the first HSV color value and a second hue value of the second HSV color value on an RGB-HSV spectrum graph that includes an abscissa axis indicating a hue value and an ordinate axis indicating an intensity value.
7 more elements
Dependencies are inferred from the claim text.