Apparatus and method for generating extrapolated view
AssigneeSamsung Electronics Co., Ltd.
InventorsYang Ho Cho, Ho Young Lee, Chang Yeong Kim, Du Sik Park
Life of this patent
Estimating the term…
Abstract
A view extrapolation apparatus and a view extrapolation method to generate images at a plurality of virtual points uses a relatively small number of input images. The view extrapolation apparatus and the view extrapolation method output a view at a reference point, the view at the reference point being formed of frames generated chronologically, integrate a plurality of successive frames of the view at the reference point to generate an integrated frame, and generate an extrapolated view at a virtual point using the integrated frame.
Claims31
An image apparatus comprising:
- an input view generation unit to output a view at a reference point, the view at the reference point comprising frames generated chronologically;
- an integrated frame generation unit to generate a time-domain integrated frame by integrating a plurality of frames of the output view at the reference point;
- and
- an extrapolated view generation unit to generate an extrapolated view at a virtual point using the time-domain integrated frame,
- wherein the integration frame generation unit determines pixels having a depth value greater than or equal to a predetermined value of the background or determines pixels having a depth value less than the predetermined value of the background.
A method of generating an extrapolated view comprising:
- generating, by a processor, an input view to output a view at a reference point, the view at the reference point comprising frames generated chronologically;
- generating, by the processor, a time-domain integrated frame by integrating a plurality of frames of the output view at the reference point;
- and
- generating, by the processor, an extrapolated view at a virtual point using the time-domain integrated frame, wherein the generating of the time-domain integrated frame comprises determining pixels having a depth value greater than or equal to a predetermined value of the background or determining pixels having a depth value less than the predetermined value of the background.
An image apparatus comprising:
- a controller comprising:
- an input view generation unit to output a view at a reference point, the view at the reference point comprising frames generated chronologically;
- an integrated frame generation unit to generate a time-domain integrated frame by integrating frames of the output view at the reference point based upon a characteristic of each of the successive frames;
- and
- an extrapolated view generation unit to generate an extrapolated view at a virtual point using the time-domain integrated frame,
- wherein the integrated frame generation unit generates the time-domain integrated frame by separating foreground regions and background regions of the plurality of frames using depth information about the plurality of frames and by integrating the background regions, and the integrated frame generation unit compensates for an object boundary hole region using the integrated background regions.
A method of generating an extrapolated view comprising:
- generating, by a processor, an input view to output a view at a reference point, the view at the reference point comprising frames generated chronologically that are captured by an input device located at the reference point;
- generating, by the processor, a time-domain integrated frame by integrating a plurality of successive frames of the output view at the reference point based upon a characteristic of each of the successive frames;
- and
- generating, by the processor, an extrapolated view at a virtual point using the time-domain integrated frame, wherein the generating of the time-domain integrated frame comprises:
- separating foreground regions and background regions of the plurality of frames using depth information about the plurality of frames and integrating the background regions to generate the integrated background regions resized in a horizontal direction;
- and compensating for an object boundary hole region using the integrated background regions.
Dependencies are inferred from the claim text.