Loading patent…
AssigneeTeknologian tutkimuskeskus VTT Oy
InventorsTatu Harviainen, Charles Woodward
Estimating the term…
Apparatus, method, and computer program code for producing composite image. A method comprises: obtaining (150) a first image (130) with first depth information; obtaining (152) a second image (132) with second depth information; detecting (154) regions of interest in the first image (130); segmenting (156) the regions of interest into individual layers; performing (158) image compensation for the individual layers according to the first depth information so that in image compensated individual layers a perspective and/or a viewpoint of the first image (130) is modified to be more similar with the second image (132); and rendering (160) the image compensated individual layers with the second image (132) utilizing the first depth information and the second depth information in order to produce a composite image (134).
An apparatus comprising:
A method comprising:
A non-transitory computer-readable storage medium comprising computer program code which, when loaded into an apparatus causes the apparatus at least to:
Dependencies are inferred from the claim text.
From the US filing history. Foreign family members aren’t listed.
Scaling of whole images or parts thereof, e.g. expanding or contracting: image mosaicing, e.g. composing plane images from plane sub-images
Geometric image transformations in the plane of the image: affine transformations
Geometric image transformations in the plane of the image: image warping, e.g. rearranging pixels individually
Scaling of whole images or parts thereof, e.g. expanding or contracting: based on interpolation, e.g. bilinear interpolation
About 10 years 9 months of term left · ends 10 Aug 2037 (estimated)
Drawings are temporarily unavailable. Open the PDF at USPTO
This application is the U.S. national phase of International Application No. PCT/FI2017/050567 filed Aug. 10, 2017 which designated the U.S. and claims priority to FI Patent Application No. 20165612 filed Aug. 11, 2016, the entire contents of each of which are hereby incorporated by reference.
The invention relates to an apparatus, method, and computer program code for producing a composite image.
In several use cases it is desirable to be able to capture a person with a camera, and visualize him/her as a part of completely different scene. One example of such use case is a meteorologist captured in front of green screen and digital weather map, both of which are composited together in real-time for TV broadcasting. Current solutions for composting different image sources together in real-time only work well when perspective and viewpoint of the different image sources are nearly identical. This significantly restricts the types of visual material which can be mixed together, thus limiting the use cases and experiences which can be provided.
Example embodiments of the present invention are described below, by way of example only, with reference to the accompanying drawings, in which
FIG. 1 illustrates example embodiments of an apparatus;
FIG. 2 illustrates further example embodiments;
The following embodiments are only examples. Although the specification may refer to “an” embodiment in several locations, this does not necessarily mean that each such reference is to the same embodiment(s), or that the feature only applies to a single embodiment. Single features of different embodiments may also be combined to provide other embodiments. Furthermore, words “comprising” and “including” should be understood as not limiting the described embodiments to consist of only those features that have been mentioned and such embodiments may contain also features/structures that have not been specifically mentioned.
FIG. 1 illustrates example embodiments of an apparatus 100, and FIG. 2 example embodiments of the full processing pipeline.
It should be noted that while FIG. 1 illustrates various embodiments of the apparatus 100, it is a simplified block diagram that only shows some structures and functional entities. The connections shown in FIG. 1 are logical connections; the actual physical connections may be different. It is apparent to a person skilled in the art that the described apparatus 100 may also comprise other functions and structures. It should be appreciated that details of some functions, structures, and the protocols used for communication are irrelevant to the actual invention. Therefore, they need not be discussed in more detail here.