US 9,542,722 B2 · Automatic scaling of objects based on depth map for image editing

Abstract

Automatic scaling of image objects being moved or copied to a target object location is presented. An original image and its depth map are received within which the user selects an original object and a target location for the object to be moved or copied. A center of scaling is found and a base location selected at which depth value is to be obtained at the target location for use in scaling. Target object is then scaled in response to a ratio between original object depth and target object depth. An occlusion check is made, after which non-occluded pixels are pasted to the target location to complete the move/copy which is in proper proportion and accounts for surrounding structures.

Claims20

Dependent claims

An apparatus for automatically scaling image objects being moved or copied from an original object to a target object, comprising:

(a) a computer processor configured for receiving and processing images;
and
(b) programming executable on the computer processor for performing steps comprising:
(i) receiving an original object selection in an image and a target location for the original object to be moved/copied as a target object at said target location;
(ii) obtaining or receiving a depth map for the image containing the original object and the target object location;
and
(iii) determining interdependent scaling factor and positioning for the target object, in response to:
(iii)(A) determining a center of scaling for the target object;
(iii)(B) selecting a base location on the original object at which depth value is to be obtained at the target location for use in scaling;
and
(iii)(C) scaling target object at target location about the center of scaling in response to a ratio between original object depth and target object depth and pasting pixels of said target object into said target location;
(iv) whereby the target object is shown in a proper size in relation to its surroundings.

9 more elements

An apparatus for automatically scaling image objects being moved or copied from an original object to a target object, comprising:

(a) a computer processor configured for receiving and processing images;
and
(b) programming executable on the computer processor for performing steps comprising:
(i) receiving an original object selection in an image and a target location for the original object to be moved/copied as a target object at said target location;
(ii) obtaining or receiving a depth map for the image containing the original object and the target object location;
and
(iii) determining interdependent scaling factor and positioning for location of the target object, in response to:
(iii)(A) determining a center of scaling for the target object;
(iii)(B) selecting a base location on the original object at which depth value is to be obtained at the target location for use in scaling;
and
(iii)(C) scaling target object at target location about center of scaling in response to a ratio between original object depth and target object depth and pasting pixels of said target object into said target location;
(iv) wherein determination of interdependent scaling factor and positioning for the target object includes determining two different depth values for any point P, as depth obtained from the depth map as D1(x), and as a computed depth assuming that object is scaled by a factor s(P)=x/b, wherein depth is Dc(x)=DB/s(P)=DB b/x, and determining value x as scaling factor, wherein value b is distance between object origin and its bottom;
and
(v) whereby the target object is shown in a proper size in relation to its surroundings.

11 more elements

Dependencies are inferred from the claim text.

Automatic scaling of objects based on depth map for image editing

Life of this patent

Automatic scaling of objects based on depth map for image editing

Life of this patent

Abstract

Claims20