US 8,411,080 B1Granted

Apparatus and method for editing three dimensional objects

AssigneeDisney Enterprises, Inc.

InventorJohannes Zimmermann

Life of this patent

Estimating the term…

Loading patent…

Abstract

A computer graphic editing or modeling system that automatically alters a computer graphic object based on a user sketch. The computer graphic object may be presented as an image space view of the object (proxy). The sketch is placed in proximity to some feature of the image space view. The system matches the sketch with the feature taking into account silhouettes, which may be derived by way of depth continuity and depth gradient similarity, of the object and matching the silhouette with the feature based on proximity and shape. The matched handle silhouette is transformed to associated handle vertices of a mesh of the graphic object. The system may then deform the mesh based on the user sketch by obtaining a dimensional relationship between the user sketch and the associated silhouette and applying the dimensional relationship to a region of interest, which includes the handle vertices.

Claims20

Dependent claims

A method of preparing a three dimensional computer graphic object for deformation comprising:

receiving a user generated sketch proximate a feature of a two dimensional view of a three dimensional computer graphic object, wherein the three dimensional computer graphic object includes one or more mesh geometry data files and the two dimensional view includes an associated image map including an array of pixel values for the two dimensional view and a depth map of depth values for the array of pixel values, wherein the depth values are used to determine discontinuities in the object and the mesh geometry data files include a plurality of mesh features;
generating a silhouette map for the two dimensional view of the three dimensional graphic, the silhouette map including substantially all pixel values on silhouette lines of the two dimensional view;
generating a plurality of silhouette segments, with each silhouette segment comprising a subset of all silhouette pixel values in the silhouette map, wherein generation of each silhouette segment considers at least one of the following criterion for inclusion of a pixel in the segment relative to other pixels in the segment:
curvature in image space, depth continuity and a direction of a depth map gradient;
and
matching the user generated sketch with the feature of the two dimensional view, wherein matching the user generate sketch with the feature of the two dimensional view comprises:
transforming the matched feature of the two dimensional view to a representation of the feature associated with the three dimensional computer graphic object;
matching the user generated sketch to all or a portion of one of the plurality of silhouette segments;
and
reducing a number of pixel positions associated with a polyline representation of the portion the one of the plurality of silhouette segments, the polyline representation including a plurality of handle pixel positions after reduction;
associating the handle pixel positions with corresponding handle mesh features from the plurality of mesh features, the set of mesh features being associated with the one or more of the plurality of features, and
generating object space bounding volumes for the handle pixel positions, the object space bounding volumes encompassing handle vertices for each mesh feature encompassed in the bounding volumes.

9 more elements

A method of deformation for a computer graphic object comprising:

providing a proxy image of the computer graphic object, the proxy image including a plurality of image features;
receiving a user generated sketch proximate at least one of the image features;
identifying at least one of the image features of the plurality image values of the proxy image by matching the user generated sketch with the at least one image feature, the operation of identifying at least one of the image features of the plurality image values of the proxy image comprising obtaining at least one silhouette map of the proxy image, wherein the silhouette map comprises a plurality of silhouette pixels and an associated depth map of depth values for each of the plurality of silhouette pixels, wherein the depth values are used to determine discontinuities in the object;
transforming the feature image values of the proxy image to corresponding object feature values of the computer graphic object, wherein the operation of identifying at least one of the image features of the plurality image values of the proxy image by matching the user generated sketch with the at least one image feature further comprises beginning with one of the plurality of silhouette pixels, tracing a portion of the silhouette map to identify silhouette pixels based on curvature, depth continuity and depth gradient, all such silhouette pixels forming a silhouette segment, wherein the silhouette segment comprises adjacent pixels having at least one of a common curvature in image space, a depth continuity or a direction of a depth map gradient correlating to a current tracing direction;
matching at least a portion of the silhouette segment to the user generated sketch based on proximity between the user generated sketch and the at least a portion of the silhouette segment and similarity of shape between the user generated sketch and the at least a portion of the silhouette segment, wherein the operation of transforming the feature image values of the proxy image to corresponding object feature values of the computer graphic object comprises transforming the least a portion of the silhouette segment to at least one handle vertex position of a mesh, the vertex positions corresponding to the feature image values of the proxy image;
obtaining altered vertex position locations corresponding to the handle vertex positions, the altered vertex position locations based on a displacement between a plurality of pixel locations corresponding with the user generated sketch and the plurality of pixel positions between the portion of the silhouette segment;
and
generating a region of interest of the computer graphic object, the region of interest comprising at least all vertex positions of the mesh to positionally modify based on the user generated sketch.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application: 12/147,445Filed 26 Jun 2008
Granted: 2 Apr 2013
Term ends: Not estimatedThe source records don’t support an estimate.

Classification6 codes

G06T 19/20
Manipulating three-dimensional [3D] models or images for computer graphics: editing of three-dimensional [3D] images, e.g. changing shapes or…
G06T 17/20
Three-dimensional [3D] modelling for computer graphics: finite element generation, e.g. wire-frame surface description, tesselation
G06T 2200/24
Indexing scheme for image data processing or generation, in general: involving graphical user interfaces [GUIs]
G06T 2210/12
Indexing scheme for image generation or computer graphics: bounding box