Articulated part extraction from sprite sheets using machine learning
AssigneesAdobe Inc., University of Massachusetts
InventorsMatthew David FISHER, Zhan XU, Yang ZHOU, Deepali ANEJA, Evangelos KALOGERAKIS
Life of this patent
Estimating the term…
Loading patent…
AssigneesAdobe Inc., University of Massachusetts
InventorsMatthew David FISHER, Zhan XU, Yang ZHOU, Deepali ANEJA, Evangelos KALOGERAKIS
Estimating the term…
Embodiments are disclosed for articulated part extraction using images of animated characters from sprite sheets by a digital design system. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving an input including a plurality of images depicting an animated character in different poses. The disclosed systems and methods further comprise, for each pair of images in the plurality of images, determining, by a first machine learning model, pixel correspondences between pixels of the pair of images, and determining, by a second machine learning model, pixel clusters representing the animated character, each pixel cluster corresponding to a different structural segment of the animated character. The disclosed systems and methods further comprise selecting a subset of clusters that reconstructs the different poses of the animated character. The disclosed systems and methods further comprise creating a rigged animated character based on the selected subset of clusters.
A method comprising:
A non-transitory computer-readable storage medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:
A system comprising:
Dependencies are inferred from the claim text.