Progressive body capture of user body for building an avatar of user
AssigneeApple Inc.
InventorsVictor Ng-Thow Hing, Timothy B. Henning
Life of this patent
Estimating the term…
Abstract
Various implementations disclosed herein include devices, systems, and methods that progressively capture data representing an actual appearance of a user for creating a 3D avatar of the user. Image sensors at a user's electronic device may capture images (or other sensor data) of different portions of a user's body over time. Images and other sensor data that is captured initially or at a given time may not represent all of the user's body. Thus, in some implementations, the progressively captured data provides representations of additional portions of the user's 3D avatar over time.
Claims20
A method comprising:
- at a processor of a device:
- obtaining two-dimensional (2D) image data during multiple segments of time, wherein obtaining the 2D image data comprises obtaining first 2D image data during a first segment of time and depicting a first appearance of a first portion of a user and obtaining second 2D image data during a second segment of time differing from the first segment of time and depicting a second appearance of a second portion of the user different than the first part portion of the user, the first appearance differing from the second appearance and the second appearance corresponding to a physical element added to the second portion of the user;
- updating three-dimensional (3D) appearance data corresponding to a representation of the user for each of the multiple segments of time, wherein the 3D appearance data is updated to define an appearance of the first and second portions of the user for the representation of the user based on the 2D image data obtained during each of the multiple segments of time;
- and
- providing the updated 3D appearance data for rendering an updated view of the representation of the user for each of the multiple segments of time, the updated view of the representation of the user providing a first representation of the first portion of the user with the first appearance and a second representation of the second portion of the user with the second appearance with respect to the multiple segments of time.
A system comprising:
- memory;
- and
- one or more processors at a device coupled to the memory, wherein the memory comprises program instructions that, when executed on the one or more processors, cause the system to perform operations comprising:
- obtaining two-dimensional (2D) image data during multiple segments of time, wherein obtaining the 2D image data comprises obtaining first 2D image data during a first segment of time and depicting a first appearance of a portion of a user and obtaining second 2D image data during a second segment of time that differs from the first segment of time and depicting a second appearance of the portion of the user that differs from the first appearance, the second appearance corresponding to a change resulting from a physical element added to the portion of the user;
- updating three-dimensional (3D) appearance data corresponding to a representation of the user for each of the multiple segments of time, wherein the 3D appearance data is updated to define an appearance of the portion of the user for the representation of the user based on the 2D image data obtained during each of the multiple segments of time;
- and
- providing the updated 3D appearance data for rendering an updated view of the representation of the user for each of the multiple segments of time, the updated view of the representation of the user providing a first representation of the portion of the user with the first appearance and a second representation of the portion of the user with the second appearance with respect to the multiple segments of time.
A non-transitory computer-readable storage medium, storing program instructions executable via one or more processors to perform operations comprising:
- obtaining two-dimensional (2D) image data during multiple segments of time, wherein obtaining the 2D image data comprises obtaining first 2D image data during a first segment of time and depicting a first appearance of a portion of a user and obtaining second 2D image data during a second segment of time that differs from the first segment of time and depicting a second appearance of the portion of the user that differs from the first appearance, the second appearance corresponding to a change resulting from a physical element added to the portion of the user;
- updating three-dimensional (3D) appearance data corresponding to a representation of the user for each of the multiple segments of time, wherein the 3D appearance data is updated to define an appearance of the portion of the user for the representation of the user based on the 2D image data obtained during each of the multiple segments of time;
- and
- providing the updated 3D appearance data for rendering an updated view of the representation of the user for each of the multiple segments of time, the updated view of the representation of the user providing a first representation of the portion of the user with the first appearance and a second representation of the portion of the user with the second appearance with respect to the multiple segments of time.
Dependencies are inferred from the claim text.