Automatic avatar creation
AssigneeApple Inc.
InventorsAlex Nelson, Cedric Bray, Thomas Goossens, Rudolph Van Der Merwe, Richard E. Crandall, Bertrand Serlet
Life of this patent
Estimating the term…
Abstract
A three-dimensional (“3D”) avatar can be automatically created that resembles the physical appearance of an individual captured in one or more input images or video frames. The avatar can be further customized by the individual in an editing environment and used in various applications, including but not limited to gaming, social networking and video conferencing.
Claims53
A computer implemented method, comprising:
- receiving one or more digital images of an individual;
- determining, in a computer, digital representations of facial elements of the individual from the one or more digital images;
- searching a population of avatars using a genetic process, where the genetic process includes using the computer to evaluate the overall fitness of the avatars using a fitness function that compares the digital representations of the individual's facial elements to digital representations of corresponding avatar facial elements;
- and
- selecting or receiving a selection of one or more avatars from the population of avatars based on fitness values associated with the avatars;
- wherein evaluating the overall fitness of the avatars using a fitness function includes calculating fitness values for individual facial elements of the avatars based on linear and geometric weights corresponding to each of the individual facial elements.
A system, comprising:
- a processor;
- and
- a computer-readable storage medium coupled to the processor and including instructions, which, when executed by the processor, causes the processor to perform operations comprising:
- receiving one or more digital images of an individual;
- determining, in a computer, digital representations of facial elements of the individual from the one or more digital images;
- searching a population of avatars using a genetic process, where the genetic process includes using the computer to evaluate the overall fitness of the avatars using a fitness function that compares the digital representations of the individual's facial elements to digital representations of corresponding avatar facial elements;
- and
- selecting or receiving a selection of one or more avatars from the population of avatars based on fitness values associated with the avatars;
- wherein evaluating the overall fitness of the avatars using a fitness function includes calculating fitness values for individual facial elements of the avatars based on linear and geometric weights corresponding to each of the individual facial elements.
A non-transitory computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, causes the one or more processors to perform operations comprising:
- receiving one or more digital images of an individual;
- determining, in a computer, digital representations of facial elements of the individual from the one or more digital images;
- searching a population of avatars using a genetic process, where the genetic process includes using the computer to evaluate the overall fitness of the avatars using a fitness function that compares the digital representations of the individual's facial elements to digital representations of corresponding avatar facial elements;
- and
- selecting or receiving a selection of one or more avatars from the population of avatars based on fitness values associated with the avatars;
- wherein evaluating the overall fitness of the avatars using a fitness function includes calculating fitness values for individual facial elements of the avatars based on linear and geometric weights corresponding to each of the individual facial elements.
A method, comprising:
- at an electronic device with a display, a camera, and one or more input devices:
- displaying, on the display, a first user interface that provides information about generation, by the electronic device, of an avatar of a user of the electronic device;
- while displaying the first user interface, receiving, via the one or more input devices, a request to initiate the generation of the avatar based on a digital representation of the user of the electronic device that is being captured by the camera of the electronic device;
- in response to receiving the request to initiate the generation of the avatar, while capturing the digital representation of the user, displaying, on the display, a second user interface that includes:
- the digital representation of the user as it is being captured by the camera of the electronic device, and
- a visual indication of a current status of evaluating the digital representation of the user of the electronic device that is being captured by the camera of the electronic device, wherein:
- the visual indication is overlaid on the digital representation of the user as the digital representation of the user is being evaluated, and
- the visual indication moves from being overlaid on a first portion of the digital representation of the user corresponding to a first facial element to being overlaid on a second portion, different from the first portion, of the digital representation of the user corresponding to a second facial element, different from the first facial element, as the digital representation of the user is being evaluated;
- after displaying the second user interface, displaying, on the display, a first proposed avatar based on the digital representation of the user;
- and
- while displaying the first proposed avatar, providing the user with options for customizing the first proposed avatar.
A non-transitory computer-readable medium storing instructions, which when executed by one or more processors of an electronic device with a display, a camera, and one or more input devices, cause the one or more processors to perform a method comprising:
- displaying, on the display, a first user interface that provides information about generation, by the electronic device, of an avatar of a user of the electronic device;
- while displaying the first user interface, receiving, via the one or more input devices, a request to initiate the generation of the avatar based on a digital representation of the user of the electronic device that is being captured by the camera of the electronic device;
- in response to receiving the request to initiate the generation of the avatar, while capturing the digital representation of the user, displaying, on the display, a second user interface that includes:
- the digital representation of the user as it is being captured by the camera of the electronic device, and
- a visual indication of a current status of evaluating the digital representation of the user of the electronic device that is being captured by the camera of the electronic device, wherein:
- the visual indication is overlaid on the digital representation of the user as the digital representation of the user is being evaluated, and
- the visual indication moves from being overlaid on a first portion of the digital representation of the user corresponding to a first facial element to being overlaid on a second portion, different from the first portion, of the digital representation of the user corresponding to a second facial element, different from the first facial element, as the digital representation of the user is being evaluated;
- after displaying the second user interface, displaying, on the display, a first proposed avatar based on the digital representation of the user;
- and
- while displaying the first proposed avatar, providing the user with options for customizing the first proposed avatar.
An electronic device comprising:
- one or more processors;
- a display;
- a camera;
- one or more input devices;
- and
- memory storing instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising:
- displaying, on the display, a first user interface that provides information about generation, by the electronic device, of an avatar of a user of the electronic device;
- while displaying the first user interface, receiving, via the one or more input devices, a request to initiate the generation of the avatar based on a digital representation of the user of the electronic device that is being captured by the camera of the electronic device;
- in response to receiving the request to initiate the generation of the avatar, while capturing the digital representation of the user, displaying, on the display, a second user interface that includes:
- the digital representation of the user as it is being captured by the camera of the electronic device, and
- a visual indication of a current status of evaluating the digital representation of the user of the electronic device that is being captured by the camera of the electronic device, wherein:
- the visual indication is overlaid on the digital representation of the user as the digital representation of the user is being evaluated, and
- the visual indication moves from being overlaid on a first portion of the digital representation of the user corresponding to a first facial element to being overlaid on a second portion, different from the first portion, of the digital representation of the user corresponding to a second facial element, different from the first facial element, as the digital representation of the user is being evaluated;
- after displaying the second user interface, displaying, on the display, a first proposed avatar based on the digital representation of the user;
- and
- while displaying the first proposed avatar, providing the user with options for customizing the first proposed avatar.
Dependencies are inferred from the claim text.