Virtual character generation from image or video data

A computer-implemented method comprising:

• under the control of a computer system comprising computer hardware, the computer system configured with computer executable instructions:
• obtaining input media depicting a real person as captured by a camera;
• obtaining base three-dimensional (3D) model data associated with a generic human figure;
• providing at least a portion of the input media to a machine learning model configured to extract visual information regarding one or more humans depicted in image or video data;
• modifying the base 3D model data based on visual information extracted by the machine learning model to generate custom 3D model data corresponding to the real person;
• extracting, from the input media, visual information regarding a first item worn by the real person as depicted in the input media, wherein the first item comprises a clothing item or an accessory;
• generating or selecting a virtual item corresponding to the first item worn by the real person;
• and
• storing, in a data store that stores virtual character data for virtual characters that populate a virtual world in at least one video game, data defining a custom virtual character, wherein the data defining the custom virtual character comprises at least the custom 3D, wherein the data store further includes an association between the virtual item and the custom virtual character.

A non-transitory computer-readable storage medium having stored thereon computer-readable instructions that, when executed, configure a computing system to:

• obtain input media depicting a real person as captured by a camera;
• obtain base three-dimensional (3D) model data associated with a generic human figure;
• provide at least a portion of the input media to a machine learning model configured to extract visual information regarding one or more humans depicted in image or video data;
• modify the base 3D model data based on visual information extracted by the machine learning model to generate custom 3D model data corresponding to the real person;
• extract, from the input media, visual information regarding a first item worn by the real person as depicted in the input media, wherein the first item comprises a clothing item or an accessory;
• generate or select a virtual item corresponding to the first item worn by the real person;
• and
• store, in a data store that stores virtual character data for virtual characters that populate a virtual world in at least one video game, data defining a custom virtual character, wherein the data defining the custom virtual character comprises at least the custom 3D model, wherein the data store further includes an association between the virtual item and the custom virtual character.