Rendering virtual articles of clothing based on audio characteristics
AssigneeLemon Inc.
InventorsYunzhu Li, Haiying Cheng, Chen Sun
Life of this patent
Estimating the term…
Abstract
Systems and methods for generating a virtual article of clothing at a display are described. Some examples may include: obtaining video data and audio data, analyzing the video data to determine one or more body joints of a target object appearing in the video data. A mesh based on the determined one or more body joints may be generated. The audio data may be analyzed to determine audio characteristics associated with the audio data. Texture rendering information associated with a virtual article of clothing may be determined based on the audio characteristics. A rendered video may be generated by rendering the virtual article of clothing to the generated mesh using the texture rendering information.
Claims20
A method for generating a virtual article of clothing at a display, the method comprising:
- obtaining video data and audio data;
- analyzing the video data to determine one or more body joints of a target object appearing in the video data;
- generating a mesh based on the determined one or more body joints;
- analyzing the audio data to determine audio characteristics;
- determining the audio characteristics including at least one of a beat characteristic of the audio data or a frequency spectrum value of the audio data;
- determining texture rendering information associated with a virtual article of clothing based on the determined audio characteristics;
- and
- generating a rendered video by rendering the virtual article of clothing to the generated mesh using the texture rendering information.
A computing device for generating a virtual article of clothing at a display, the computing device comprising:
- a processor;
- and
- a memory having a plurality of instructions stored thereon that, when executed by the processor, causes the computing device to:
- obtain video data and audio data;
- analyze the video data to determine one or more body joints of a target object appearing in the video data;
- generate a mesh based on the determined one or more body joints;
- analyze the audio data to determine audio characteristics;
- determine the audio characteristics including at least one of a beat characteristic of the audio data or a frequency spectrum value of the audio data;
- determine texture rendering information associated with a virtual article of clothing based on the determined audio characteristics;
- and
- generate a rendered video by rendering the virtual article of clothing to the generated mesh using the texture rendering information.
A non-transitory computer-readable medium storing instructions for generating a virtual article of clothing at a display, the instructions when executed by one or more processors of a computing device, cause the computing device to:
- obtain video data and audio data;
- analyze the video data to determine one or more body joints of a target object appearing in the video data;
- generate a mesh based on the determined one or more body joints;
- analyze the audio data to determine audio characteristics;
- determine the audio characteristics including at least one of a beat characteristic of the audio data or a frequency spectrum value of the audio data;
- determine texture rendering information associated with a virtual article of clothing based on the determined audio characteristics;
- and
- generate a rendered video by rendering the virtual article of clothing to the generated mesh using the texture rendering information.
Dependencies are inferred from the claim text.