Context-Based Animated Image Generation from a Video
AssigneeGoogle Inc.
InventorsVishu Goyal, Rosemond Gerold Dorleans
Life of this patent
Estimating the term…
Abstract
Systems and methods for animated image generation can obtain user-generated content, perform a video segment search based on the user-generated content, process the video segment to generate an animated image, and provide the animated image as an output. The systems and methods can perform sentiment analysis, audio transcription, key frame extraction, and sequence-based rendering to perform the animated image generation.
Claims20
A computing system for generating animated images, the system comprising:
- one or more processors;
- and
- one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the computing system to perform operations, the operations comprising:
- obtaining, via a link notes interface, user-generated content data, wherein the user-generated content data comprises a text string input by a user, wherein the link notes interface comprises a user interface that is configured to receive inputs to generate user generated link notes to index with web resources;
- obtaining, via the link note interface, video data, wherein the video data comprises a plurality of image frames and audio data;
- processing the user-generated content data and the video data to determine a subset of frames of the plurality of image frames are associated with the user-generated content data;
- processing the subset of frames of the plurality of image frames to generate an animated image, wherein the animated image comprises an animated playback of the subset of frames ordered sequentially;
- and
- providing the animated image for display via the link notes interface.
A computer-implemented method for generating animated images, the method comprising:
- obtaining, by a computing system comprising one or more processors and via a link notes interface, user-generated content data, wherein the user-generated content data comprises a text string input by a user, wherein the link notes interface comprises a user interface that is configured to receive inputs to generate user generated link notes to index with web resources;
- obtaining, by the computing system and from a video database, a video based on the text string input, wherein the video comprises a plurality of image frames and audio data, wherein the video database comprises a plurality of different videos;
- processing, by the computing system, the user-generated content data and the video to determine a subset of frames of the plurality of image frames are associated with the user-generated content data;
- processing, by the computing system, the subset of frames of the plurality of image frames to generate an animated image, wherein the animated image comprises an animated playback of the subset of frames ordered sequentially;
- and
- providing, by the computing system, the animated image for display via the link notes interface.
One or more non-transitory computer-readable media that collectively store instructions that, when executed by one or more computing devices, cause the one or more computing devices to perform operations, the operations comprising:
- obtaining, via a link notes interface, user-generated content data, wherein the user-generated content data comprises a text string input by a user, wherein the link notes interface comprises a user interface that is configured to receive inputs to generate user generated link notes to index with web resources;
- determining a video comprises content associated with at least a subset of text string input, wherein the video data comprises a plurality of image frames and audio data;
- processing the user-generated content data and the video to determine a subset of frames of the plurality of image frames are associated with the user-generated content data;
- segmenting the subset of frames of the plurality of image frames from the video based on determining the subset of frames of the plurality of image frames are associated with the user-generated content data;
- processing the subset of frames of the plurality of image frames to generate an animated image, wherein the animated image comprises an animated playback of the subset of frames ordered sequentially;
- and
- providing the animated image for display via the link notes interface.
Dependencies are inferred from the claim text.