Systems and methods for generating video based on informational audio data
AssigneeMusixmatch S.P.A.
InventorsMarco Paglia, Alessandro Camedda, Davide Soranzio
Life of this patent
Estimating the term…
Abstract
In one embodiment, a computer-implemented method may include receiving a media file, extracting, using an artificial intelligence engine including one or more trained machine learning models, one or more audio features from the media file. The one or more audio features include at least one of a time-synchronized transcript, speaker recognition data, mood data, index data, visual asset speaker data, color palette data, and written description speaker data. The method may include generating, based on the one or more audio features, a video, wherein the video is presented via a media player on a user interface of a computing device.
Claims17
A computer-implemented method comprising:
- receiving an audio file;
- extracting, using an artificial intelligence engine comprising one or more trained machine learning models, one or more audio features from the audio file, wherein the one or more audio features comprise at least one of a time-synchronized transcript, speaker recognition data, mood data, visual asset speaker data, color palette data, and written description speaker data, wherein the visual asset speaker data comprises information pertaining to one or more visual representations of one or more speakers associated with the speaker recognition data, and the color palette data comprises information pertaining to the images;
- assigning, using the visual asset speaker data, one or more visual representations to one or more speakers identified in the speaker recognition data;
- and
- generating, based on the one or more audio features, a video, wherein the video is presented via a media player on a user interface of a computing device, and the video presents the one or more visual representations of the one or more speakers when the one or more speakers speak during the video.
A tangible, non-transitory computer-readable media storing instructions that, when executed, cause one or more processing devices to:
- receive an audio file;
- extract, using an artificial intelligence engine comprising one or more trained machine learning models, one or more audio features from the audio file, wherein the one or more audio features comprise at least one of a time-synchronized transcript, speaker recognition data, mood data, visual asset speaker data, color palette data, and written description speaker data, wherein the visual asset speaker data comprises information pertaining to one or more visual representations of one or more speakers associated with the speaker recognition data, and the color palette data comprises information pertaining to the images;
- assign, using the visual asset speaker data, one or more visual representations to one or more speakers identified in the speaker recognition data;
- and
- generate, based on the one or more audio features, a video, wherein the video is presented via a media player on a user interface of a computing device, and the video presents the one or more visual representations of the one or more speakers when the one or more speakers speak during the video.
A system comprising:
- a memory device storing instructions;
- and
- a processing device communicatively coupled to the memory device, wherein the processing device executes the instructions to:
- receive an audio file;
- extract, using an artificial intelligence engine comprising one or more trained machine learning models, one or more audio features from the audio file, wherein the one or more audio features comprise at least one of a time-synchronized transcript, speaker recognition data, mood data, visual asset speaker data, color palette data, and written description speaker data, wherein the visual asset speaker data comprises information pertaining to one or more visual representations of one or more speakers associated with the speaker recognition data, and the color palette data comprises information pertaining to the images;
- assign, using the visual asset speaker data, one or more visual representations to one or more speakers identified in the speaker recognition data;
- and
- generate, based on the one or more audio features, a video, wherein the video is presented via a media player on a user interface of a computing device, and the video presents the one or more visual representations of the one or more speakers when the one or more speakers speak during the video.
Dependencies are inferred from the claim text.