Artificial intelligence (ai)-based speech and non-speech subtitle information generation from multimedia content

A method, comprising:

• in an electronic device:
• receiving multimedia content including speech content;
• detecting the speech content from the multimedia content to determine a set of speech segments and a set of non-speech segments;
• determining speech metadata based on the set of speech segments and non-speech metadata based on the set of non-speech segments, wherein
• the speech metadata includes a spoken text, a user associated with the spoken text, and a profanity score associated with the spoken text, of the speech content;
• applying a first artificial intelligence (AI) model to the speech metadata;
• determining voice captions associated with the multimedia content, based on the applied first AI model;
• applying a second AI model to the non-speech metadata;
• determining non-voice captions associated with the multimedia content, based on the applied second AI model;
• generating subtitle information associated with the multimedia content, based on the voice captions and the non-voice captions;
• and
• controlling rendering of the multimedia content with the subtitle information.

A non-transitory computer-readable medium having stored thereon, computer-executable instructions that when executed by an electronic device, causes the electronic device to execute operations, the operations comprising:

• receiving multimedia content including speech content;
• detecting the speech content from the multimedia content to determine a set of speech segments and a set of non-speech segments;
• determining speech metadata based on the set of speech segments and non-speech metadata based on the set of non-speech segments, wherein
• the speech metadata includes a spoken text, a user associated with the spoken text, and a profanity score associated with the spoken text, of the speech content;
• applying a first artificial intelligence (AI) model to the speech metadata;
• determining voice captions associated with the multimedia content, based on the applied first AI model;
• applying a second AI model to the non-speech metadata;
• determining non-voice captions associated with the multimedia content, based on the applied second AI model;
• generating subtitle information associated with the multimedia content, based on the voice captions and the non-voice captions;
• and
• controlling rendering of the multimedia content with the subtitle information.