Media System with Closed-Captioning Data and/or Subtitle Data Generation Features

A computing system comprising a processor and a non-transitory computer-readable storage medium having stored thereon program instructions that upon execution by the processor, cause the computing system to perform a set of acts comprising:

• obtaining media, wherein the obtained media includes (i) audio representing speech, (ii) video, and (iii) metadata associated with the obtained media;
• using at least the audio representing speech as a basis to generate speech text, wherein using at least the audio representing speech as the basis to generate the speech text comprises:
• (i) providing to a trained model, at least audio data for the audio representing speech and the metadata associated with the obtained media, wherein the metadata associated with the obtained media includes a rating of the obtained media;
• and
• (ii) responsive to the providing, receiving from the trained model, generated speech text generated by the trained model;
• using at least the audio representing speech to determine starting and ending time points of the speech;
• and
• using at least the generated speech text and the determined starting and ending time points of the speech to (i) generate closed-captioning or subtitle data that includes closed-captioning or subtitle text based on the generated speech text and (ii) associating the generated closed-captioning or subtitle data with the obtained media, such that the closed-captioning or subtitle text is time-aligned with the video based on the determined starting and ending time points of the speech.

A non-transitory computer-readable storage medium having stored thereon program instructions that upon execution by a processor, cause a computing system to perform a set of acts comprising:

• obtaining media, wherein the obtained media includes (i) audio representing speech, (ii) video, and (iii) metadata associated with the obtained media;
• using at least the audio representing speech as a basis to generate speech text, wherein using at least the audio representing speech as the basis to generate the speech text comprises:
• (i) providing to a trained model, at least audio data for the audio representing speech and metadata associated with the obtained media, wherein the metadata associated with the obtained media includes a rating of the obtained media;
• and
• (ii) responsive to the providing, receiving from the trained model, generated speech text generated by the trained model;
• using at least the audio representing speech to determine starting and ending time points of the speech;
• and
• using at least the generated speech text and the determined starting and ending time points of the speech to (i) generate closed-captioning or subtitle data that includes closed-captioning or subtitle text based on the generated speech text and (ii) associating the generated closed-captioning or subtitle data with the obtained media, such that the closed-captioning or subtitle text is time-aligned with the video based on the determined starting and ending time points of the speech.