Method and apparatus for annotating video content with metadata generated using speech recognition technology

A system comprising:

• one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
• while rendering video content on a display device:
• receiving audio data from a user, the audio data annotating a particular portion of the video content;
• converting the audio data into text;
• and
• generating annotation metadata associating the text with the particular portion of the video content;
• after rendering the video content on the display device, receiving a search query comprising one or more terms present in the text;
• and
• providing the particular portion of the video content for output based on the search query and the annotation metadata associating the text with the particular portion of the video content.

A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

• while rendering video content on a display device:
• receiving audio data from a user, the audio data annotating a particular portion of the video content;
• converting the audio data into text;
• and
• generating annotation metadata associating the text with the particular portion of the video content;
• after rendering the video content on the display device, receiving a search query comprising one or more terms present in the text;
• and
• providing the particular portion of the video content for output based on the search query and the annotation metadata associating the text with the particular portion of the video content.