Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorsOron NIR, Tal SHOHAM
Estimating the term…
A vision language model (“VLM”) generates text captions from video content. Innovations in controlling the complexity of captioning that uses a VLM are described. For example, a training tool updates a training set so that text captions are more concise, then fine-tunes a VLM using the updated training set. Or, as another example, a generative artificial intelligence model such as a VLM dynamically adjusts the probability of an end-of-sentence (“EOS”) token so that the probability of the EOS token increases in successive iterations of output token generation, which tends to make generated text captions more concise. Or, as another example, a captioning tool identifies and ranks representative units (such as keyframes) of video, then selectively applies captioning (using a VLM) to representative units of the video based on ranking information. Together or individually, the innovations can improve the computational efficiency and accuracy of captioning that uses a VLM.
A computing device comprising a processor system and memory, wherein the computing device implements a captioning tool configured to perform operations comprising:
In a computing device that implements a captioning tool, a method comprising:
One or more computer-readable media having stored therein computer-executable instructions for causing a processor system, when programmed thereby, to perform operations comprising:
Dependencies are inferred from the claim text.