Video timeline assembly based on text instructions using machine learning
AssigneeAdobe Inc.
InventorsFabian David CABA HEILBRON, Jui-Hsien WANG, Bryan RUSSELL, Luis Alejandro PARDO GONZALEZ, Josef SIVIC
Life of this patent
Estimating the term…
Loading patent…
AssigneeAdobe Inc.
InventorsFabian David CABA HEILBRON, Jui-Hsien WANG, Bryan RUSSELL, Luis Alejandro PARDO GONZALEZ, Josef SIVIC
Estimating the term…
Embodiments are trained to generate a timeline of digital media assets based on natural language instructions using a machine learning model. The method may include receiving an input including digital media assets, an input visual timeline, and text input, where the text input indicates a natural language instruction describing a modification to the input visual timeline using the digital media assets. The disclosed systems and methods further comprise generating a first set of tokens for the digital media assets, a second set of tokens for the input visual timeline, and a third set of tokens for the text input. The disclosed systems and methods further comprise processing, by a large language model, the first set of tokens, the second set of tokens, and the third set of tokens to generate an output set of tokens and generating a reconstructed visual timeline using the output set of tokens.
A method comprising:
A non-transitory computer-readable medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:
A system comprising:
Dependencies are inferred from the claim text.