Method, System, and Computer-Readable Medium for Generating and Utilizing Metadata on Cinematic Elements In Video Content Through a Trained Captioner Model
AssigneeInterPositive, LLC
InventorBenjamin Geza Affleck-Boldt
Life of this patent
Estimating the term…
Abstract
A method generates information on cinematic elements in video content using a trained model by processing video sequences to generate metadata, aggregating this metadata, and outputting detailed reports. A system includes processors and memory with instructions to generate and output information on cinematic elements in video content using a trained model. A computer-readable medium has instructions for generating and outputting information on cinematic elements in video content using a trained model.
Claims30
A computer-implemented method for generating information on cinematic elements within video content using a trained captioner model, the method comprising:
- a. providing a captioner model that has been trained to identify and generate metadata for cinematic elements in video sequences, where the cinematic elements include but are not limited to focal length, camera movement, depth of field, occlusion, and parallax;
- b. inputting a target video sequence into the trained captioner model, where the target video sequence comprises a series of frames depicting various cinematic elements;
- c. processing the target video sequence through the trained captioner model to generate metadata for each frame of the video sequence, where the metadata describes the cinematic elements identified by the model;
- d. aggregating frame-level metadata to produce comprehensive information on the cinematic elements present throughout the target video sequence;
- e. outputting the aggregated information as a structured report or visualization that details the cinematic elements identified within the target video sequence, including changes in focal length, patterns of camera movement, and instances of occlusion or parallax;
- f. storing the generated information in a database or file system for future reference or analysis;
- g. utilizing the generated information to enhance video content analysis, editing, or production processes by providing insights into cinematic techniques employed within the target video sequence.
A computing system for generating information on cinematic elements within video content using a trained captioner model, the computing system comprising:
- one or more processors;
- and
- one or more memories, having stored thereon instructions that, when executed, cause the computing system to:
- provide a captioner model that has been trained to identify and generate metadata for cinematic elements in video sequences,
- where the cinematic elements include but are not limited to focal length, camera movement, depth of field, occlusion, and parallax;
- input a target video sequence into the trained captioner model,
- where the target video sequence comprises a series of frames depicting various cinematic elements;
- process the target video sequence through the trained captioner model to generate metadata for each frame of the video sequence,
- where the metadata describes the cinematic elements identified by the model;
- aggregate frame-level metadata to produce comprehensive information on the cinematic elements present throughout the target video sequence;
- output the aggregated information as a structured report or visualization that details the cinematic elements identified within the target video sequence, including changes in focal length, patterns of camera movement, and instances of occlusion or parallax;
- store the generated information in a database or file system for future reference or analysis;
- and
- utilize the generated information to enhance video content analysis, editing, or production processes by providing insights into cinematic techniques employed within the target video sequence.
A non-transitory computer-readable medium having stored thereon a set of instructions that, when executed, cause a computer to:
- provide a captioner model that has been trained to identify and generate metadata for cinematic elements in video sequences,
- where the cinematic elements include but are not limited to focal length, camera movement, depth of field, occlusion, and parallax;
- input a target video sequence into the trained captioner model,
- where the target video sequence comprises a series of frames depicting various cinematic elements;
- process the target video sequence through the trained captioner model to generate metadata for each frame of the video sequence,
- where the metadata describes the cinematic elements identified by the model;
- aggregate frame-level metadata to produce comprehensive information on the cinematic elements present throughout the target video sequence;
- output the aggregated information as a structured report or visualization that details the cinematic elements identified within the target video sequence, including changes in focal length, patterns of camera movement, and instances of occlusion or parallax;
- store the generated information in a database or file system for future reference or analysis;
- and
- utilize the generated information to enhance video content analysis, editing, or production processes by providing insights into cinematic techniques employed within the target video sequence.
Dependencies are inferred from the claim text.