US 11,557,121 B2Granted

System, device, and method for generating and utilizing content-aware metadata

AssigneeCloudinary Ltd.

InventorsAmnon Cohen-Tidhar, Tal Lev-Ami

Life of this patent

Estimating the term…

Loading patent…

Abstract

System, device, and method for generating and utilizing content-aware metadata, particularly for playback of video and other content items. A method includes: receiving a video file, and receiving content-aware metadata about visual objects that are depicted in said video file; and dynamically adjusting or modifying playback of that video file, on a video playback device, based on the content-aware metadata. The modifications include content-aware cropping, summarizing, watermarking, overlaying of other content elements, modifying playback speed, adding user-selectable indicators or areas around or near visual objects to cause a pre-defined action upon user selection, or other adjustments or modification. Optionally, a modified and content-aware version of the video file is automatically generated or stored. Optionally, the content-aware metadata is stored internally or integrally within the video file, in its header or as a private channel; or is stored in an accompanying file.

Claims35

Dependent claims

A system comprising:

a hardware processor that is configured to execute code, and that is operably associated with a memory unit that is configured to store code;
wherein the hardware processor is configured to perform a process comprising:
(a) receiving a video file, and receiving content-aware metadata about visual objects that are depicted by said video file;
(b) dynamically adjusting playback of said video file, on a video playback device, based cumulatively on at least (I) said content-aware metadata, and (II) dimensions of a screen-portion that is currently available for playback of said video file on said video playback device;
wherein step (a) comprises:
receiving a video file which comprises at least (i) a video channel carrying video data, and (ii) a private channel carrying content-aware metadata;
wherein both the video channel carrying the video data and the private channel carrying the content-aware metadata are internal components of said video file;
wherein step (b) comprises:
extracting said content-aware metadata from said private channel of said video file, and dynamically adjusting the playback of the video based on content-aware metadata that was extracted from said private channel of said video file.

6 more elements

A system comprising:

a hardware processor that is configured to execute code, and that is operably associated with a memory unit that is configured to store code;
wherein the hardware processor is configured to perform a process comprising:
(a) receiving a video file, and receiving content-aware metadata about visual objects that are depicted by said video file;
(b) dynamically adjusting playback of said video file, on a video playback device, based cumulatively on at least (I) said content-aware metadata, and (II) dimensions of a screen-portion that is currently available for playback of said video file on said video playback device;
wherein step (a) comprises:
receiving a video file which comprises at least (i) a video channel carrying video data, and (ii) a file header carrying content-aware metadata;
wherein both the video channel carrying the video data and file header carrying the content-aware metadata are internal components of said video file;
wherein step (b) comprises:
extracting said content-aware metadata from said file header of said video file, and dynamically adjusting the playback of the video based on content-aware metadata that was extracted from said file header of said video file.

6 more elements

A system comprising:

a hardware processor that is configured to execute code, and that is operably associated with a memory unit that is configured to store code;
wherein the hardware processor is configured to perform a process comprising:
(a) receiving a video file, and receiving content-aware metadata about visual objects that are depicted by said video file;
(b) dynamically adjusting playback of said video file, on a video playback device, based cumulatively on at least (I) said content-aware metadata, and (II) dimensions of a screen-portion that is currently available for playback of said video file on said video playback device;
wherein step (a) comprises:
receiving a video file which comprises at least (i) a video channel carrying video data, and (ii) a file-portion storing a link to a location on a remote server which stores content-aware metadata pertaining to that video channel;
wherein both the video channel carrying the video data and the file-portion storing said link are internal components of said video file;
wherein step (a) further comprises:
obtaining from said location on remote server, the content-aware metadata pertaining to that video file, based on said link which is part of said video file;
wherein step (b) comprises:
dynamically adjusting the playback of the video based on content-aware metadata that was obtained from said location on said remote server.

8 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/858,633Filed 26 Apr 2020
Published: US 2021/0334547 A128 Oct 2021
Granted: 17 Jan 2023
Term ends: Not estimatedThe source records don’t support an estimate.

Classification9 codes

G06V 20/46
In video content: extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
G06F 16/7837
Using metadata automatically derived from the content: using objects detected or recognised in the video content
G06F 16/7854
Using low-level visual features of the video content: using shape
G06F 16/7867
Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually: using information manually…