US 11,601,713 B2Granted

System and method for media segment identification

OwnerOran Gilad, Samuel Chenillo +1inventors

InventorsOran Gilad, Samuel Chenillo, Oren Steinfeld

Life of this patent

Estimating the term…

Loading patent…

Abstract

A system and method for identifying media segments using audio augmented image cross-comparison is disclosed, in which a media segment identifying system analyses both audio and video content, producing a unique identifier to compare with previously identified media segments in a media segment database. The characteristic landmark-linked-image-comparisons are constructed by first identifying an audio landmark. The audio landmark is an audio peak that exceeds a predetermined threshold. Two digital images are then obtained, one associated directly with the audio landmark, and one obtained a predetermined landmark time removed from the first image. The two images are then used to provide a characteristic landmark-linked-image-comparison. The pair of images are reduced in pixel size and converted to gray scale. Corresponding pixels are compared to form a numeric comparison. One image is mirrored before comparison to reduce the possibility of null comparisons.

Claims18

Dependent claims

A method of media segment identification, comprising:

providing a digital processor;
providing an identified media segment database, in functional connection to said digital processor, comprising one or more previously identified media segments, said previously identified media segments comprising an audio segment and a video segment and a having an associated landmark-linked-image-comparison, said associated landmark-linked-image-comparison comprising a landmark-time and an image-cross-comparison, said image-cross-comparison being an image-comparison between a first digital image associated with an audio peak and a second digital image obtained from said video segment at a position removed from said audio peak by a temporal distance equal to said landmark-time;
obtaining, by said digital processor, a current digital multimedia stream, having a current media segment comprising a digital image stream, and a digital audio stream;
automatically generating, by one or more software modules operable on said digital processor, a landmark-linked-image-comparison for said current media segment;
automatically comparing, by said software module, said obtained landmark-linked-image-comparison with said landmark-linked-image-comparisons in said media stream database;
and
when said obtained landmark-linked-image-comparison matches one of said landmark-linked-image-comparisons in said identified media segment database, automatically tagging said current media segment as being equivalent to the identified media segment having said matched landmark-linked-image-comparison.

4 more elements

A system of media segment identification, comprising:

a digital processor;
an identified media segment database in functional connection with said digital processor, said identified media segment database comprising one or more previously identified media segments each comprising an audio segment and a video segment and having an associated landmark-linked-image-comparison, said associated landmark-linked-image-comparison comprising a landmark-time and an image-cross-comparison, said image-cross-comparison an image-comparison between a first digital image associated with an audio peak and a second digital image obtained from said video segment at a position removed from said audio peak by a temporal distance equal to said landmark-time;
a current digital multimedia stream, obtained by said digital processor, having a current media segment comprising a digital image stream, and a digital audio stream;
a landmark-linked-image-comparison for said current media segment automatically generated by one or more software modules operable on said digital processor;
automatically comparing, by said software module, said obtained landmark-linked-image-comparison with said landmark-linked-image-comparisons in said media stream database;
and
automatically tagging said current media segment as being equivalent to the identified media segment having said matched landmark-linked-image-comparison when said obtained landmark-linked-image-comparison matches one of said landmark-linked-image-comparisons in said identified media segment database.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/115,876Filed 9 Dec 2020 · continuation in part
Priority: 17 May 2017
Published: US 2021/0092480 A125 Mar 2021
Granted: 7 Mar 2023
Term ends: Not estimatedThe source records don’t support an estimate.

Classification17 codes

G06F 16/41
Of multimedia data, e.g. slideshows comprising image and additional audio data: indexing; Data structures therefor; Storage structures
G06F 16/7834
Using metadata automatically derived from the content: using audio features
G06F 18/253
Fusion techniques: of extracted features
G06V 10/806
Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level: of…

Family

Application62/507,549Us provisional application · filed 17 May 2017
Application62/608,666Us provisional application · filed 21 Dec 2017
Application15/852,389Parent of this continuation-in-part · filed 22 Dec 2017
Application16/110,265Parent of this continuation-in-part · filed 23 Aug 2018
US 10,096,169 B1Parent of this continuation-in-part · filed 11 Sep 2018
Application16/389,957Parent of this continuation-in-part · filed 21 Apr 2019
US 10,271,095 B1Parent of this continuation-in-part · filed 23 Apr 2019
US 2021/0092480 A1Pre-grant publication · published 25 Mar 2021
US 10,867,185 B2Parent of this continuation-in-part
US 2019/0244032 A1Published application
US 11,601,713 B2This patent

From the US filing history. Foreign family members aren’t listed.