Scene frame matching for automatic content recognition

A system comprising:

• data processing hardware;
• and
• memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
• receiving media device fingerprints, wherein the media device fingerprints comprise fingerprints generated from media device frames captured by a corresponding media device, and wherein the media device frames are frames of a media device stream received by the corresponding media device;
• identifying a single target media device frame that is the most-recent target media device frame of the media device stream, the single target media device frame having a corresponding target media device fingerprint;
• obtaining scene centroids of corresponding scenes of the media device stream, each scene comprising an initial media device frame having a corresponding initial media device fingerprint and a last media device frame having a corresponding last media device fingerprint, each scene centroid representing a mean of fingerprints of the respective scene, the mean of fingerprints determined by an average of pixel values corresponding to the fingerprints of the respective scene;
• for each of at least two scene centroids, determining a distance between the respective scene centroid and the target media device fingerprint of the single target media device frame;
• selecting from the at least two scene centroids, a scene centroid having a shortest distance to the target media device fingerprint of the single target media device frame;
• and
• based on the selected scene centroid having the shortest distance to the target media device fingerprint of the single target media device frame, determining that the respective scene represented by the selected scene centroid is a target scent to which the single target media device frame belongs such that the single target media device frame is one of a plurality of target media device frames that make up the respective scene.

A non-transitory computer readable medium having stored thereon instructions that, upon execution by a processor, cause performance of a set of acts comprising:

• receiving media device fingerprints, wherein the media device fingerprints comprise fingerprints generated from media device frames captured by a corresponding media device, and wherein the media device frames are frames of a media device stream received by the corresponding media device;
• identifying a single target media device frame that is the most recent target media device frame of the media device stream, the single target media device frame having a corresponding target media device fingerprint;
• obtaining scene centroids of corresponding scenes of the media device stream, each scene comprising an initial media device frame having a corresponding initial media device fingerprint and a last media device frame having a corresponding last media device fingerprint, each scene centroid representing a mean of fingerprints of the respective scene;
• for each of at least two scene centroids, determining a distance between the respective scene centroid and the target media device fingerprint of the single target media device frame;
• selecting, from the at least two scene centroids, a scene centroid having a shortest distance to the target media device fingerprint of the single target media device frame;
• and
• based on the selected scene centroid having the shortest distance to the target media device fingerprint of the single target media device frame, determining that the respective scene represented by the selected scene centroid is a target scene to which the single target media device frame belongs such that the single target media device frame is one of a plurality of target media device frames that make up the respective scene.