Method and system for fingerprinting digital video object based on multiresolution, multirate spatial and temporal signatures

A computer implemented method for generating a spatial signature for a frame of a video object with a computer system programmed to perform the method, comprising:

• obtaining, by the computer system, a frame associated with a video object;
• dividing, by the computer system, the frame into a plurality of blocks, the plurality of blocks corresponding to a plurality of locations respectively, each of the plurality of blocks including a plurality of pixels, the plurality of pixels corresponding to a plurality of pixel values respectively;
• determining, by the computer system, a plurality of average pixel values for the plurality of blocks respectively;
• processing, by the computer system, the plurality of average pixel values;
• determining, by the computer system, a plurality of ranks for the plurality of blocks respectively based on at least information associated with the plurality of average pixel values, each of the plurality of ranks corresponding to a block;
• processing, by the computer system, information associated with the plurality of ranks;
• determining, by the computer system, a sequence of ranks based on at least information associated with the plurality of ranks and the plurality of locations;
• and
• storing a spatial signature for the frame in a data storage separate from the video object, wherein the spatial signature for the frame includes information associated with the sequence of ranks, and wherein the frame of the video object is not modified by the spatial signature.

A computer implemented method for generating a temporal signature for a frame of a video object that is performed by a computer system programmed to perform the method, comprising:

• obtaining, by the computer system, a first plurality of frames associated with a video object, the first plurality of frames including at least a frame, each of the first plurality of frames including a first plurality of pixels and corresponding to an adjacent frame, the adjacent frame including a second plurality of pixels;
• processing, by the computer system, information associated with the first plurality of frames;
• determining, by the computer system, a plurality of difference values for the first plurality of frames respectively, each of the plurality of difference values corresponding to the each of the first plurality of frames and the adjacent frame;
• processing, by the computer system, information associated with the plurality of difference values;
• determining, by the computer system, a plurality of ranks corresponding to the first plurality of frames respectively based on at least information associated with the plurality of difference values, the plurality of ranks including a rank corresponding to the frame, the rank being a temporal signature for the frame;
• and
• storing, by the computer system, the temporal signature for the frame in a data store separate from the video object, wherein the first plurality of frames associated with the video object are not modified by the temporal signature.

A computer implemented method for generating a spatial-temporal signature for a frame of a video object with a computer system programmed to perform the method, comprising:

• obtaining, by the computer system, a first plurality of frames associated with a video object, the first plurality of frames including at least a frame, each of the first plurality of frames corresponding to an adjacent frame;
• dividing, by the computer system, each of the first plurality of frames, wherein the divided frame includes a first plurality of blocks corresponding to a plurality of locations respectively, each of the first plurality of blocks corresponding to a second plurality of blocks including the each of the first plurality of blocks, the second plurality of blocks being associated with blocks on the first plurality of frames respectively;
• processing, by the computer system, information associated with the first plurality of frames;
• for each of the first plurality of blocks,
• determining, by the computer system, a plurality of difference values for the second plurality of blocks respectively, each of the plurality of difference values being associated with the each of the second plurality of blocks and a corresponding block on the adjacent frame;
• processing, by the computer system, information associated with the plurality of difference values;
• determining, by the computer system, a first plurality of ranks corresponding to the second plurality of blocks respectively based on at least information associated with the plurality of difference values;
• processing, by the computer system, information associated with the first plurality of ranks;
• determining, by the computer system, a rank for the each of the first plurality of blocks based on at least information associated with the first plurality of ranks;
• processing, by the computer system, information associated with a second plurality of ranks corresponding to the first plurality of blocks respectively, the second plurality of ranks including the rank;
• determining, by the computer system, a sequence of ranks based on at least information associated with the second plurality of ranks and the plurality of locations for the first plurality of blocks;
• and
• storing, by the computer system, a spatial-temporal signature for the frame independent of the video object, wherein the spatial-temporal signature for the frame includes information associated with the sequence of ranks, and wherein the first plurality of frames associated with the video object are not modified by the spatial-temporal signature.

A non-transitory computer readable medium including instructions that programs a processor of a computer system to generate a fingerprint for a video object, the non-transitory computer readable medium comprising:

• one or more instructions that programs the processor to obtain a plurality of frames associated with a video object;
• one or more instructions for each of the plurality of frames,
• that programs the processor to process information associated with the plurality of frames;
• that programs the processor to determine a plurality of spatial signatures for the each of the plurality of frames based on at least information associated with the each of the plurality of frames, the plurality of spatial signatures corresponding to a plurality of resolutions respectively;
• that programs the processor to determine a plurality of temporal signatures for the each of the plurality of frames based on at least information associated with the plurality of frames, the plurality of temporal signatures corresponding to a plurality of frame rates respectively;
• that programs the processor to process information associated with the plurality of spatial signatures and the plurality of temporal signatures;
• that programs the processor to determine a frame fingerprint for the each of the plurality of frames, the frame fingerprint including the plurality of spatial signatures corresponding to the plurality of resolutions respectively and the plurality of temporal signatures corresponding to the plurality of frame rates respectively;
• one or more instructions that programs the processor to process a plurality of frame fingerprints for the plurality of frames respectively, the plurality of frame fingerprints including the frame fingerprint for the each of the plurality of frames;
• one or more instructions that programs the processor to determine a video fingerprint for the video object, the video fingerprint including the plurality of frame fingerprints;
• and
• one or more instructions that programs to processor to store the video fingerprint for the video object in a memory storage separately from the video object, wherein the plurality of frames associated with the video object are not modified.

A non-transitory computer readable medium including instructions that programs a processor of a computer system to generate a spatial signature for a frame of a video object, the non-transitory computer readable medium comprising:

• one or more instructions that programs the processor to obtain a frame associated with a video object;
• one or more instructions that programs the processor to divide the frame into a plurality of blocks, the plurality of blocks corresponding to a plurality of locations respectively, each of the plurality of blocks including a plurality of pixels, the plurality of pixels corresponding to a plurality of pixel values respectively;
• one or more instructions that programs the processor to determine a plurality of average pixel values for the plurality of blocks respectively;
• one or more instructions that programs the processor to process the plurality of average pixel values;
• one or more instructions that programs the processor to determine a plurality of ranks for the plurality of blocks respectively based on at least information associated with the plurality of average pixel values, each of the plurality of ranks corresponding to a block;
• one or more instructions that programs the processor to process information associated with the plurality of ranks;
• one or more instructions that programs the processor to determine a sequence of ranks based on at least information associated with the plurality of ranks and the plurality of locations;
• and
• one or more instructions that programs the processor to store a spatial signature for the frame in a memory separately from the video object, wherein the spatial signature for the frame includes information associated with the sequence of ranks, wherein the frame associated with the video object is not modified by the spatial signature.

A non-transitory computer readable medium including instructions that programs a processor of a computer system to generate a temporal signature for a frame of a video object, the non-transitory computer readable medium comprising:

• one or more instructions that programs the processor to obtain a first plurality of frames associated with a video object, the first plurality of frames including at least a frame, each of the first plurality of frames including a first plurality of pixels and corresponding to an adjacent frame, the adjacent frame including a second plurality of pixels;
• one or more instructions that programs the processor to process information associated with the first plurality of frames;
• one or more instructions that programs the processor to determine a plurality of difference values for the first plurality of frames respectively, each of the plurality of difference values corresponding to the each of the first plurality of frames and the adjacent frame;
• one or more instructions that programs the processor to process information associated with the plurality of difference values;
• one or more instructions that programs the processor to determine a plurality of ranks corresponding to the first plurality of frames respectively based on at least information associated with the plurality of difference values, the plurality of ranks including a rank corresponding to the frame, the rank being a temporal signature for the frame;
• and
• one or more instructions that programs the processor to store the temporal signature for the frame in a fingerprint database separate from the video object, wherein the video object is not modified by the temporal signature.

A non-transitory computer readable medium including instructions that programs a processor a computer system to generate a spatial-temporal signature for a frame of a video object, the non-transitory computer readable medium comprising:

• one or more instructions that programs the processor to obtain a first plurality of frames associated with a video object, the first plurality of frames including at least a frame, each of the first plurality of frames corresponding to an adjacent frame;
• one or more instructions that programs the processor to dividing each of the first plurality of frames, wherein the divided frame includes a first plurality of blocks corresponding to a plurality of locations respectively, each of the first plurality of blocks corresponding to a second plurality of blocks including the each of the first plurality of blocks, the second plurality of blocks being associated with blocks on the first plurality of frames respectively;
• one or more instructions that programs the processor to process information associated with the first plurality of frames;
• one or more instructions, for each of the first plurality of blocks,
• that programs the processor to determine a plurality of difference values for the second plurality of blocks respectively, each of the plurality of difference values being associated with the each of the second plurality of blocks and a corresponding block on the adjacent frame;
• that programs the processor to process information associated with the plurality of difference values;
• that programs the processor to determine a first plurality of ranks corresponding to the second plurality of blocks respectively based on at least information associated with the plurality of difference values;
• that programs the processor to process information associated with the first plurality of ranks;
• that programs the processor to determine a rank for the each of the first plurality of blocks based on at least information associated with the first plurality of ranks;
• one or more instructions for processing information associated with a second plurality of ranks corresponding to the first plurality of blocks respectively, the second plurality of ranks including the rank;
• one or more instructions that programs the processor to determine a sequence of ranks based on at least information associated with the second plurality of ranks and the plurality of locations for the first plurality of blocks;
• and
• one or more instructions that programs the processor to store the spatial-temporal signature for the frame in a fingerprint database separate from the video object, wherein the spatial-temporal signature for the frame includes information associated with the sequence of ranks, and wherein the video object is not modified by the spatial-temporal signature.