# US 2019/0377954 A1 · Comparing video sequences using fingerprints

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0377954 A1
- Document ID: US20190377954A1
- Status: Published application
- Kind: A1
- Application number: 16/549,994
- Filed: 2019-08-23
- Published: 2019-12-12
- Earliest claimed: 2016-08-24
- Assignees: Grass Valley Limited
- Applicants: Grass Valley Limited
- Inventors: Jonathan DIGGINS
- Web page: https://patentgrep.com/patent/US20190377954A1

## CPC

- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06F 16/7328: {Query by example, e.g. a complete video frame or video sequence (graphical querying G06F16/7335)}
- G06V 20/48: {Matching video sequences}
- G06V 20/49: {Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes}
- H04N 5/04: Synchronising (for television systems using pulse code modulation H04N7/56)
- H04N 17/02: for colour television signals
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A first sequence of video fingerprints at a first image repetition rate is compared with a second sequence of video fingerprints at a second, different image repetition rate. A converted sequence of fingerprints is generated from the first or second sequence of fingerprints by forming a combination of the values of a number of neighbouring fingerprints. The combination is a weighted average based on the temporal location of the respective neighbouring fingerprints in the first sequence of fingerprints with respect to the fingerprint in the converted sequence. A correlation is then performed between the converted sequence of fingerprints and the other sequence of fingerprints.

## Claims

### Claim 1

An apparatus for validating synchronization of a distributed video signal, the apparatus comprising:
a video sequence receiver configured to obtain a first sequence of fingerprints at a first image repetition rate for a first video image sequence and a second sequence of fingerprints at a second image repetition rate for a second video image sequence, wherein each of the first and second video image sequences are derived from the distributed video signal;
a fingerprint sequence converter configured to generate a first converted sequence of fingerprints by converting the first sequence of fingerprints at the first image repetition rate to a comparison image repetition rate that is common with the second sequence of fingerprints at the second image repetition rate;
a correlator configured to perform a correlation between the first converted sequence of fingerprints and the second sequence of fingerprints at the comparison image repetition rate; and
a video signal analyzer configured to validate the distributed video signal based on the performed correlation by confirming the first video image sequence contains same video content as the second video image sequence;
wherein the second image repetition rate is different from the first image repetition rate;
wherein the comparison image repetition rate is one of the second image repetition rate or a common image repetition rate of a second converted sequence of fingerprints generated by converting the second sequence of fingerprints at the second image repetition rate to the common image repetition rate;
wherein the converted sequence of fingerprints includes a combination of a number of neighboring fingerprints in the first sequence of fingerprints; and
wherein the fingerprints of the first and second sequences of fingerprints are at least one of spatial fingerprints derived each from content of a single video image, temporal fingerprints derived each from a difference in content between two video images, or a combination of spatial and temporal fingerprints.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the combination of the number of neighboring fingerprints includes a weighted average based on a temporal location of the respective neighboring fingerprints in the first sequence of fingerprints in which a temporal fingerprint in the first sequence of fingerprints is scaled in accordance with a ratio of the first and second image repetition rates.

### Claim 3 (depends on 1)

The apparatus of claim 1, further comprising at least one fingerprint creation module configured to form the fingerprints of the first and second sequences of fingerprints.

### Claim 4 (depends on 1)

The apparatus of claim 1, further comprising a shot change detector configured to detect shot changes in at least one of the first and second sequences of video images, and wherein temporal fingerprints derived from video images across a shot change are ignored or given reduced prominence when the correlator performs the correlation.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the correlator is further configured to perform the correlation between the first converted sequence of fingerprints and the second sequence of fingerprints by performing one of a discrete correlation function, a phase correlation process, a simple sum of absolute minimum differences as a function of offset, or an alternative matching function that compares two inputs and returns a function that has an optimum point at an offset position.

### Claim 6

An apparatus for validating synchronization of a distributed video signal, the apparatus comprising:
a video sequence receiver configured to obtain a first sequence of fingerprints at a first image repetition rate for a first video image sequence and a second sequence of fingerprints at a second image repetition rate for a second video image sequence, wherein each of the first and second video image sequences are derived from the distributed video signal and the second image repetition rate is different from the first image repetition rate;
a fingerprint sequence converter configured to generate a first converted sequence of fingerprints by converting the first sequence of fingerprints at the first image repetition rate to a comparison image repetition rate;
a correlator configured to perform a correlation between the first converted sequence of fingerprints and the second sequence of fingerprints at the comparison image repetition rate; and
a video signal analyzer configured to validate the distributed video signal based on the performed correlation by confirming the first video image sequence contains same video content as the second video image sequence; and
wherein the converted sequence of fingerprints includes a combination of a number of neighboring fingerprints in the first sequence of fingerprints.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the fingerprints of the first and second sequences of fingerprints are at least one of spatial fingerprints derived each from content of a single video image, temporal fingerprints derived each from a difference in content between two video images, or a combination of spatial and temporal fingerprints.

### Claim 8 (depends on 6)

The apparatus of claim 6, wherein the comparison image repetition rate is one of the second image repetition rate or a common image repetition rate of a second converted sequence of fingerprints generated by converting the second sequence of fingerprints at the second image repetition rate to the common image repetition rate.

### Claim 9 (depends on 6)

The apparatus of claim 6, wherein the combination of the number of neighboring fingerprints includes a weighted average based on a temporal location of the respective neighboring fingerprints in the first sequence of fingerprints in which a temporal fingerprint in the first sequence of fingerprints is scaled in accordance with a ratio of the first and second image repetition rates.

### Claim 10 (depends on 6)

The apparatus of claim 6, further comprising at least one fingerprint creation module configured to form the fingerprints of the first and second sequences of fingerprints.

### Claim 11 (depends on 6)

The apparatus of claim 6, further comprising a shot change detector configured to detect shot changes in at least one of the first and second sequences of video images, and wherein temporal fingerprints derived from video images across a shot change are ignored or given reduced prominence when the correlator performs the correlation.

### Claim 12 (depends on 6)

The apparatus of claim 6, wherein the correlator is further configured to perform the correlation between the first converted sequence of fingerprints and the second sequence of fingerprints by performing one of a discrete correlation function, a phase correlation process, a simple sum of absolute minimum differences as a function of offset, or an alternative matching function that compares two inputs and returns a function that has an optimum point at an offset position.

### Claim 13

An apparatus for validating synchronization of a distributed video signal, the apparatus comprising:
a correlator configured to perform a correlation at a comparison image repetition rate between a first converted sequence of fingerprints that is derived from a first sequence of fingerprints at a first image repetition rate of a first video image sequence and a second sequence of fingerprints at a second image repetition rate of a second video image sequence, with the first image repetition rate being different from the second image repetition rate and each of the first and second video image sequences derived from the distributed video signal; and
a video signal analyzer configured to validate the distributed video signal based on the performed correlation by confirming the first video image sequence contains a same video content as the second video image sequence.

### Claim 14 (depends on 13)

The apparatus of claim 13, further comprising:
at least one video sequence receiver configured to obtain the first sequence of fingerprints at the first image repetition rate for the first video image sequence and the second sequence of fingerprints at the second image repetition rate for the second video image sequence; and
a fingerprint sequence converter configured to generate the first converted sequence of fingerprints by converting the first sequence of fingerprints at the first image repetition rate to the comparison image repetition rate that is common with the second image repetition rate of the second sequence of fingerprints.

### Claim 15 (depends on 13)

The apparatus of claim 13, wherein the converted sequence of fingerprints includes a combination of a number of neighboring fingerprints in the first sequence of fingerprints.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the combination of the number of neighboring fingerprints includes a weighted average based on a temporal location of the respective neighboring fingerprints in the first sequence of fingerprints in which a temporal fingerprint in the first sequence of fingerprints is scaled in accordance with a ratio of the first and second image repetition rates.

### Claim 17 (depends on 14)

The apparatus of claim 14, wherein the comparison image repetition rate is one of the second image repetition rate or a common image repetition rate of a second converted sequence of fingerprints generated by converting the second sequence of fingerprints at the second image repetition rate to the common image repetition rate.

### Claim 18 (depends on 13)

The apparatus of claim 13, further comprising at least one fingerprint creation module configured to form the fingerprints of the first and second sequences of fingerprints.

### Claim 19 (depends on 13)

The apparatus of claim 13, further comprising a shot change detector configured to detect shot changes in at least one of the first and second sequences of video images, and wherein temporal fingerprints derived from video images across a shot change are ignored or given reduced prominence when the correlator performs the correlation.

### Claim 20 (depends on 13)

The apparatus of claim 13, wherein the correlator is further configured to perform the correlation between the first converted sequence of fingerprints and the second sequence of fingerprints by performing one of a discrete correlation function, a phase correlation process, a simple sum of absolute minimum differences as a function of offset, or an alternative matching function that compares two inputs and returns a function that has an optimum point at an offset position.

### Claim 21 (depends on 13)

The apparatus of claim 13, wherein the fingerprints of the first and second sequences of fingerprints are at least one of spatial fingerprints derived each from content of a single video image of each respective video sequence, temporal fingerprints derived each from a difference in content between two video images of each respective video sequence, or a combination of spatial and temporal fingerprints.
