# US 2014/0195548 A1 · Identifying video content via fingerprint matching > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0195548 A1 - Document ID: US20140195548A1 - Status: Published application - Kind: A1 - Application number: 13/735,426 - Filed: 2013-01-07 - Published: 2014-07-10 - Earliest claimed: 2013-01-07 - Assignees: Gracenote, Inc. - Inventors: Wilson Harron - Web page: https://patentgrep.com/patent/US20140195548A1 ## CPC - G06F 16/783: using metadata automatically derived from the content - G06F 16/7847: {using low-level visual features of the video content} - G06F 16/951: Indexing; Web crawling techniques - G06Q 30/02: Marketing; Price estimation or determination; Fundraising - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract Methods and systems to identify video content based on video fingerprint matching are described. In some example embodiments, the methods and systems generate a query fingerprint of a frame of video content captured at a client device, query a database of reference fingerprints, determine the query fingerprint of the frame of captured video content matches a reference fingerprint, and identify the video content based on the match of fingerprints. ## Claims ### Claim 1 A method, comprising: accessing a query fingerprint that is based on multiple patches of a frame of video content captured at a client device; querying a database of reference fingerprints associated with frames of known video content; determining the query fingerprint matches at least one of the reference fingerprints; and identifying the video content captured at the client device based on the determination that the query fingerprint matches at least one of the reference fingerprints. ### Claim 2 (depends on 1) The method of claim 1, wherein accessing a query fingerprint that is based on multiple patches of a frame of video content includes accessing a query fingerprint that is based on a value calculated for the multiple patches of the frame of video content using an integral image technique. ### Claim 3 (depends on 1) The method of claim 1, wherein accessing a query fingerprint that is based on multiple patches of a frame of video content includes accessing a query fingerprint that is based on a value calculated for multiple Haar-like features of the frame of video content. ### Claim 4 (depends on 1) The method of claim 1, wherein accessing a query fingerprint that is based on multiple patches of a frame of video content includes accessing a query fingerprint that is based on a value calculated for multiple Haar-like features of the video content, wherein each of the Haar-like features is associated with a unique location of a unique scale within the frame of video content. ### Claim 5 (depends on 1) The method of claim 1, wherein querying a database of reference fingerprints includes querying an index of 24-bit numbers that are associated with single frames of the reference fingerprints and derived by quantizing patch values of the reference fingerprints. ### Claim 6 (depends on 1) The method of claim 1, wherein querying a database of reference fingerprints includes querying an index of quantized patch values calculated for the reference fingerprints. ### Claim 7 (depends on 1) The method of claim 1, wherein determining the query fingerprint matches at least one of the reference fingerprints includes determining that a similarity between the query fingerprint and the at least one of the reference fingerprints satisfies a predetermined threshold associated with a Tanimoto distance measurement. ### Claim 8 (depends on 1) The method of claim 1, wherein determining the query fingerprint matches at least one of the reference fingerprints includes determining that a similarity between the query fingerprint and the at least one of the reference fingerprints satisfies a predetermined threshold associated with a Manhattan distance measurement. ### Claim 9 (depends on 1) The method of claim 1, further comprising: returning an identifier to the client device for the video content that is associated with metadata to be presented along with the video content via the client device. ### Claim 10 (depends on 1) The method of claim 1, further comprising: returning an identifier to the client device for the video content that is associated with event-based information to be presented along with the video content via the client device. ### Claim 11 A system, comprising: a query fingerprint generator that includes: a patch selection module that is configured to select multiple patches of a frame of video content; and a value calculation module that is configured to calculate a value for each of the selected multiple patches using an integral image technique; an index module that is configured to query a database of reference fingerprints associated with frames of known video content; a fingerprint match module that is configured to determine the query fingerprint matches at least one of the reference fingerprints; and an identification module that is configured to identify the video content captured at the client device based on the determination that the query fingerprint matches at least one of the reference fingerprints. ### Claim 12 (depends on 11) The system of claim 11, wherein the selected multiple patches of the frame of video content are each associated with a displayed region of the frame of the video content. ### Claim 13 (depends on 11) The system of claim 11, wherein the query fingerprint generator is configured to calculate values of multiple Haar-like features of the frame of video content. ### Claim 14 (depends on 11) The system of claim 11, wherein the query fingerprint generator is configured to calculate values of multiple Haar-like features of the frame of video content, wherein each of the Haar-like features is associated with a unique location and at a unique scale of the frame of video content. ### Claim 15 (depends on 11) The system of claim 11, wherein the fingerprint match module is configured to determine that a similarity between the query fingerprint and the at least one of the reference fingerprints satisfies a predetermined threshold associated with a distance measurement. ### Claim 16 A computer-readable storage medium whose contents, when executed by a computing system, cause the computing system to perform operations, comprising: accessing a query fingerprint that is based on a value calculated for multiple patches of a frame of video content using an integral image technique; querying a database of reference fingerprints associated with frames of known video content; determining the query fingerprint matches at least one of the reference fingerprints; and identifying the video content captured at the client device based on the determination that the query fingerprint matches at least one of the reference fingerprints. ### Claim 17 (depends on 16) The computer-readable storage medium of claim 16, wherein accessing a query fingerprint includes accessing a query fingerprint that is based on a value calculated for multiple Haar-like features of the video content. ### Claim 18 (depends on 16) The computer-readable storage medium of claim 16, wherein accessing a query fingerprint includes accessing a query fingerprint that is based on a value calculated for multiple Haar-like features of the video content, wherein each of the Haar-like features is associated with a unique location of a unique scale within the frame of video content. ### Claim 19 (depends on 16) The computer-readable storage medium of claim 16, wherein querying a database of reference fingerprints associated with frames of known video content includes querying a database of reference fingerprints with two or more accessed query fingerprints; and wherein determining the query fingerprint matches at least one of the reference fingerprints includes determining the two or more accessed query fingerprints matches at least two or more reference fingerprints. ### Claim 20 (depends on 16) The computer-readable storage medium of claim 16, wherein querying a database of reference fingerprints includes querying an index of quantized patch values calculated for the reference fingerprints.