# US 2014/0156691 A1 · Methods for identifying audio or video content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0156691 A1 - Document ID: US20140156691A1 - Status: Published application - Kind: A1 - Application number: 13/909,834 - Filed: 2013-06-04 - Published: 2014-06-05 - Earliest claimed: 2005-12-23 - Assignees: Digimarc Corporation - Applicants: Digimarc Corporation - Inventors: William Y. Conwell - Web page: https://patentgrep.com/patent/US20140156691A1 ## CPC - G06Q 10/00: Administration; Management - G06F 16/40: of multimedia data, e.g. slideshows comprising image and additional audio data (retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70) - G06F 16/43: Querying - G06F 16/489: {using time information} - G06F 16/58: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F 16/683: using metadata automatically derived from the content - G06F 16/783: using metadata automatically derived from the content - G06N 5/048: Fuzzy inferencing - G06Q 50/18: Legal services - G06Q 50/265: {Personal security, identity or safety} - H04L 9/3247: {involving digital signatures} - H04L 63/08: {for authentication of entities (cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32)} - G06Q 10/40: Business processes related to social networking or social networking services - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract The disclosed technology generally relates to methods for identifying audio and video entertainment content. Certain shortcomings of fingerprint-based content identification can be redressed through use of human-reviewers. ## Claims ### Claim 1 A method comprising: generating fingerprint data from user uploaded visual or audio content, the user uploaded visual or audio content having been uploaded by a user to a first party's online video service for distribution from the first party's online video service to the public, in which the user uploaded visual or audio content has been altered relative to a corresponding version of the user uploaded video or audio content; identifying reference content, from a universe of reference content, that is a possible match of the user uploaded visual or audio content, said identifying being based on the fingerprint data and being performed by a computer system configured to perform such act; queuing for review by a second party, different than the first party, the user uploaded visual or audio content item and data associated with the identified reference content; receiving assessment data from the second party, the assessment data indicating a result of a comparison of the user uploaded visual or audio content and the reference content by one or more human reviewer(s); using the assessment data in concluding that the reference content corresponds with the user uploaded visual or audio content; and limiting distribution of the user uploaded visual or audio content from the first party's online video service to the public based on the concluding. ### Claim 2 (depends on 1) The method of claim 1 in which the user uploaded visual or audio content has been intentionally altered to avoid fingerprint matching. ### Claim 3 (depends on 2) The method of claim 2 in which the user uploaded visual or audio content has been rotated. ### Claim 4 (depends on 1) The method of claim 1 further comprising updating the universe of reference content with the user uploaded visual or audio content. ### Claim 5 (depends on 1) The method of claim 1 in which said limiting distribution comprises interrupting delivery to a public user. ### Claim 6 (depends on 5) The method of claim 5 further comprising providing an explanatory message to the public user. ### Claim 7 (depends on 1) The method of claim 1 in which the first party vice provides a graphical interface to allow access by the second party for reviewing queued items. ### Claim 8 (depends on 1) The method of claim 1 in which said queuing includes providing a second party a link to the determined reference content. ### Claim 9 (depends on 1) The method of claim 1 in which said generating fingerprint data comprises comprising analyzing a transform domain representation of the user uploaded visual or audio content. ### Claim 10 (depends on 1) The method of claim 1 in which the data associated with the determined reference content comprises at least a portion of the reference content. ### Claim 11 A computer system comprising: a processor; a non-transitory computer-readable readable medium storing executable code, the code when executed by the processor causes the computer system to perform acts including: generating fingerprint data from user uploaded visual or audio content, the user uploaded visual or audio content having been uploaded by a user to a first party's online video service for distribution from the first party's online video service to the public, in which the user uploaded visual or audio content has been altered relative to a corresponding version of the user uploaded video or audio content; identifying reference content, from a universe of reference content, that is a possible match of the user uploaded visual or audio content, said identifying being based on the fingerprint data and being performed by a computer system configured to perform such act; queuing for review by a second party, different than the first party, the user uploaded visual or audio content item and data associated with the identified reference content; receiving assessment data from the second party, the assessment data indicating a result of a comparison of the user uploaded visual or audio content and the reference content by one or more human reviewer(s); using the assessment data in concluding that the reference content corresponds with the user uploaded visual or audio content; and limiting distribution of the user uploaded visual or audio content from the first party's online video service to the public based on the concluding. ### Claim 12 (depends on 11) The computer system of claim 11 in which the user uploaded visual or audio content has been intentionally altered to avoid fingerprint matching. ### Claim 13 (depends on 12) The computer system of claim 12 in which the user uploaded visual or audio content has been rotated. ### Claim 14 (depends on 11) The computer system of claim 11 further comprising code that when executed by the processor causes the computer system to perform an act of updating the universe of reference content with the user uploaded visual or audio content. ### Claim 15 (depends on 11) The computer system of claim 11 in which the limiting distribution comprises interrupting delivery to a public user. ### Claim 16 (depends on 15) The computer system of claim 15 further comprising code that when executed by the processor causes the computer system to perform an act of providing an explanatory message to the public user. ### Claim 17 (depends on 11) The computer system of claim 11 further comprising code that when executed by the processor causes the computer system to perform an act of providing a graphical interface to allow access by the second party for reviewing queued items. ### Claim 18 (depends on 11) The computer system of claim 11 in which said queuing includes providing the second party a link to the determined reference content. ### Claim 19 (depends on 11) The computer system of claim 11 that further comprises code that when executed by the processor causes analyzing a transform domain representation of the user uploaded visual or audio content. ### Claim 20 (depends on 11) The computer system of claim 11 in which the data associated with the determined reference content comprises at least a portion of the reference content.