# US 2012/0254404 A1 · Multi-tiered automatic content recognition and processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254404 A1
- Document ID: US20120254404A1
- Status: Published application
- Kind: A1
- Application number: 13/101,643
- Filed: 2011-05-05
- Published: 2012-10-04
- Earliest claimed: 2011-04-04
- Assignees: NBCUniversal Media, LLC
- Inventors: Michael Shane Wilkinson; Thomas Bause; Arturo Vermolen; Sheau Ng; John Sullivan
- Web page: https://patentgrep.com/patent/US20120254404A1

## CPC

- H04L 67/303: Terminal profiles
- G06F 16/185: Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof (details of archiving G06F16/11)
- G06F 16/41: Indexing; Data structures therefor; Storage structures
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- H04N 21/2407: {Monitoring of transmitted content, e.g. distribution time, number of downloads (arrangements for monitoring programmes for broadcast or for distribution combined with broadcast H04H20/14)}
- H04N 21/25808: {Management of client data (terminal profiles in network data switching protocols H04L67/303)}
- H04N 21/25866: {Management of end-user data (customer care in data networks H04L41/5077)}
- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/6582: {Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38)}
- H04N 21/8352: involving content or source identification data, e.g. Unique Material Identifier [UMID]
- H04N 21/8358: involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)}
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A multi-tiered approach to identifying digital content and acting upon the identification includes transmitting data from a device on which the content is stored or played to a first tier entity where the content and the device are identified. The first tier entity may use any one of many techniques for identifying the data and device. Once the identification data is determined, the information is transmitted to any one of multiple second tier entities that work in cooperation with the first tier entity. The second tier entities may then perform any desired functions based on the identification, such as providing offers, content, products and/or services to the device, or to other devices associated with the device or the device user. Other tiers may be employed for carrying out particular functions or activities, such as under the direction of the second tier entities.

## Claims

### Claim 1

A multi-tiered automatic content recognition and processing method, comprising:
in a first tier entity, receiving electronic device data;
analyzing, in the first tier entity, the electronic device data to identify the electronic device and data indicative of digital content being played on the electronic device;
analyzing, in the first tier entity, the data indicative of the digital content to identify the digital content; and
transmitting from the first tier entity to an appropriate one of a plurality of second tier entities the identity of the electronic device and the identity of the digital content to facilitate activity between the second tier entity and the electronic device based upon the identified content.

### Claim 2 (depends on 1)

The method of claim 1, wherein the content is identified by identification code embedded in the content.

### Claim 3 (depends on 1)

The method of claim 1, wherein the content is identified by a digital watermark.

### Claim 4 (depends on 1)

The method of claim 1, wherein the content is identified by a digital signature created by the electronic device or by the first tier entity.

### Claim 5 (depends on 1)

The method of claim 1, comprising selecting, in the first tier entity, one of a plurality of content identification techniques based upon the electronic device data, and wherein the digital content is identified based upon the selected content identification technique.

### Claim 6 (depends on 1)

The method of claim 1, wherein the digital content is identified based upon more than one content identification techniques.

### Claim 7 (depends on 1)

The method of claim 1, comprising selecting the appropriate one of the plurality of second tier entities based upon the identity of the digital content.

### Claim 8 (depends on 1)

The method of claim 1, comprising reporting to each of the plurality of second tier entities data indicative of at least a number of incidents of identification of an electronic device and digital content for each respective second tier entity.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first tier entity provides code to a provider of the digital content for facilitating identification of the digital content by the first tier entity.

### Claim 10

A multi-tiered automatic content recognition and processing system, comprising:
in a first tier entity, a database comprising data corresponding to digital content of a plurality of second tier entities;
in the first tier entity, a content recognition component configured to receive electronic device data, to analyze the electronic device data to identify the electronic device and data indicative of digital content being played on the electronic device, and to analyze the data indicative of the digital content to identify the digital content based upon the database; and
in the first tier entity, a transmission component configured transmit to an appropriate one of the plurality of second tier entities the identity of the electronic device and the identity of the digital content to facilitate activity between the second tier entity and the electronic device based upon the identified content.

### Claim 11 (depends on 10)

The system of claim 10, wherein the content identification component selects one of a plurality of content identification techniques based upon the electronic device data, and wherein the digital content is identified based upon the selected content identification technique.

### Claim 12 (depends on 10)

The system of claim 10, wherein the content identification component identifies the digital content based upon more than one content identification techniques.

### Claim 13 (depends on 10)

The system of claim 10, comprising a plurality of second tier entities linked to allow for data exchange with the first tier entity, the first tier entity selecting the appropriate one of the plurality of second tier entities for data transmission based upon the identity of the digital content.

### Claim 14 (depends on 13)

The system of claim 13, wherein the second tier entities are configured to perform services, or to offer services or products to the identified electronic devices based upon the identified digital content.

### Claim 15

A multi-tiered automatic content recognition and processing method, comprising:
in a first tier entity, receiving electronic device data, analyzing the electronic device data to identify the electronic device and data indicative of digital content being played on the electronic device, analyzing the data indicative of the digital content to identify the digital content, and transmitting from the first tier entity to an appropriate one of a plurality of second tier entities the identity of the electronic device and the identity of the digital content to facilitate activity between the second tier entity and the electronic device based upon the identified content; and
in at least one of the second tier entities performing a product and/or service function based upon the identified digital content, or coordinating with a further tier entity to do so.

### Claim 16 (depends on 15)

The method of claim 15, wherein the second tier entity performs the product and/or service function or coordinates with a further tier entity to do so via communication with the electronic device.

### Claim 17 (depends on 15)

The method of claim 15, wherein at least one of the second tier entities performs the product and/or service function or coordinates with a further tier entity to do so via communication with a different electronic device.

### Claim 18 (depends on 15)

The method of claim 15, wherein for identification of the content, the first tier entity references a database that comprises data provided by each of the second tier entities for identifying its digital content.

### Claim 19

A multi-tiered automatic content recognition and processing system, comprising:
a first tier entity configured to receive electronic device data, to analyze the electronic device data to identify the electronic device and data indicative of digital content being played on the electronic device, to analyze the data indicative of the digital content to identify the digital content, and to transmit from the first tier entity to an appropriate one of a plurality of second tier entities the identity of the electronic device and the identity of the digital content to facilitate activity between the second tier entity and the electronic device based upon the identified content; and
a plurality of second tier entities configured to perform a product or service function based upon the identified digital content, or coordinating with a further tier entity to do so.

### Claim 20 (depends on 19)

The system of claim 19, comprising at least one additional tier entity in data communication with at least one of the second tier entities and configured to perform a product and/or service function with the identified electronic devices upon instruction from the respective second tier entity.

### Claim 21 (depends on 19)

The system of claim 19, wherein the second or an additional tier entity is configured to perform a product and/or service function with a different electronic device based upon the identified electronic device and the identified digital content.

### Claim 22

A multi-tiered automatic content recognition and processing method, comprising:
in a plurality of second tier entities, receiving from a first tier entity an identity of an electronic device playing digital content, and an identification of the digital content; and
performing a product and/or service function based upon the identified electronic device and the identified digital content, or coordinating with a further tier entity to do so.

### Claim 23 (depends on 22)

The method of claim 22, wherein the product and/or service function is performed by transmission of data to the electronic device.

### Claim 24 (depends on 22)

The method of claim 22, wherein the product and/or service function is performed by transmission of data to a different electronic device.

### Claim 25 (depends on 22)

The method of claim 22, wherein each of the second tier entities provides data to the first tier entity for identification of the digital content.

### Claim 26 (depends on 22)

The method of claim 22, wherein each of the second tier entities stipulates to the first tier entity particular digital content to be identified by the first tier entity.

### Claim 27

A multi-tiered automatic content recognition and processing method, comprising:
in a first tier entity, receiving electronic device data;
analyzing, in the first tier entity, the electronic device data to identify the electronic device and data indicative of digital content being played on the electronic device;
monitoring, in the first tier entity, the data indicative of the digital content to identify the digital content; and
reporting to each of the plurality of second tier entities data indicative of at least a number of incidents of identification of an electronic device and digital content for each respective second tier entity.

### Claim 28 (depends on 27)

The method of claim 27, comprising transmitting from the first tier entity to an appropriate one of a plurality of second tier entities the identity of the electronic device and the identity of the digital content to facilitate activity between the second tier entity and the electronic device based upon the identified content.
