# US 2022/0191588 A1 · Media Channel Identification and Action, with Disambiguation Through Client-Side Fingerprint Matching of Channel-Specific Icon

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0191588 A1
- Document ID: US20220191588A1
- Status: Published application
- Kind: A1
- Application number: 17/644,660
- Filed: 2021-12-16
- Published: 2022-06-16
- Earliest claimed: 2020-12-16
- Assignees: Roku, Inc.
- Applicants: Roku, Inc.
- Inventors: Andreas Schmidt; Shashank Merchant; Markus Kurt Peter Cremer
- Web page: https://patentgrep.com/patent/US20220191588A1

## CPC

- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement}
- H04N 21/4314: {for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid}
- H04N 21/44204: {Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched (monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31)}
- H04N 21/654: Transmission by server directed to the client
- H04N 21/6543: for forcing some client operations, e.g. recording {(remote booting in general G06F9/4416)}
- H04N 21/6581: {Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application}
- H04N 21/6582: {Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38)}
- H04N 21/8153: {comprising still images, e.g. texture, background image}
- H04N 21/8352: involving content or source identification data, e.g. Unique Material Identifier [UMID]
- H04N 21/44016: {involving splicing one content stream with another content stream, e.g. for substituting a video clip}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed is a method that includes a media presentation device (i) generating query fingerprint data representing video frames of a channel being rendered by the media presentation device, and transmitting the generated query fingerprint data from the device over a network to a server, (ii) responsive to transmitting the query fingerprint data to the server, receiving, from the server, channel-icon fingerprint data representing channel icons of multiple channels selected based at least on the server having detected that the query fingerprint data representing the video frames of the channel being rendered by the media presentation device matches the reference fingerprint data representing the frames of the multiple channels of video content, and (iii) responsive to receiving the channel-icon fingerprint data from the server, performing channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device.

## Claims

### Claim 1

A method comprising:
generating, by a media presentation device, query fingerprint data representing video frames of a channel being rendered by the media presentation device, and transmitting the generated query fingerprint data from the media presentation device over a network to a server;
responsive to transmitting the query fingerprint data to the server, receiving by the media presentation device, from the server, channel-icon fingerprint data representing channel icons of multiple channels selected based at least on the server having detected that the query fingerprint data representing the video frames of the channel being rendered by the media presentation device matches the reference fingerprint data representing the frames of the multiple channels of video content; and
responsive to receiving the channel-icon fingerprint data from the server, performing by the media presentation device channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the channel-icon fingerprint data includes, respectively for each channel in the multiple channels of video content, a reference channel-icon fingerprint representing a channel icon specific to the channel.

### Claim 3 (depends on 2)

The method of claim 2, wherein each channel in the multiple channels of video content presents in a respective in-frame region the channel icon specific to the channel, and wherein the channel-icon fingerprint data further includes, respectively for each channel in the multiple channels of video content, coordinates defining the in-frame region at which the channel presents the channel icon specific to the channel.

### Claim 4 (depends on 3)

The method of claim 3, wherein performing by the media presentation device channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device comprises:
generating by the media presentation device query channel-icon fingerprints representing the in-frame regions at which the channels in the multiple channels of video content present their respective channel icons; and
comparing the generated query channel-icon fingerprints with the reference channel-icon fingerprints representing the channel icons specific to the multiple channels of video content, so as to determine which channel of the multiple channels is being rendered by the media presentation device.

### Claim 5 (depends on 4)

The method of claim 4, wherein the channel icon respectively of each channel in the multiple channels of video content has a respective channel-icon characteristic, the method further comprising, for at least one channel in the multiple channels of video content:
receiving, by the media presentation device, in the channel-icon fingerprint data an indication of a fingerprint-generation technique determined by the server to be suitable for the channel's respective channel-icon characteristic; and
applying, by the media presentation device, the indicated fingerprint-generation technique for generating the query channel-icon fingerprint representing the in-frame region at which the channel presents the channel's respective channel icon.

### Claim 6 (depends on 1)

The method of claim 1, further comprising, after determining based on the channel-icon fingerprint matching which channel in the multiple channels is the channel being rendered by the media presentation device, transmitting from the media presentation device to the server a report of the determined channel.

### Claim 7 (depends on 1)

The method of claim 1, wherein the media presentation device is a television.

### Claim 8

A media presentation device comprising:
a media input interface through which to receive video content to be presented by the media presentation device, wherein the video content includes video frames;
a media presentation interface for presenting the received video content; and
a network communication interface,
wherein the media presentation device is configured to generate query fingerprint data representing video frames of a channel being rendered by the media presentation device, and to transmit the generated query fingerprint data through the network communication interface to a server,
wherein the media presentation device is configured to receive from the server, responsive to transmitting the query fingerprint data to the server, channel-icon fingerprint data representing channel icons of multiple channels selected based at least on the server having detected that the query fingerprint data representing the video frames of the channel being rendered by the media presentation device matches the reference fingerprint data representing the frames of the multiple channels of video content, and
wherein the media presentation device is configured to respond to receiving the channel-icon fingerprint data from the server by performing channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device.

### Claim 9 (depends on 8)

The media presentation device of claim 8, wherein the channel-icon fingerprint data includes, respectively for each channel in the multiple channels of video content, a reference channel-icon fingerprint representing a channel icon specific to the channel.

### Claim 10 (depends on 9)

The media presentation device of claim 9, wherein each channel in the multiple channels of video content presents in a respective in-frame region the channel icon specific to the channel, and wherein the channel-icon fingerprint data further includes, respectively for each channel in the multiple channels of video content, coordinates defining the in-frame region at which the channel presents the channel icon specific to the channel.

### Claim 11 (depends on 10)

The media presentation device of claim 10, wherein performing by the media presentation device channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device comprises:
generating by the media presentation device query channel-icon fingerprints representing the in-frame regions at which the channels in the multiple channels of video content present their respective channel icons; and
comparing the generated query channel-icon fingerprints with the reference channel-icon fingerprints representing the channel icons specific to the multiple channels of video content, so as to determine which channel of the multiple channels is being rendered by the media presentation device.

### Claim 12 (depends on 11)

The media presentation device of claim 11, wherein the channel icon respectively of each channel in the multiple channels of video content has a respective channel-icon characteristic, and wherein the media presentation device is further configured to carry out the following operations for at least one channel in the multiple channels of video content:
receiving, by the media presentation device, in the channel-icon fingerprint data an indication of a fingerprint-generation technique determined by the server to be suitable for the channel's respective channel-icon characteristic; and
applying, by the media presentation device, the indicated fingerprint-generation technique for generating the query channel-icon fingerprint representing the in-frame region at which the channel presents the channel's respective channel icon.

### Claim 13 (depends on 8)

The media presentation device of claim 8, further comprising, after determining based on the channel-icon fingerprint matching which channel in the multiple channels is the channel being rendered by the media presentation device, transmitting from the media presentation device to the server a report of the determined channel.

### Claim 14 (depends on 8)

The media presentation device of claim 8, wherein the media presentation device is a television.

### Claim 15

Non-transitory data storage having stored program instructions executable by a processing unit to cause a media presentation device to carry out operations including:
generating query fingerprint data representing video frames of a channel being rendered by the media presentation device, and transmitting the generated query fingerprint data from the media presentation device over a network to a server;
responsive to transmitting the query fingerprint data to the server, receiving from the server channel-icon fingerprint data representing channel icons of multiple channels selected based at least on the server having detected that the query fingerprint data representing the video frames of the channel being rendered by the media presentation device matches the reference fingerprint data representing the frames of the multiple channels of video content; and
responsive to receiving the channel-icon fingerprint data from the server, performing channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device.

### Claim 16 (depends on 15)

The non-transitory data storage of claim 15, wherein the channel-icon fingerprint data includes, respectively for each channel in the multiple channels of video content, a reference channel-icon fingerprint representing a channel icon specific to the channel.

### Claim 17 (depends on 16)

The non-transitory data storage of claim 16, wherein each channel in the multiple channels of video content presents in a respective in-frame region the channel icon specific to the channel, and wherein the channel-icon fingerprint data further includes, respectively for each channel in the multiple channels of video content, coordinates defining the in-frame region at which the channel presents the channel icon specific to the channel.

### Claim 18 (depends on 17)

The non-transitory data storage of claim 17, wherein performing channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device comprises:
generating query channel-icon fingerprints representing the in-frame regions at which the channels in the multiple channels of video content present their respective channel icons; and
comparing the generated query channel-icon fingerprints with the reference channel-icon fingerprints representing the channel icons specific to the multiple channels of video content, so as to determine which channel of the multiple channels is being rendered by the media presentation device.

### Claim 19 (depends on 18)

The non-transitory data storage of claim 18, wherein the channel icon respectively of each channel in the multiple channels of video content has a respective channel-icon characteristic, the operations further including, for at least one channel in the multiple channels of video content:
receiving, in the channel-icon fingerprint data, an indication of a fingerprint-generation technique determined by the server to be suitable for the channel's respective channel-icon characteristic; and
applying the indicated fingerprint-generation technique for generating the query channel-icon fingerprint representing the in-frame region at which the channel presents the channel's respective channel icon.

### Claim 20 (depends on 19)

The non-transitory data storage of claim 19, wherein the operations additionally include:
after determining based on the channel-icon fingerprint matching which channel in the multiple channels is the channel being rendered by the media presentation device, transmitting to the server a report of the determined channel.
