# US 2023/0276090 A1 · Media channel identification and action, with disambiguation through client-side fingerprint matching of channel-specific icon

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0276090 A1
- Document ID: US20230276090A1
- Status: Published application
- Kind: A1
- Application number: 18/309,989
- Filed: 2023-05-01
- Published: 2023-08-31
- Earliest claimed: 2020-12-16
- Assignees: Roku, Inc.
- Applicants: Roku, Inc.
- Inventors: Andreas Schmidt; Shashank Merchant; Markus Kurt Peter Cremer
- Web page: https://patentgrep.com/patent/US20230276090A1

## CPC

- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement}
- H04N 21/4314: {for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid}
- H04N 21/44204: {Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched (monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31)}
- H04N 21/654: Transmission by server directed to the client
- H04N 21/6543: for forcing some client operations, e.g. recording {(remote booting in general G06F9/4416)}
- H04N 21/6581: {Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application}
- H04N 21/6582: {Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38)}
- H04N 21/8153: {comprising still images, e.g. texture, background image}
- H04N 21/8352: involving content or source identification data, e.g. Unique Material Identifier [UMID]
- H04N 21/44016: {involving splicing one content stream with another content stream, e.g. for substituting a video clip}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed is a method that includes a media presentation device (i) generating query fingerprint data representing video frames of a channel being rendered by the media presentation device, and transmitting the generated query fingerprint data from the device over a network to a server, (ii) responsive to transmitting the query fingerprint data to the server, receiving, from the server, channel-icon fingerprint data representing channel icons of multiple channels selected based at least on the server having detected that the query fingerprint data representing the video frames of the channel being rendered by the media presentation device matches the reference fingerprint data representing the frames of the multiple channels of video content, and (iii) responsive to receiving the channel-icon fingerprint data from the server, performing channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device.

## Claims

### Claim 1

A method comprising:
generating, by a media presentation device, query fingerprint data representing one or more video frames of a channel being rendered by the media presentation device, and transmitting the generated query fingerprint data from the media presentation device over a network to a server;
responsive to transmitting the query fingerprint data to the server, receiving by the media presentation device and from the server, channel-icon fingerprint data including channel-icon characteristics and fingerprint-generation techniques selected based on the channel-icon characteristics for multiple channels based at least on the server having detected that the query fingerprint data representing the one or more video frames of the channel being rendered matches reference fingerprint data of the multiple channels;
generating a query channel-icon fingerprint representing an in-frame region at which the channel presents the channel's respective channel icon by applying the indicated fingerprint-generation techniques;
comparing the generated query channel-icon fingerprint with reference channel-icon fingerprints representing channel icons specific to the multiple channels so as to determine which channel of the multiple channels is being rendered by the media presentation device.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
generating the query fingerprint over a course of multiple frames of the channel; and
averaging the multiples frames to establish a composite query fingerprint representing the query fingerprint.

### Claim 3 (depends on 1)

The method of claim 1, further comprising based on determining which channel of the multiples channels is being rendered by the media presentation device, notifying the server or another entity to take a specific action for the channel.

### Claim 4 (depends on 3)

The method of claim 3, wherein the specific action for the channel comprises:
reporting the identification of the channel,
recording ratings data, or
enabling dynamic ad insertion.

### Claim 5 (depends on 1)

The method of claim 1, wherein the media presentation device is a television.

### Claim 6 (depends on 1)

The method of claim 1, wherein the channel-icon fingerprint data further includes, for each of the multiple channels, coordinates defining an in-frame region at which the channel presents the a icon specific to each of the multiple channels.

### Claim 7 (depends on 6)

The method of claim 6, wherein the in-frame region is defined by exclusion, with a mask defining which pixels in a frame are absent from the in-frame region.

### Claim 8

A non-transitory computer readable medium with instructions stored thereon, that when processed by one or more processors of a media presentation device, perform the operations comprising:
generating query fingerprint data representing one or more video frames of a channel being rendered by the media presentation device, and transmitting the generated query fingerprint data from the media presentation device over a network to a server;
responsive to transmitting the query fingerprint data to the server, receiving, from the server, channel-icon fingerprint data including channel-icon characteristics and fingerprint-generation techniques selected based on the channel-icon characteristics for multiple channels based at least on the server having detected that the query fingerprint data representing the one or more video frames of the channel being rendered matches reference fingerprint data of the multiple channels;
generating a query channel-icon fingerprint representing an in-frame region at which the channel presents the channel's respective channel icon by applying the indicated fingerprint-generation techniques;
comparing the generated query channel-icon fingerprint with reference channel-icon fingerprints representing channel icons specific to the multiple channels so as to determine which channel of the multiple channels is being rendered by the media presentation device.

### Claim 9 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the operations further comprise:
generating the query fingerprint over a course of multiple frames of the channel; and
averaging the multiples frames to establish a composite query fingerprint representing the query fingerprint.

### Claim 10 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the operations further comprise, based on determining which channel of the multiples channels is being rendered by the media presentation device, notifying the server or another entity to take a specific action for the channel.

### Claim 11 (depends on 10)

The non-transitory computer readable medium of claim 10, wherein the specific action for the channel comprises:
reporting the identification of the channel,
recording ratings data, or
enabling dynamic ad insertion.

### Claim 12 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the media presentation device is a television.

### Claim 13 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the channel-icon fingerprint data further includes, for each of the multiple channels, coordinates defining an in-frame region at which the channel presents the a icon specific to each of the multiple channels.

### Claim 14 (depends on 13)

The non-transitory computer readable medium of claim 13, wherein the in-frame region is defined by exclusion, with a mask defining which pixels in a frame are absent from the in-frame region.

### Claim 15

A media presentation device comprising:
a memory storing instructions;
one or more processors, coupled to the memory and configured to process the stored instructions to:
generate query fingerprint data representing one or more video frames of a channel being rendered by the media presentation device, for transmission from the media presentation device over a network to a server;
responsive to transmission of the query fingerprint data to the server, receive, from the server, channel-icon fingerprint data including channel-icon characteristics and fingerprint-generation techniques selected based on the channel-icon characteristics for multiple channels based at least on the server having detected that the query fingerprint data representing the one or more video frames of the channel being rendered matches reference fingerprint data of the multiple channels;
generate a query channel-icon fingerprint representing an in-frame region at which the channel presents the channel's respective channel icon by applying the indicated fingerprint-generation techniques;
compare the generated query channel-icon fingerprint with reference channel-icon fingerprints representing channel icons specific to the multiple channels so as to determine which channel of the multiple channels is being rendered by the media presentation device.

### Claim 16 (depends on 15)

The media presentation device of claim 15, wherein the one or more processors are further configured to:
generate the query fingerprint over a course of multiple frames of the channel; and
average the multiples frames to establish a composite query fingerprint representing the query fingerprint.

### Claim 17 (depends on 15)

The media presentation device of claim 15, wherein the one or more processors are further configured to, based on determining which channel of the multiples channels is being rendered by the media presentation device, generate a notification to the server or another entity to take a specific action for the channel.

### Claim 18 (depends on 17)

The media presentation device of claim 17, wherein the specific action for the channel comprises:
reporting the identification of the channel,
recording ratings data, or
enabling dynamic ad insertion.

### Claim 19 (depends on 15)

The media presentation device of claim 15, wherein the media presentation device is a television.

### Claim 20 (depends on 15)

The media presentation device of claim 15, wherein the channel-icon fingerprint data further includes:
for each of the multiple channels, coordinates defining an in-frame region at which the channel presents the a icon specific to each of the multiple channels; and
wherein the in-frame region is defined by exclusion, with a mask defining which pixels in a frame are absent from the in-frame region.
