# US 10,482,127 B2 · Viewing suggestions based on closed-captioned content from multiple tuners

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,482,127 B2
- Document ID: US10482127B2
- Status: Granted
- Kind: B2
- Application number: 15/872,597
- Filed: 2018-01-16
- Published: 2018-07-05
- Granted: 2019-11-19
- Earliest claimed: 2016-12-30
- Assignees: DISH Technologies L.L.C.
- Applicants: DISH Technologies L.L.C.
- Inventors: Jesus Flores Guerra
- Web page: https://patentgrep.com/patent/US10482127B2

## CPC

- G06F 16/7867: {using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings}
- H04N 21/4263: {involving specific tuning arrangements, e.g. two tuners}
- H04N 21/435: Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/47214: {for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market (stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224)}
- H04N 21/4755: {for defining user preferences, e.g. favourite actors or genre (retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306)}
- H04N 21/4826: {using recommendation lists, e.g. of programmes or channels sorted out according to their score}
- H04N 21/4884: {for displaying subtitles}
- H04N 21/8405: represented by keywords
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Described are systems, methods and computer program products for suggesting television programs to a user by, for example, analyzing closed caption or subtitle content of unwatched or unrecorded video content to determine if the video content is of interest to the user. The user may indicate one or more keywords for use in the analysis and the analysis may scan the text of the closed caption or subtitle content to identify matches to the keywords. Beside user input keywords, the keywords may also be determined through analysis of video content watched or recorded by the user to determine frequently encountered words. These frequently encountered words may automatically be used in matching the text of the closed caption or subtitle content. The users may also or alternatively select particular words of the frequently encountered words to use for matching.

## Claims

### Claim 1

A television receiver, comprising:
one or more processors;
a plurality of tuners communicatively coupled with the one or more processors;
an audio-video output interface communicatively coupled with the one or more processors; and
a non-transitory computer readable storage medium communicatively coupled with and readable by the one or more processors and having stored therein processor-readable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations including:
receiving input corresponding to determination of one or more user-designated keywords;
receiving first program content using an active tuner of the plurality of tuners;
outputting the first program content using the audio-video output interface for display on a display device;
receiving second program content using an inactive tuner of the plurality of tuners;
obtaining text data corresponding to an audio portion of the second program content;
determining that a first keyword of the one or more user-designated keywords appears in the text data; and
generating a first interface for output by the audio-video output interface for display on the display device in real-time upon determining that the first keyword appears in the text data, wherein the first interface includes a notification identifying a match of the first keyword.

### Claim 2 (depends on 1)

The television receiver of claim 1, wherein the inactive tuner corresponds to a tuner of the plurality of tuners that is not being actively used to output live program content for display on the display device or to record program content according to a recording schedule or timer.

### Claim 3 (depends on 1)

The television receiver of claim 1, wherein obtaining the text data includes one or more of:
decoding a closed caption portion of the second program content to generate the text data,
decoding a subtitle portion of the second program content to generate the text data,
retrieving the text data from a network location,
processing the audio portion of the second program content using a speech-to-text algorithm to generate the text data, or
rendering embedded closed captions or subtitles of the second program content and generating the text data by performing character recognition on the embedded closed captions or subtitles.

### Claim 4 (depends on 1)

The television receiver of claim 1, wherein the input corresponds to user entry of the one or more user-designated keywords or to user selection of one or more user-designated keywords from a word list.

### Claim 5 (depends on 1)

The television receiver of claim 1, wherein the operations further comprise:
automatically determining one or more additional keywords without user input;
determining that a second keyword of the one or more additional keywords appears in the text data; and
generating a second interface for output by the audio-video output interface for display on the display device in real-time upon determining that the second keyword appears in the text data, wherein the second interface identifies the second keyword and the second program content.

### Claim 6 (depends on 5)

The television receiver of claim 5, wherein automatically determining the one or more additional keywords without user input includes:
monitoring recorded or watched text data corresponding to audio portions of at least one of program content recorded by the television receiver and program content output by the audio-video output interface for immediate display on the display device;
evaluating the recorded or watched text data to rank words appearing in the watched or recorded text data by frequency; and
adding one or more words appearing in the recorded or watched text data having rankings greater than a threshold ranking to a word list corresponding to the one or more additional keywords.

### Claim 7 (depends on 1)

The television receiver of claim 1, wherein the first interface requests selection of a command, wherein the command corresponds to at least one of:
record the second program content,
immediately output the second program content for display on the display device, or
ignore the second program content.

### Claim 8 (depends on 1)

The television receiver of claim 1, wherein the first interface corresponds to a notification overlaid on a graphical user interface, an electronic programming guide, or other program content being output by the audio-video output interface for display on the display device.

### Claim 9 (depends on 1)

The television receiver of claim 1, further comprising:
receiving second program content using a second inactive tuner of the plurality of tuners;
obtaining second text data corresponding to audio of the second program content;
determining that a second keyword of the one or more user-designated keywords appears in the second text data; and
generating a second interface for output by the audio-video output interface for display on the display device in real-time upon determining that the second keyword appears in the second text data, wherein the second interface identifies the second keyword and the second program content.

### Claim 10

A method, comprising:
receiving, by a television receiver, input corresponding to determination of one or more user-designated keywords;
receiving, by the television receiver, first program content using an active tuner of the television receiver;
outputting, by the television receiver, the first program content for display by a display device;
receiving, by the television receiver, second program content using an inactive tuner of the television receiver;
obtaining, by the television receiver, text data corresponding to an audio portion of the second program content;
determining, by the television receiver, that a first keyword of the one or more user-designated keywords appears in the text data; and
generating, by the television receiver, a first interface for display on the display device in real-time upon determining that the first keyword appears in the text data, wherein the first interface includes a notification identifying a match of the first keyword.

### Claim 11 (depends on 10)

The method of claim 10, wherein obtaining the text data includes one or more of:
decoding a closed caption portion of the second program content to generate the text data,
decoding a subtitle portion of the second program content to generate the text data,
retrieving the text data from a network location,
processing the audio portion of the second program content using a speech-to-text algorithm to generate the text data, or
rendering embedded closed captions or subtitles of the second program content and generating the text data by performing character recognition on the embedded closed captions or subtitles.

### Claim 12 (depends on 10)

The method of claim 10, further comprising
automatically determining one or more additional keywords without user input;
determining that a second keyword of the one or more additional keywords appears in the text data; and
generating a second interface for display on the display device in real-time upon determining that the second keyword appears in the text data, wherein the second interface identifies the second keyword and the second program content.

### Claim 13 (depends on 12)

The method of claim 12, wherein automatically determining the one or more additional keywords without user input includes:
monitoring recorded or watched text data corresponding to audio portions of at least one of program content recorded by the television receiver and program content output by the television receiver for immediate display on the display device;
evaluating the recorded or watched text data to rank words appearing in the watched or recorded text data by frequency; and
adding one or more words appearing in the recorded or watched text data having rankings greater than a threshold ranking to a word list corresponding to the one or more additional keywords.

### Claim 14 (depends on 10)

The method of claim 10, wherein the first interface requests selection of a command, wherein the command corresponds to at least one of:
record the second program content,
immediately output the second program content for display on the display device, or
ignore the second program content.

### Claim 15 (depends on 10)

The method of claim 10, further comprising:
receiving, by the television receiver, second program content using a second inactive tuner of the television receiver;
obtaining, by the television receiver, second text data corresponding to audio of the second program content;
determining, by the television receiver, that a second keyword of the one or more user-designated keywords appears in the second text data; and
generating, by the television receiver, a second interface for display on the display device in real-time upon determining that the second keyword appears in the second text data, wherein the second interface identifies the second keyword and the second program content.

### Claim 16

A non-transitory computer readable storage medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations including:
receiving input corresponding to determination of one or more user-designated keywords;
receiving first program content using an active tuner;
outputting the first program content for display by a display device;
receiving second program content using an inactive tuner;
obtaining text data corresponding to an audio portion of the second program content;
determining that a first keyword of the one or more user-designated keywords appears in the text data; and
generating a first interface for display on the display device in real-time upon determining that the first keyword appears in the text data, wherein the first interface includes a notification identifying a match of the first keyword.

### Claim 17 (depends on 16)

The non-transitory computer readable storage medium of claim 16, wherein obtaining the text data includes one or more of:
decoding a closed caption portion of the second program content to generate the text data,
decoding a subtitle portion of the second program content to generate the text data,
retrieving the text data from a network location,
processing the audio portion of the second program content using a speech-to-text algorithm to generate the text data, or
rendering embedded closed captions or subtitles of the second program content and generating the text data by performing character recognition on the embedded closed captions or subtitles.

### Claim 18 (depends on 16)

The non-transitory computer readable storage medium of claim 16, wherein the operations further include:
automatically determining one or more additional keywords without user input;
determining that a second keyword of the one or more additional keywords appears in the text data; and
generating a second interface for display on the display device in real-time upon determining that the second keyword appears in the text data, wherein the second interface identifies the second keyword and the second program content.

### Claim 19 (depends on 18)

The non-transitory computer readable storage medium of claim 18, wherein automatically determining the one or more additional keywords without user input includes:
monitoring recorded or watched text data corresponding to audio portions of at least one of program content being instantly recorded and program content output for immediate display on the display device;
evaluating the recorded or watched text data to rank words appearing in the watched or recorded text data by frequency; and
adding one or more words appearing in the recorded or watched text data having rankings greater than a threshold ranking to a word list corresponding to the one or more additional keywords.

### Claim 20 (depends on 16)

The non-transitory computer readable storage medium of claim 16, wherein the operations further include:
receiving second program content using a second inactive tuner;
obtaining second text data corresponding to audio of the second program content;
determining that a second keyword of the one or more user-designated keywords appears in the second text data; and
generating a second interface for display on the display device in real-time upon determining that the second keyword appears in the second text data, wherein the second interface identifies the second keyword and the second program content.
