# US 10,375,449 B2 · Discovering and displaying media content related to an electronic document

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,375,449 B2
- Document ID: US10375449B2
- Status: Granted
- Kind: B2
- Application number: 15/614,449
- Filed: 2017-06-05
- Published: 2017-11-23
- Granted: 2019-08-06
- Earliest claimed: 2012-06-27
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Dave Scott Fisher; Vincent Dureau; William Noah Schilit
- Web page: https://patentgrep.com/patent/US10375449B2

## CPC

- H04N 21/6581: {Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application}
- H04N 21/4112: {having fewer capabilities than the client, e.g. thin client having less processing power or no tuning capabilities}
- H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)}
- H04N 21/4782: Web browsing {, e.g. WebTV}
- H04N 21/482: End-user interface for programme selection
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems, computer-readable storage mediums, and methods for discovering and displaying media content related to an electronic document. At a first computing device, document identifying information—which is one of: at least a portion of a network identifier or source code for the electronic document—for the electronic document is obtained. One or more media entities associated with the electronic document are then obtained from a server. The media entities correspond to media content including scheduled TV programming, streaming media or locally stored media. A representation of a subset of the media entities is displayed, and a user selection from the representation of a respective media entity from the subset is obtained. In response, selection information identifying the respective media entity is sent to a second computing device, which is configured to access and display respective media content corresponding to the respective media entity based on the selection information.

## Claims

### Claim 1

A method comprising:
at a first computing device having one or more processors and memory storing one or more programs for execution by the one or more processors:
opening an electronic document and obtaining document identifying information for the electronic document, wherein the document identifying information is one of: at least a portion of a network identifier or source code for the electronic document;
after opening the electronic document, obtaining from a server one or more media entities associated with a subject of the electronic document, including one or more media entities not linked or included in the electronic document, wherein the media entities correspond to media content including scheduled TV programming, streaming media or locally stored media;
displaying, on the first computing device, a representation of at least a subset of the one or more media entities;
obtaining a user selection from the representation of a respective media entity from the at least a subset of the one or more media entities; and
in response to the user selection,
sending selection information identifying the respective media entity to a second computing device, the second computing device being configured to access and display respective media content corresponding to the respective media entity based on the selection information.

### Claim 2 (depends on 1)

The method of claim 1, wherein the electronic document is an electronic document opened in a document application on the first computing device.

### Claim 3 (depends on 1)

The method of claim 1, wherein the document application is a web browser and the electronic document is a web page.

### Claim 4 (depends on 1)

The method of claim 1, wherein the one or more programs includes a browser plug-in that performs the method of claim 1.

### Claim 5 (depends on 1)

The method of claim 1, further comprising, when the document identifying information includes at least a portion of a media content link that is readily identifiable by the first computing device, directly obtaining at the first computing device media entity associated with the at least a portion of the media content link, without involvement of the server.

### Claim 6 (depends on 1)

The method of claim 1, wherein, when the document identifying information is the at least a portion of a network identifier, the one or more obtained media entities include media entities recognized by a search engine while previously indexing the web page.

### Claim 7 (depends on 1)

The method of claim 1, wherein, when the document identifying information is the source code of the electronic document, the one or more obtained media entities include entities obtained by parsing the source code of the electronic document.

### Claim 8 (depends on 1)

The method of claim 1, wherein the one or more media entities are obtained based at least in part on one or more filtering criteria.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
obtaining a media entity that is related to the one or more media entities; and
displaying, on the first computing device, a representation of the related media entity.

### Claim 10 (depends on 1)

The method of claim 1, wherein the sending of the selection information is done via a local connection, from the first computing device, to the second computing device.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
during a display of the respective media content on the second computing device:
receiving, at the first computing device, a second user selection, and
sending a remote control command modifying the display of the respective media content, in accordance with the second user selection, to the second computing device.

### Claim 12 (depends on 1)

The method of claim 1, wherein obtaining one or more media entities associated with the electronic document includes:
sending a request to the server for media entities associated with the electronic document, the request including the document identifying information; and
receiving the one or more media entities from the server.

### Claim 13

A client system, comprising:
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
opening an electronic document and obtaining document identifying information for the electronic document, wherein the document identifying information is one of: at least a portion of a network identifier or source code for the electronic document;
after opening the electronic document, obtaining from a server one or more media entities associated with a subject of the electronic document, including one or more media entities not linked or included in the electronic document, wherein the media entities correspond to media content including scheduled TV programming, streaming media or locally stored media;
displaying, on the first computing device, a representation of at least a subset of the one or more media entities;
obtaining a user selection from the representation of a respective media entity from the at least a subset of the one or more media entities; and
in response to the user selection,
sending selection information identifying the respective media entity to a second computing device, the second computing device being configured to access and display respective media content corresponding to the respective media entity based on the selection information.

### Claim 14 (depends on 13)

The client system of claim 13, wherein the document application is a web browser and the electronic document is a web page.

### Claim 15 (depends on 13)

The client system of claim 13, wherein the one or more programs includes a browser plug-in that includes the instructions.

### Claim 16 (depends on 13)

The client system of claim 13, wherein the one or more program further comprising instructions for:
when the document identifying information includes at least a portion of a media content link that is readily identifiable by the first computing device, directly obtaining at the first computing device media entity associated with the at least a portion of the media content link, without involvement of the server.

### Claim 17

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computer system with one or more processors, cause the computer system to:
open an electronic document and obtain document identifying information for the electronic document, wherein the document identifying information is one of: at least a portion of a network identifier or source code for the electronic document;
after opening the electronic document, obtain from a server one or more media entities associated with a subject of the electronic document, including one or more media entities not linked or included in the electronic document, wherein the media entities correspond to media content including scheduled TV programming, streaming media or locally stored media;
display, on the first computing device, a representation of at least a subset of the one or more media entities;
obtain a user selection from the representation of a respective media entity from the at least a subset of the one or more media entities; and
in response to the user selection,
send selection information identifying the respective media entity to a second computing device, the second computing device being configured to access and display respective media content corresponding to the respective media entity based on the selection information.

### Claim 18 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein the document application is a web browser and the electronic document is a web page.

### Claim 19 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein the one or more programs includes a browser plug-in that includes the instructions.

### Claim 20 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein the one or more program further comprising instructions for:
when the document identifying information includes at least a portion of a media content link that is readily identifiable by the first computing device, directly obtaining at the first computing device media entity associated with the at least a portion of the media content link, without involvement of the server.
