# US 2019/0379946 A1 · Discovering and displaying media content related to an electronic document

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0379946 A1
- Document ID: US20190379946A1
- Status: Published application
- Kind: A1
- Application number: 16/532,202
- Filed: 2019-08-05
- Published: 2019-12-12
- Earliest claimed: 2012-06-27
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Dave Scott Fisher; Vincent Dureau; William Noah Schilit
- Web page: https://patentgrep.com/patent/US20190379946A1

## CPC

- H04N 21/6581: {Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application}
- H04N 21/4112: {having fewer capabilities than the client, e.g. thin client having less processing power or no tuning capabilities}
- H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)}
- H04N 21/4782: Web browsing {, e.g. WebTV}
- H04N 21/482: End-user interface for programme selection
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems, computer-readable storage mediums, and methods for discovering and displaying media content related to an electronic document. At a first computing device, document identifying information—which is one of: at least a portion of a network identifier or source code for the electronic document—for the electronic document is obtained. One or more media entities associated with the electronic document are then obtained from a server. A representation of a subset of the media entities is displayed, and a user selection from the representation of a respective media entity from the subset is obtained. In response, the respective media entity is displayed.

## Claims

### Claim 1

A method comprising:
at a first computing device having one or more processors and memory storing one or more programs for execution by the one or more processors:
opening an electronic document and obtaining document identifying information for the electronic document, wherein the document identifying information is one of: at least a portion of a network identifier or source code for the electronic document;
after opening the electronic document, obtaining from a server one or more media entities associated with a subject of the electronic document, including one or more media entities not linked or included in the electronic document;
displaying, on the first computing device, a representation of at least a subset of the one or more media entities;
obtaining a user selection from the representation of a respective media entity from the at least a subset of the one or more media entities; and
in response to the user selection, causing the respective media entity to be displayed.

### Claim 2 (depends on 1)

The method of claim 1, wherein the electronic document is an electronic document opened in a document application on the first computing device.

### Claim 3 (depends on 2)

The method of claim 2, wherein the document application is a web browser and the electronic document is a web page.

### Claim 4 (depends on 1)

The method of claim 1, wherein the one or more programs includes a browser plug-in that performs the method of claim 1.

### Claim 5 (depends on 1)

The method of claim 1, further comprising, when the document identifying information includes at least a portion of a media content link associated with the respective media entity, directly obtaining at the first computing device the respective media entity associated with the at least a portion of the media content link, without involvement of the server.

### Claim 6 (depends on 1)

The method of claim 1, wherein, when the document identifying information is the at least a portion of a network identifier, the one or more obtained media entities include media entities recognized by a search engine while previously indexing the web page.

### Claim 7 (depends on 1)

The method of claim 1, wherein, when the document identifying information is the source code of the electronic document, the one or more obtained media entities include entities obtained by parsing the source code of the electronic document.

### Claim 8 (depends on 1)

The method of claim 1, wherein the one or more media entities are obtained based at least in part on one or more filtering criteria.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
obtaining a media entity that is related to the one or more media entities; and
displaying, on the first computing device, a representation of the related media entity.

### Claim 10 (depends on 1)

The method of claim 1, wherein:
causing the respective media entity to be displayed includes sending selection information identifying the respective media entity to a second computing device, the second computing device being configured to access and display respective media content corresponding to the respective media entity based on the selection information; and
the sending of the selection information is done via a local connection, from the first computing device, to the second computing device.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
during a display of the respective media content on the second computing device:
receiving, at the first computing device, a second user selection, and
sending a remote control command modifying the display of the respective media content, in accordance with the second user selection, to the second computing device.

### Claim 12 (depends on 1)

The method of claim 1, wherein obtaining one or more media entities associated with the electronic document includes:
sending a request to the server for media entities associated with the electronic document, the request including the document identifying information; and
receiving the one or more media entities from the server.

### Claim 13

A client system, comprising:
one or more processors of a first computing device;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
opening an electronic document and obtaining document identifying information for the electronic document, wherein the document identifying information is one of: at least a portion of a network identifier or source code for the electronic document;
after opening the electronic document, obtaining from a server one or more media entities associated with a subject of the electronic document, including one or more media entities not linked or included in the electronic document;
displaying, on the first computing device, a representation of at least a subset of the one or more media entities;
obtaining a user selection from the representation of a respective media entity from the at least a subset of the one or more media entities; and
in response to the user selection, causing the respective media entity to be displayed.

### Claim 14 (depends on 13)

The client system of claim 13, wherein:
the electronic document is an electronic document opened in a document application on the first computing device; and
the document application is a web browser and the electronic document is a web page.

### Claim 15 (depends on 13)

The client system of claim 13, wherein the one or more programs includes a browser plug-in that includes the instructions.

### Claim 16 (depends on 13)

The client system of claim 13, wherein the one or more program further comprising instructions for:
when the document identifying information includes at least a portion of a media content link associated with the respective media entity, directly obtaining at the first computing device the respective media entity associated with the at least a portion of the media content link, without involvement of the server.

### Claim 17

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a first computing device with one or more processors, cause the computer system to:
open an electronic document and obtain document identifying information for the electronic document, wherein the document identifying information is one of: at least a portion of a network identifier or source code for the electronic document;
after opening the electronic document, obtain from a server one or more media entities associated with a subject of the electronic document, including one or more media entities not linked or included in the electronic document;
display, on the first computing device, a representation of at least a subset of the one or more media entities;
obtain a user selection from the representation of a respective media entity from the at least a subset of the one or more media entities; and
in response to the user selection, causing the respective media entity to be displayed.

### Claim 18 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein:
the electronic document is an electronic document opened in a document application on the first computing device; and
the document application is a web browser and the electronic document is a web page.

### Claim 19 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein the one or more programs includes a browser plug-in that includes the instructions.

### Claim 20 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein the one or more program further comprising instructions for:
when the document identifying information includes at least a portion of a media content link associated with the respective media entity, directly obtaining at the first computing device the respective media entity associated with the at least a portion of the media content link, without involvement of the server.
