# US 2012/0254929 A1 · Content Extraction for Television Display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254929 A1
- Document ID: US20120254929A1
- Status: Published application
- Kind: A1
- Application number: 13/079,375
- Filed: 2011-04-04
- Published: 2012-10-04
- Earliest claimed: 2011-04-04
- Assignees: Google Inc.
- Inventors: Ant Oztaskent; Andrew Gildfind
- Web page: https://patentgrep.com/patent/US20120254929A1

## CPC

- H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)}
- H04N 21/4227: {Providing} Remote input by a user located remotely from the client device, e.g. at work
- H04N 21/4782: Web browsing {, e.g. WebTV}
- H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)}
- H04N 21/8586: {by using a URL (processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a display device that, in response to receiving a network address from a personal computing device, retrieves and presents network based electronic media. In one aspect, a method includes receiving at a user device a first resource referenced by a first resource address, and the first resource includes a second resource address referencing a second resource that is content that is displayed in a content display environment in the first resource page. In response to a selection of the display of the content in the content display environment, the method provide the second resource address to the television device in response to determining that a television device in data communication with the user device has a processing capability to retrieve the content from the second resource address and display the content.

## Claims

### Claim 1

A user device, comprising:
a data processing apparatus;
a communication subsystem that transmits and receives data over one or more networks and one or more media;
a display device; and
a memory device storing instructions that when executed by data processing apparatus cause the user device to perform operations comprising:
receive a first resource referenced by a first resource address, wherein the first resource defines a first resource page and a content display environment in the first resource page, and includes a second resource address referencing a second resource, the second resource defining content that is displayed in the content display environment in the first resource page;
display the first resource page and the content display environment;
receive the content referenced by the second resource address and display the content in the content display environment;
in response to a selection of the display of the content in the content display environment, determine whether a television device in data communication with the user device has a processing capability to retrieve the content from the second resource address and display the content; and
in response to determining that the television device has the processing capability to retrieve the content from the second resource address and display the content, provide the second resource address to the television device.

### Claim 2 (depends on 1)

The user device of claim 1, wherein the memory device further stores instructions that when executed by data processing apparatus cause the user device to perform operations comprising, in response to determining that the television device does not have the processing capability to retrieve the content from the second resource address and display the content:
transcode the content into transcoded content for which the television has the processing capability to display; and
provide the transcoded content to the television device.

### Claim 3 (depends on 1)

The user device of claim 1, wherein the memory device further stores instructions that when executed by data processing apparatus cause the user device to perform operations comprising:
in response to providing the second resource address to the television device:
generate a plurality of content playback commands in the display device, each command having a corresponding content playback operation;
in response to a user selection of a content playback command, generate a playback command signal specifying the corresponding content playback operation;
provide the content playback command signal to the television device to cause the television device to perform the specified content playback operation.

### Claim 4 (depends on 1)

The user device of claim 1, wherein the memory device further stores instructions that when executed by data processing apparatus cause the user device to perform operations comprising:
query the television device for the second resource address from which the television device is receiving and displaying content;
receive the second resource address from the television device; and
receive and display content from the second resource address.

### Claim 5 (depends on 1)

The user device of claim 1, wherein the memory device further stores instructions that when executed by data processing apparatus cause the user device to perform operations comprising:
provide other user devices that are present on a local area network with the first resource address and a notification that the second resource address has been provided to the television device.

### Claim 6 (depends on 1)

The user device of claim 1, wherein:
the television device is implemented as a first Universal Plug and Play (UPnP) control point on a local area network; and
the memory device further stores instructions that when executed by data processing apparatus cause the user device to perform operations comprising:
instantiate the user device as second UPnP control point present on a local area network;
discover and communicate with the television device using a UPnP protocol.

### Claim 7 (depends on 6)

The user device of claim 6, wherein to determine whether a television device in data communication with the user device has the processing capability to retrieve the content from the second resource address and display the content, the user device performs operations comprising:
determining a format and encoding of the content; and
determining whether the television processing device can process the content according to the determined format and encoding.

### Claim 8 (depends on 1)

The user device of claim 1, wherein:
the user device is a mobile device;
the television device is a set top box;
the mobile device is in data communication with the set top box over a local area network, and in data communication with a first content network that is publicly accessible, and receives the first resource and the content from the first content network;
the television device is data communication with the first content network and with a second content network that is not publicly accessible, and receives the content over the first content network, and television programming content over the second content network.

### Claim 9 (depends on 1)

The user device of claim 1, wherein the resource address is a uniform resource locator.

### Claim 10 (depends on 9)

The user device of claim 9, wherein provide the second resource address to the television device comprises providing a full HTTP request that includes the uniform resource locator and data from a cookie stored on the user device.

### Claim 11 (depends on 1)

The user device of claim 1, further comprising an application resident on the user device; and, wherein the memory device further stores instructions that when executed by data processing apparatus cause the user device to perform operations comprising:
encode an output of the application into content for which the television has the processing capability to display; and,
provide the encoded content to the television device.

### Claim at position 12

12-15. (canceled)

### Claim 16

A method, comprising:
receiving, at a user device, a first resource referenced by a first resource address, wherein the first resource defines a first resource page and a content display environment in the first resource page, and includes a second resource address referencing a second resource, the second resource defining content that is displayed in the content display environment in the first resource page;
displaying, at the user device, the first resource page and the content display environment;
receiving, at the user device, the content referenced by the second resource address and display the content in the content display environment;
receiving, at the user device, a user selection of the display of the content in the content display environment;
determining, by the user device, whether a television device in data communication with the user device has a processing capability to retrieve the content from the second resource address and display the content; and
in response to determining that the television device has the processing capability to retrieve the content from the second resource address and display the content, providing, by the user device, the second resource address to the television device.

### Claim 17 (depends on 16)

The method of claim 16, further comprising, in response to determining that the television device does not have the processing capability to retrieve the content from the second resource address and display the content:
transcoding, by the user device, the content into transcoded content for which the television has the processing capability to display; and
providing, by the user device, the transcoded content to the television device.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
in response to providing the second resource address to the television device:
generating, by the user device, a plurality of content playback commands in the display device, each command having a corresponding content playback operation;
in response to a user selection of a content playback command, generating, by the user device, a playback command signal specifying the corresponding content playback operation;
providing, by the user device, the content playback command signal to the television device to cause the television device to perform the specified content playback operation.

### Claim 19 (depends on 16)

The method of claim 16, further comprising:
querying, by the user device, the television device for the second resource address from which the television device is receiving and displaying content;
receiving, at the user device, the second resource address from the television device; and
receiving and displaying, at the user device, content from the second resource address.

### Claim 20 (depends on 16)

The method of claim 16, further comprising:
providing, by the user device, other user devices that are present on a local area network with the first resource address and a notification that the second resource address has been provided to the television device.

### Claim 21 (depends on 16)

The method of claim 16, wherein:
the television device is implemented as a first Universal Plug and Play (UPnP) control point on a local area network; and
the method further comprises:
instantiating, by the user device, the user device as second UPnP control point present on a local area network;
discovering and communicating, by the user device, with the television device using a UPnP protocol.

### Claim 22 (depends on 21)

The method of claim 21, wherein determining whether a television device in data communication with the user device has the processing capability to retrieve the content from the second resource address and display the content comprises:
determining, by the user device, a format and encoding of the content; and
determining, by the user device, whether the television processing device can process the content according to the determined format and encoding.

### Claim 23 (depends on 16)

The method of claim 16, wherein:
the user device is a mobile device;
the television device is a set top box;
the mobile device is in data communication with the set top box over a local area network, and in data communication with a first content network that is publicly accessible, and receives the first resource and the content from the first content network;
the television device is data communication with the first content network and with a second content network that is not publicly accessible, and receives the content over the first content network, and television programming content over the second content network.

### Claim 24 (depends on 16)

The method of claim 16, wherein the resource address is a uniform resource locator.

### Claim 25 (depends on 16)

The method of claim 16, wherein the memory device further stores instructions that when executed by data processing apparatus cause the user device to perform operations comprising:
encode an output of the first resource page into content for which the television has the processing capability to display; and,
provide the encoded content to the television device.

### Claim 26

A computer program stored in a computer readable storage device, the computer program comprising instructions that when executed by a user device cause the user device to perform operations comprising:
receiving a first resource referenced by a first resource address, wherein the first resource defines a first resource page and a content display environment in the first resource page, and includes a second resource address referencing a second resource, the second resource defining content that is displayed in the content display environment in the first resource page;
displaying the first resource page and the content display environment;
receiving the content referenced by the second resource address and display the content in the content display environment;
in response to a selection of the display of the content in the content display environment, determining whether a television device in data communication with the user device has a processing capability to retrieve the content from the second resource address and display the content; and
in response to determining that the television device has the processing capability to retrieve the content from the second resource address and display the content, providing the second resource address to the television device.

### Claim 27 (depends on 1)

The computer program product of claim 1, wherein the operations further comprise, in response to determining that the television device does not have the processing capability to retrieve the content from the second resource address and display the content:
transcoding the content into transcoded content for which the television has the processing capability to display; and
providing the transcoded content to the television device.

### Claim 28 (depends on 1)

The computer program product of claim 1, wherein the operations further comprise:
in response to providing the second resource address to the television device:
generating a plurality of content playback commands in the display device, each command having a corresponding content playback operation;
in response to a user selection of a content playback command, generating a playback command signal specifying the corresponding content playback operation;
providing the content playback command signal to the television device to cause the television device to perform the specified content playback operation.

### Claim 29 (depends on 1)

The computer program product of claim 1, wherein the operations further comprise:
querying the television device for the second resource address from which the television device is receiving and displaying content;
receiving the second resource address from the television device; and
receiving and display content from the second resource address.

### Claim 30 (depends on 1)

The computer program product of claim 1, wherein the operations further comprise:
providing other user devices that are present on a local area network with the first resource address and a notification that the second resource address has been provided to the television device.

### Claim 31 (depends on 1)

The computer program product of claim 1, wherein:
the television device is implemented as a first Universal Plug and Play (UPnP) control point on a local area network; and
the operations further comprise:
instantiating the user device as second UPnP control point present on a local area network;
discovering and communicating with the television device using a UPnP protocol.

### Claim 32 (depends on 6)

The computer program product of claim 6, wherein determining whether a television device in data communication with the user device has the processing capability to retrieve the content from the second resource address and display the content comprises:
determining a format and encoding of the content; and
determining whether the television processing device can process the content according to the determined format and encoding.

### Claim 33 (depends on 1)

The computer program product of claim 1, wherein:
the user device is a mobile device;
the television device is a set top box;
the mobile device is in data communication with the set top box over a local area network, and in data communication with a first content network that is publicly accessible, and receives the first resource and the content from the first content network;
the television device is data communication with the first content network and with a second content network that is not publicly accessible, and receives the content over the first content network, and television programming content over the second content network.

### Claim 34 (depends on 1)

The computer program product of claim 1, wherein the resource address is a uniform resource locator.

### Claim 35 (depends on 34)

The computer program product of claim 34, wherein providing the second resource address to the television device comprises providing a full HTTP request that includes the uniform resource locator and data from a cookie stored on the user device.

### Claim 36 (depends on 26)

The computer program product of claim 26, wherein the operations further comprise:
encoding an output of an application executing on the user device into content for which the television has the processing capability to display; and,
providing the encoded content to the television device.

### Claim 37

A computer program stored in a computer readable storage device, the computer program comprising instructions that when executed by a user device cause the user device to perform operations comprising:
receiving a first resource referenced by a first resource address, wherein the first resource defines a first resource page and a content display environment in the first resource page, and includes a second resource address referencing a second resource, the second resource defining content that is displayed in the content display environment in the first resource page;
displaying the first resource page and the content display environment;
receiving the content referenced by the second resource address and display the content in the content display environment;
receiving a user selection of the display of the content in the content display environment;
determining whether a television device in data communication with the user device has a processing capability to retrieve the content from the second resource address and display the content; and
in response to determining that the television device has the processing capability to retrieve the content from the second resource address and display the content, providing the second resource address to the television device.

### Claim 38 (depends on 37)

The computer program product of claim 37, the operations further comprising, in response to determining that the television device does not have the processing capability to retrieve the content from the second resource address and display the content:
transcoding the content into transcoded content for which the television has the processing capability to display; and
providing the transcoded content to the television device.

### Claim 39 (depends on 37)

The computer program product of claim 37, the operations further comprising:
in response to providing the second resource address to the television device:
generating a plurality of content playback commands in the display device, each command having a corresponding content playback operation;
in response to a user selection of a content playback command, generating a playback command signal specifying the corresponding content playback operation;
providing the content playback command signal to the television device to cause the television device to perform the specified content playback operation.

### Claim 40 (depends on 37)

The computer program product of claim 37, the operations further comprising:
querying the television device for the second resource address from which the television device is receiving and displaying content;
receiving the second resource address from the television device; and
receiving and displaying content from the second resource address.

### Claim 41 (depends on 37)

The computer program product of claim 37, the operations further comprising:
providing other user devices that are present on a local area network with the first resource address and a notification that the second resource address has been provided to the television device.

### Claim 42 (depends on 37)

The computer program product of claim 37, wherein:
the television device is implemented as a first Universal Plug and Play (UPnP) control point on a local area network; and
the operations further comprise:
instantiating the user device as second UPnP control point present on a local area network;
discovering and communicating with the television device using a UPnP protocol.

### Claim 43 (depends on 42)

The computer program product of claim 42, wherein determining whether a television device in data communication with the user device has the processing capability to retrieve the content from the second resource address and display the content comprises:
determining a format and encoding of the content; and
determining whether the television processing device can process the content according to the determined format and encoding.

### Claim 44 (depends on 37)

The computer program product of claim 37, wherein:
the user device is a mobile device;
the television device is a set top box;
the mobile device is in data communication with the set top box over a local area network, and in data communication with a first content network that is publicly accessible, and receives the first resource and the content from the first content network;
the television device is data communication with the first content network and with a second content network that is not publicly accessible, and receives the content over the first content network, and television programming content over the second content network.

### Claim 45 (depends on 37)

The computer program product of claim 37, wherein the resource address is a uniform resource locator.

### Claim 46 (depends on 37)

The computer program product of claim 37, wherein the operations further comprise:
encoding an output of the application into content for which the television has the processing capability to display; and
providing the encoded content to the television device.
