Back to results
US 12,602,237 B2Granted
User interface extendability over wireless protocol
AssigneeApple Inc.
InventorsJeremy Jie You Foo, Matthew M. Sun
Life of this patent
Estimating the term…
Abstract
Generating unified content includes receiving, at a first device, first media content comprising a media stream from one or more source devices, and receiving, at the first device, user interface overlay instructions. The first device generates unified content having the first media content and a user interface overlay, and provides the unified content for display on a display device.
Claims14
A method for processing content, comprising:
- receiving, at a first device, a playback request for a first media content comprising a media stream;
- in response to the playback request:
- transmitting an instruction to a receiver device to retrieve the media stream from a media server over a first data pipeline,
- determining one or more user interface (UI) overlay elements for the media stream based on a local media application on the first device;
- generating user interface overlay instructions for drawing the one or more UI overlay elements, and for retrieving sensor data from an accessory device;
- and
- transmitting a UI overlay stream over a second data pipeline comprising the user interface overlay instructions to the receiver device,
- wherein the user interface overlay instructions comprise instructions to render the one or more UI overlay elements over the media stream in accordance with the user interface overlay instructions, and instructions to populate
- the one or more UI overlay elements with the sensor data retrieved from the accessory device.
6 more elements
A non-transitory computer readable medium comprising computer readable code for processing content, executable by one or more processors to:
- receive, at a first device, a playback request for a first media content comprising a media stream;
- in response to the playback request:
- transmit an instruction to a receiver device to retrieve the media stream from a media server over a first data pipeline,
- determine one or more user interface (UI) overlay elements for the media stream based on a local media application on the first device;
- generate user interface overlay instructions for drawing the one or more UI overlay elements, and for retrieving sensor data from an accessory device;
- and
- transmit a UI overlay stream over a second data pipeline comprising the user interface overlay instructions to the receiver device,
- wherein the user interface overlay instructions comprise instructions to render the one or more UI overlay elements over the media stream in accordance with the user interface overlay instructions, and instructions to populate
- the one or more UI overlay elements with the sensor data retrieved from the accessory device.
6 more elements
A system comprising:
- one or more processors;
- and
- one or more computer readable media comprising computer readable code executable by the one or more processors to:
- receive, at a first device, a playback request for a first media content comprising a media stream;
- in response to the playback request:
- transmit an instruction to a receiver device to retrieve the media stream from a media server over a first data pipeline,
- determine one or more user interface (UI) overlay elements for the media stream based on a local media application on the first device;
- generate user interface overlay instructions for drawing the one or more UI overlay elements, and for retrieving sensor data from an accessory device;
- and
- transmit a UI overlay stream over a second data pipeline comprising the user interface overlay instructions to the receiver device,
- wherein the user interface overlay instructions comprise instructions to render the one or more UI overlay elements over the media stream in accordance with the user interface overlay instructions, and instructions to populate
- the one or more UI overlay elements with the sensor data retrieved from the accessory device.
9 more elements
Dependencies are inferred from the claim text.