Immersive teleconferencing and telepresence
AssigneeApple Inc.
InventorOzgur Oyman
Life of this patent
Estimating the term…
Abstract
Embodiments may relate to a user equipment (UE) that is configured to determine a real-time transport protocol (RTP) media flow that includes visual data related to a plurality of images concurrently taken of a location and a supplemental information enhancement (SEI) message that is to be used to display at least a portion of the visual data. The UE is further configured to visually display, based on the visual data and the SEI message, the portion of the visual data to a user of the user device. Other embodiments may be described or claimed.
Claims19
A method comprising:
- receiving real-time transport protocol (RTP) stream that includes visual data and corresponding metadata comprising one or more omnidirectional video specific supplemental enhancement information (SEI) messages;
- processing the RTP stream to generate an elementary stream;
- decoding the elementary stream using a high-efficiency video coding (HEVC) decoder to obtain decoded visual data and decoder metadata comprising the one or more SEI messages;
- generating, based at least in part on the decoded visual data and the decoder metadata, a 360 degree video;
- and
- generating a viewport from the 360 degree video based at least on position information from one or more sensors.
An apparatus comprising one or more processors configured to perform operations comprising:
- receiving real-time transport protocol (RTP) stream that includes visual data and corresponding metadata comprising one or more omnidirectional video specific supplemental enhancement information (SEI) messages;
- processing the RTP stream to generate an elementary stream;
- decoding the elementary stream using a high-efficiency video coding (HEVC) decoder to obtain decoded visual data and decoder metadata comprising the one or more SEI messages;
- generating, based at least in part on the decoded visual data and the decoder metadata, a 360 degree video;
- and
- generating a viewport corresponding to a 360 degree video based at least on position information from one or more sensors.
One or more non-transitory machine-readable media storing instructions that, when executed, are configured to cause one or more processors to perform operations comprising:
- receiving real-time transport protocol (RTP) stream that includes visual data and corresponding metadata comprising one or more omnidirectional video specific supplemental enhancement information (SEI) messages;
- processing the RTP stream to generate an elementary stream;
- decoding the elementary stream using a high-efficiency video coding (HEVC) decoder to obtain decoded visual data and decoder metadata comprising the one or more SEI messages;
- generating, based at least in part on the decoded visual data and the decoder metadata, a 360 degree video;
- and
- generating a viewport from the 360 degree video based at least on position information from one or more sensors.
Dependencies are inferred from the claim text.