Qoe metrics reporting for rtp-based 360-degree video delivery
AssigneeIntel Corporation
InventorsOzgur Oyman, Gang Shen
Life of this patent
Estimating the term…
Abstract
An apparatus and system to provide QoE metrics reporting mechanisms for RTP-based 360-degree video delivery in live immersive streaming and real-time immersive conversational service applications are described for both in-camera and network-based stitching. Initial and desired parameters for viewports used in a teleconference are exchanged, and the teleconference established using 360° media. RTP FoV reports sent during the teleconference each contain viewport orientation information, as well as information for the QoE metrics.
Claims20
An apparatus for a teleconference, the apparatus comprising:
- processing circuitry configured to:
- collect virtual reality (VR) quality-related metrics during a VR session, the VR quality metrics including viewport switching latency, rendered viewports, and device information;
- and
- provide control signals to a display based on the VR quality metrics as part of a Quality of Experience (QoE) framework within Real Time Protocol (RTP)-based 360° video delivery over Multimedia Telephony Service for Internet Protocol Multimedia Subsystem (MTSI);
- and
- a memory configured to store the VR quality metrics.
A teleconference apparatus, the teleconference apparatus comprising:
- processing circuitry configured to:
- encode, for transmission to remote devices, parameters that include an initial viewport orientation, decoding and rendering metadata, Capture field-of-View, and Codec negotiation;
- establish the teleconference using 360° media for transmission to the remote devices the teleconference using one of:
- in-camera stitching in which stitched immersive video is sent from a teleconference apparatus to a conferencing server for transmission from the conferencing server to the remote devices, and
- network-based stitching in which different two dimensional captures are sent from the teleconference apparatus to the conferencing server and the conferencing server performs decoding, stitching, and re-encoding to produce the stitched immersive video, which is distributed to the remote devices;
- and
- decode, from the remote devices, Real-Time Transport Protocol (RTP) field of view (FoV) reports during the teleconference;
- and
- a memory configured to store the parameters.
A non-transitory computer-readable storage medium that stores instructions for execution by one or more processors of a teleconference apparatus, the one or more processors to configure the teleconference apparatus to, when the instructions are executed:
- encode, for transmission to remote devices, parameters that include an initial viewport orientation, decoding and rendering metadata, Capture Field-of-View, and Codec negotiation;
- establish the teleconference using 360° media for transmission to the remote devices the teleconference using one of:
- in-camera stitching in which stitched immersive video is sent from a teleconference apparatus to a conferencing server for transmission from the conferencing server to the remote devices, and
- network-based stitching in which different two dimensional captures are sent from the teleconference apparatus to the conferencing server and the conferencing server performs decoding, stitching, and re-encoding to produce the stitched immersive video, which is distributed to the remote devices;
- and
- decode, from the remote devices, Real-Time Transport Protocol (RTP) field of view (FoV) reports during the teleconference.
Dependencies are inferred from the claim text.