US 2019/0356894 A1 · FIELD-OF-VIEW PREDICTION METHOD BASED ON CONTEXTUAL INFORMATION FOR 360-DEGREE VR VIDEO

Abstract

Systems and methods described that provide for sending a first temporal portion of video to a client, wherein video quality of a first spatial region associated with a first direction of view is sent with higher quality than video data for another spatial region not associated with the first direction of view; sending a second temporal portion of the video to the client; and responsive to determining that a significant event, audio or video or a combination, occurred during the second temporal portion and corresponds with a second direction of view that is associated with a second spatial region, sending higher quality video for the second spatial region than video data for another spatial region. Virtual reality (VR) video, including 360-degree VR video may thus be foveated, based on contextual information in the video data and corresponding audio data, combined with field of view predictions based upon user motion.

Claims14

Dependent claims

A method of delivering video, wherein the video includes a plurality of temporal segments, each temporal segment having a plurality of spatial regions, the method comprising:

sending a first temporal segment of video to a client, wherein a first spatial region in the first temporal segment associated with a first direction of view is sent with a higher video quality than a second spatial region in the first temporal segment that is not associated with the first direction of view;
determining that a first significant audio event has occurred during a second temporal segment that is subsequent to the first temporal segment, the significant audio event occurring in a second direction of view;
and
sending the second temporal segment of video to the client, wherein responsive to determining that the significant event has occurred during the second temporal segment, a third spatial region in the second temporal segment associated with the second direction of view is sent with a higher video quality than a fourth spatial region in the second temporal segment that is not associated with the second direction of view.

1 more element

A system comprising:

a processor;
and
a non-transitory computer-readable medium storing instruction that are operative, if executed on the processor, to perform the functions of:
sending a first temporal segment of video to a client, wherein a first spatial region in the first temporal segment associated with a first direction of view is sent with a higher video quality than a second spatial region in the first temporal segment that is not associated with the first direction of view;
determining that a first significant audio event has occurred during a second temporal segment that is subsequent to the first temporal segment, the significant audio event occurring in a second direction of view;
and
sending the second temporal segment of video to the client, wherein responsive to determining that the significant event has occurred during the second temporal segment, a third spatial region in the second temporal segment associated with the second direction of view is sent with a higher video quality than a fourth spatial region in the second temporal segment that is not associated with the second direction of view.

4 more elements

Dependencies are inferred from the claim text.

Field-of-view prediction method based on contextual information for 360-degree vr video

Life of this patent

Field-of-view prediction method based on contextual information for 360-degree vr video

Life of this patent

Abstract

Claims14