Positional zero latency
AssigneeDolby Laboratories Licensing Corporation
InventorAjit Ninan
Life of this patent
Estimating the term…
Abstract
Based on viewing tracking data, a viewer's view direction to a three-dimensional (3D) scene depicted by a first video image is determined. The first video image has been streamed in a video stream to the streaming client device before the first time point and rendered with the streaming client device to the viewer at the first time point. Based on the viewer's view direction, a target view portion is identified in a second video image to be streamed in the video stream to the streaming client device to be rendered at a second time point subsequent to the first time point. The target view portion is encoded into the video stream with a higher target spatiotemporal resolution than that used to encode remaining non-target view portions in the second video image.
Claims17
A method for presenting video data to viewers, comprising:
- wherein the method is performed by a streaming client device;
- transmitting, from the streaming client device to a video stream server, viewing tracking data based on a target view direction of a viewer in relation to a scene depicted by a first video image rendered by the streaming client device at a first time point to the viewer, wherein the first video image is decoded for the first time point from a video stream streamed by the video streaming server to the streaming client device;
- receiving and decoding a second video image for a second time point from the video stream streamed by the video streaming server to the streaming client device, wherein the second video image comprises a target view image portion at a first spatiotemporal resolution and one or more non-target view image portions at a second spatiotemporal resolution different from the first spatiotemporal resolution, wherein the target view image portion corresponds to the target view direction of the viewer;
- wherein a spatial extent of a surround region covered by the target view portion in the second video image is determined based at least in part on a transmission latency time between the video streaming server and the streaming client device;
- causing the target view image portion in the second video image to be rendered, at the second time point, to the viewer.
Dependencies are inferred from the claim text.