Apparatus and method for providing content with multiplane image transcoding includes user history of confidence
AssigneeAT&T Intellectual Property I, L.P.
InventorsTan Xu, Bo Han, Eric Zavesky
Life of this patent
Estimating the term…
Abstract
Aspects of the subject disclosure may include, for example, transmitting viewpoint information associated with a first portion of a three-dimensional (3D)/volumetric video to a device, wherein the viewpoint information comprises a first coordinate in 3D space associated with a first viewing direction in a playback of the first portion and a first timestamp associated with the first portion, receiving, from the device, a multiplane image (MPI) representation of a second portion of the 3D video responsive to the transmitting of the viewpoint information, and providing an image of the MPI representation to a display device. Other embodiments are disclosed.
Claims20
A device, comprising:
- a processing system including a processor;
- and
- a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:
- obtaining viewpoint information associated with a first portion of a volumetric video from a communication device;
- processing the viewpoint information to generate a predicted viewpoint associated with a second portion of the volumetric video;
- defining a window about the predicted viewpoint;
- modifying a size or a dimension of the window based on:
- a user history that indicates a degree of confidence in the predicted viewpoint, an amount of network traffic, a first computational capacity of the communication device, and a second computational capacity of the device, the modifying resulting in a modified window;
- generating a representation of the second portion of the volumetric video based on the predicted viewpoint and the modified window, wherein the representation comprises a first multiplane image (MPI) representation of the second portion of the volumetric video;
- and
- providing the representation of the second portion of the volumetric video to the communication device.
A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:
- transmitting viewpoint information associated with a first portion of a three-dimensional (3D) video to a device, wherein the viewpoint information comprises a first coordinate in 3D space associated with a first viewing direction in a playback of the first portion and a first timestamp associated with the first portion, wherein the device processes the viewpoint information to generate a predicted viewpoint, wherein the device defines a window about the predicted viewpoint, and wherein the device modifies a size or a dimension of the window based on:
- a user history that indicates a degree of confidence in the predicted viewpoint and an amount of network traffic, a first computational capacity of the device, and a second computational capacity of the processing system, resulting in a modified window;
- receiving, from the device, a multiplane image (MPI) representation of a second portion of the 3D video responsive to the transmitting of the viewpoint information, wherein the MPI representation is based on the modified window;
- and
- providing an image of the MPI representation to a display device.
A method, comprising:
- obtaining, by a processing system including a processor, information indicative of a first orientation of a user during a presentation of a first portion of a content item at a user equipment;
- analyzing, by the processing system, the information to generate a prediction of a second orientation of the user during a presentation of a second portion of the content item at the user equipment;
- defining, by the processing system, a window based on the prediction;
- modifying, by the processing system, a size or a dimension of the window based on:
- a user history that indicates a degree of confidence in the prediction, an amount of network traffic, a first computational capacity of the user equipment, and a second computational capacity of the processing system, the modifying resulting in a modified window;
- transforming, by the processing system, a first representation of the second portion of the content item that is compatible with a three-dimensional (3D) space to a second representation of the second portion of the content item that is compatible with two-dimensional (2D) hardware of the user equipment, 2D firmware of the user equipment, or a combination thereof, wherein the second representation of the second portion of the content item is based on the prediction and the modified window;
- and
- transmitting, by the processing system, the second representation of the second portion of the content item to the user equipment to facilitate the presentation of the second portion of the content item at the user equipment.
Dependencies are inferred from the claim text.