Back to results
US 12,003,792 B2Granted
Adaptation of 2D video for streaming to heterogenous client end-points
AssigneeTencent America LLC
InventorsArianne Hinds, Stephan Wenger
Life of this patent
Estimating the term…
Abstract
A method, computer program, and computer system is provided for streaming immersive media. The method includes ingesting content in a two-dimensional format; converting the ingested content to a three-dimensional format based on a neural network; and streaming the converted content to a client end-point.
Claims18
A method of streaming immersive media, executable by a processor, the method comprising:
- ingesting content in a two-dimensional format;
- adapting the ingested content to a three-dimensional format based on a neural network,
- wherein the neural network is selected based on a neural network token provided by a first client end-point,
- wherein the neural network token is provided responsive to a request that the first client end-point provide a neural network token associated with a neural network model available at the first client end-point, and
- wherein the adapting maps a geometry of a first client end-point frustum to interpolation abilities of the ingested content;
- and
- streaming the adapted content to the first client end-point and a second client end-point,
- wherein the first client end-point is unable to support the two-dimensional format, and
- wherein the second client end-point is able to support the two-dimensional format.
6 more elements
A device for streaming immersive media, the device comprising:
- at least one memory configured to store program code;
- and
- at least one processor configured to read the program code and operate as instructed by the program code, the program code including:
- ingesting code configured to cause the at least one processor to ingest content in a two-dimensional format;
- adapting code configured to cause the at least one processor to adapt the ingested content to a three-dimensional format based on a neural network,
- wherein the neural network is selected based on a neural network token provided by a first client end-point,
- wherein the neural network token is provided responsive to a request that the first client end-point provide a neural network token associated with a neural network model available at the first client end-point, and
- wherein the adapting maps a geometry of a first client end-point frustum to interpolation abilities of the ingested content;
- and
- streaming code configured to cause the at least one processor to stream the adapted content to the first client end-point and a second client end-point,
- wherein the first client end-point is unable to support the two-dimensional format, and
- wherein the second client end-point is able to support the two-dimensional format.
9 more elements
A non-transitory computer-readable medium storing instructions, the instructions comprising:
- one or more instructions that, when executed by at least one processor of a device for streaming immersive media, cause the at least one processor to:
- ingest content in a two-dimensional format;
- adapt the ingested content to a three-dimensional format based on a neural network,
- wherein the neural network is selected based on a neural network token provided by a first client end-point,
- wherein the neural network token is provided responsive to a request that the first client end-point provide a neural network token associated with a neural network model available at the first client end-point, and
- wherein the adapting maps a geometry of a first client end-point frustum to interpolation abilities of the ingested content;
- and
- stream the adapted content to the first client end-point and a second client end-point,
- wherein the first client end-point is unable to support the two-dimensional format, and
- wherein the second client end-point is able to support the two-dimensional format.
7 more elements
Dependencies are inferred from the claim text.