Reference of neural network model by immersive media for adaptation of media for streaming to heterogenous client end-points
AssigneeTencent America LLC
InventorsArianne HINDS, Stephan WENGER
Life of this patent
Estimating the term…
Abstract
A method, computer program, and computer system is provided for streaming immersive media. Content is ingested in a first two-dimension format or a first three-dimensional format, whereby the format references a neural network. The ingested content is converted to a second two-dimensional or a second three-dimensional format based on the referenced neural network. The converted content is streamed to a client end-point, such as a television, a computer, a head-mounted display, a lenticular light field display, a holographic display, an augmented reality display, or a dense light field display.
Claims20
A method of streaming immersive media, executable by a processor, comprising:
- ingesting content in a first two-dimensional format or a first three-dimension format, the content comprising one or more SEI messages,
- wherein the one or more SEI message comprises a reference to a neural network model for converting the content,
- wherein the reference to the neural network model indicates whether the neural network model is associated with a scene in the content;
- converting the content to a second two-dimensional or a second three-dimensional format based on the referenced neural network model;
- and
- streaming the converted content to a client end-point.
A computer system for streaming immersive media, the computer system comprising:
- one or more computer-readable non-transitory storage media configured to store computer program code;
- and
- one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:
- ingesting code configured to cause the one or more computer processors to ingest content in a first two-dimensional format or a first three-dimension format,
- wherein the one or more SEI message comprises a reference to a neural network model for converting the content,
- wherein the reference to the neural network model indicates whether the neural network model is associated with a scene in the content;
- converting code configured to cause the one or more computer processors to convert the content to a second two-dimensional or a second three-dimensional format based on the referenced neural network model;
- and
- streaming code configured to cause the one or more computer processors to stream the converted content to a client end-point.
A non-transitory computer readable medium having stored thereon a computer program for streaming immersive media, the computer program configured to cause one or more computer processors to:
- ingest content in a first two-dimensional format or a first three-dimension format,
- wherein the one or more SEI message comprises a reference to a neural network model for converting the content,
- wherein the reference to the neural network model indicates whether the neural network model is associated with a scene in the content;
- converting code configured to cause the one or more computer processors to convert the content to a second two-dimensional or a second three-dimensional format based on the referenced neural network model;
- and
- streaming code configured to cause the one or more computer processors to stream the converted content to a client end-point.
Dependencies are inferred from the claim text.