# US 12,634,541 B2 · Streaming scene prioritizer for immersive media > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,634,541 B2 - Document ID: US12634541B2 - Status: Granted - Kind: B2 - Application number: 18/137,849 - Filed: 2023-04-21 - Published: 2023-11-16 - Granted: 2026-05-19 - Earliest claimed: 2022-05-12 - Assignees: Tencent America LLC - Applicants: Tencent America LLC - Inventors: Paul Spencer Dawkins; Arianne Hinds; Stephan Wenger - Web page: https://patentgrep.com/patent/US12634541B2 ## CPC - H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras} - H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)} - H04N 21/2402: {Monitoring of the downstream path of the transmission network, e.g. bandwidth available (traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876)} - H04N 21/26216: {involving the channel capacity, e.g. network bandwidth (admission control, resource allocation in open networks H04L12/5692; flow control in packet networks H04L47/10; establishing a schedule or organising the servicing of application requests taking into account QoS H04L67/61)} - H04N 21/414: Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance - H04N 21/44012: {involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs} - H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection - H04N 21/816: {involving special video data, e.g 3D video} - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Aspects of the disclosure provide methods and apparatuses for immersive media processing. In some examples, a method of media processing includes receiving a scene based immersive media for playing at a light field based display. The scene based immersive media includes a plurality of scenes. The method includes assigning priority values respectively to the plurality of scenes in the scene based immersive media, and determining an order for streaming the plurality of scenes to an end device according to the priority values. In some examples, a method of media processing includes receiving a scene based immersive media for playing at a light field based display. A scene in the scene based immersive media includes a plurality of assets in a first order. The method includes determining a second order for streaming the plurality of assets to an end device, the second order is different from the first order. ## Claims ### Claim 1 A method of immersive media processing, comprising: receiving, by a network device, a scene based immersive media for display by a light field based display, the scene based immersive media comprising a plurality of immersive media scenes; assigning priority values and complexity values respectively to the plurality of immersive media scenes based on one or more attributes of the plurality of immersive media scenes such that the plurality of immersive media scenes is ordered in a first order based on the priority values and the complexity values; transmitting the plurality of immersive media scenes in the first order to an end device; determining a second order for streaming the plurality of immersive media scenes to the end device by adjusting the first order of the plurality of immersive media scenes according to updated priority values and updated complexity values that are obtained by updating the priority values and the complexity values respectively based on a feedback signal received from the end device, the second order being different from the first order; and transmitting the plurality of immersive media scenes to the end device in the second order. ### Claim 2 (depends on 1) The method of claim 1, wherein the assigning the priority values further comprises: assigning the priority values to the plurality of immersive media scenes based on a viewing position of the scene based immersive media of a user that is indicated by the feedback signal. ### Claim 3 (depends on 1) The method of claim 1, wherein the determining the second order further comprises: selecting, by a priority-aware network device, from a subset of un-transmitted scenes in the plurality of immersive media scenes, a highest priority scene with a highest priority value; and transmitting the highest priority scene to the end device. ### Claim 4 (depends on 1) The method of claim 1, wherein the assigning the priority values further comprises: determining a priority value to a scene based on a likelihood of a need to render the scene. ### Claim 5 (depends on 1) The method of claim 1, further comprising: determining that an available network bandwidth is limited; selecting, from a subset of un-transmitted scenes in the plurality of immersive media scenes, a highest priority scene with a highest priority value; and transmitting the highest priority scene when the available network bandwidth is limited. ### Claim 6 (depends on 1) The method of claim 1, further comprising: determining that an available network bandwidth is limited; and identifying a subset of the plurality of immersive media scenes are unlikely to be needed for rendering next based on the priority values, wherein the subset of the plurality of immersive media scenes is not streamed when the available network bandwidth is limited. ### Claim 7 (depends on 1) The method of claim 1, wherein the assigning the priority values further comprises: assigning, a first priority value to a first scene based on a second priority value of a second scene according to a relationship between the first scene and the second scene. ### Claim 8 (depends on 1) The method of claim 1, further comprising: receiving, the feedback signal from the end device; and adjusting at least a priority value of a scene in the plurality of immersive media scenes based on the feedback signal. ### Claim 9 (depends on 8) The method of claim 8, further comprising: assigning, a highest priority to a first scene when the feedback signal indicates a current scene is a second scene that is in connection with the first scene. ### Claim 10 (depends on 8) The method of claim 8, wherein the feedback signal indicates a priority adjustment that is determined by the end device. ### Claim 11 A method of immersive media processing, comprising: receiving, by an end device, a media presentation description (MPD) for a scene based immersive media for display by a light field based display, the scene based immersive media comprising a plurality of immersive media scenes, and the MPD being indicative of streaming the plurality of immersive media scenes to the end device in a first order that is determined according to priority values and complexity values of the plurality of immersive media scenes; sending, by the end device, a feedback signal to a server, updated priority values and updated complexity values of the plurality of immersive media scenes that are determined by updating the priority values and the complexity values respectively based on the feedback signal; receiving, by the end device, the plurality of immersive media scenes in a second order that is determined according to the updated priority values and the updated complexity values, the second order being determined by adjusting the first order of the plurality of immersive media scenes; and outputting for display the plurality of immersive media scenes of immersive media by the end device based on the second order, the second order being different from the first order. ### Claim 12 (depends on 11) The method of claim 11, wherein the feedback signal indicates a next scene to render. ### Claim 13 (depends on 11) The method of claim 11, wherein the feedback signal indicates an adjustment of a priority value of at least one scene of the plurality of immersive media scenes. ### Claim 14 (depends on 11) The method of claim 11, wherein the feedback signal indicates a viewing position of a user of a current scene. ### Claim 15 A method of immersive media processing, comprising: receiving, by a network device, a scene based immersive media for display by a light field based display, a scene in the scene based immersive media comprising a plurality of assets in a first order that is determined according to priority values and complexity values of the plurality of assets; transmitting the plurality of assets to an end device based on the first order; assigning updated priority values and updated complexity values respectively to the plurality of assets in the scene, the updated priority values and the updated complexity values being determined by updating the priority values and the complexity values respectively based on one or more attributes of the plurality of assets and a feedback signal of the end device; determining a second order for streaming the plurality of assets to the end device according to the updated priority values and the updated complexity values, the second order being different from the first order and being determined by adjusting the first order of the plurality of assets; and transmitting the plurality of assets to the end device based on the second order. ### Claim 16 (depends on 15) The method of claim 15, comprising: determining the second order for streaming the plurality of assets according to a viewing position of the scene based immersive media of a user. ### Claim 17 (depends on 16) The method of claim 16, comprising: assigning a priority value to an asset in the scene according to a size of the asset. ### Claim 18 (depends on 16) The method of claim 16, comprising: assigning a priority value to an asset in the scene according to a visibility of the asset associated with a default entry location of the scene. ### Claim 19 (depends on 16) The method of claim 16, comprising: assigning a first set of priority values to the plurality of assets based on a first attribute of the plurality of assets, the first set of priority values being used for ordering the plurality of assets in a first prioritization scheme; assigning a second set of priority values to the plurality of assets based on a second attribute of the plurality of assets, the second set of priority values being used for ordering the plurality of assets in a second prioritization scheme; selecting, a prioritization scheme for the end device from the first prioritization scheme and the second prioritization scheme according to information of the end device; and ordering the plurality of assets for streaming according to the selected prioritization scheme. ### Claim 20 (depends on 16) The method of claim 16, comprising: assigning a first priority value to a first asset and a second priority value to a second asset when the first asset has a higher complexity of computation than the second asset, the first priority value being higher than the second priority value.