# US 12,225,066 B2 · Adaptive streaming for lightfield or holographic media

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,225,066 B2
- Document ID: US12225066B2
- Status: Granted
- Kind: B2
- Application number: 17/971,048
- Filed: 2022-10-21
- Published: 2023-04-27
- Granted: 2025-02-11
- Earliest claimed: 2021-10-22
- Assignees: Tencent America LLC
- Applicants: Tencent America LLC
- Inventors: Rohit Abhishek; Arianne Hinds
- Web page: https://patentgrep.com/patent/US12225066B2

## CPC

- H04L 65/61: for supporting one-way streaming services, e.g. Internet radio
- H04L 65/752: adapting media to network capabilities
- G06V 20/20: in augmented reality scenes
- H04L 65/1089: by adding media; by removing media
- H04L 65/612: for unicast
- H04L 65/80: Responding to QoS
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Method, device, and non-transitory storage medium for adaptive streaming of immersive media are provided. The method may include determining characteristics associated with a scene to be transmitted to the end client, adjusting at least a part of the scene to be transmitted to the end client based on the determined characteristics, and transmitting an adaptive stream of the lightfield or holographic immersive media comprising the adjusted scene based on the determined characteristics.

## Claims

### Claim 1

A method for adaptive streaming of lightfield or holographic immersive media, the method being executed by one or more processors, the method comprising:
determining a bandwidth availability associated with an end client;
determining characteristics associated with a scene to be transmitted to the end client;
when the bandwidth availability is a limited availability, adjusting the scene to be transmitted to the end client to a first depth based on the characteristics associated with the scene, wherein the first depth corresponds to the bandwidth availability, and wherein the first depth indicates a distance from a camera to a respective object; and
transmitting an adaptive stream of the lightfield or the holographic immersive media comprising the adjusted scene.

### Claim 2 (depends on 1)

The method of claim 1, the method further comprising:
when the bandwidth availability is not the limited availability, adjusting the scene to be transmitted to the end client at a full depth based on the characteristics associated with the scene.

### Claim 3 (depends on 1)

The method of claim 1, wherein adjusting the scene to be transmitted comprises:
adjusting the scene to be transmitted to exclude one or more objects in the scene, wherein the one or more objects are at a distance beyond the first depth.

### Claim 4 (depends on 1)

The method of claim 1, wherein adjusting the scene to be transmitted comprises:
determining a priority associated with one or more objects in the scene to be transmitted based on a distance of the one or more objects within the first depth and an imaging device capturing the scene; and
adjusting the scene to be transmitted to include the one or more objects based on the priority.

### Claim 5 (depends on 1)

The method of claim 1, wherein adjusting the scene to be transmitted comprises:
adjusting the scene to be transmitted to include one or more objects in the scene, wherein the one or more second objects are at a distance within the first depth.

### Claim 6 (depends on 1)

The method of claim 1, wherein adjusting the scene to be transmitted comprises:
receiving a request for an alternative scene with fewer objects than one or more objects in the scene from the end client based on the determined characteristics associated with the end client; and
adjusting the alternative scene to be transmitted to include one or more objects among the one or more objects, wherein the one or more objects are within the first depth.

### Claim 7 (depends on 6)

The method of claim 6, wherein adjusting the scene to be transmitted comprises:
adjusting the alternative scene to be transmitted to exclude one or more objects among the one or more objects, wherein the one or more objects are at a distance beyond the first depth.

### Claim 8

An apparatus for adaptive streaming of lightfield or holographic immersive media, the apparatus comprising:
at least one memory configured to store program code; and
at least one processor configured to read the program code and operate as instructed by the program code, the program code including:
first determining code configured to cause the at least one processor to determine a bandwidth availability associated with an end client and characteristics associated with a scene to be transmitted to the end client;
second determining code configured to cause the at least one processor to, when the bandwidth availability is a limited availability, adjust the scene to be transmitted to the end client to a first depth based on the characteristics associated with the scene, wherein the first depth corresponds to the bandwidth availability, and wherein the first depth indicates a distance from a camera to a respective object; and
transmitting code configured to cause the at least one processor to transmit an adaptive stream of the lightfield or the holographic immersive media comprising the adjusted scene.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the program code comprises:
third determining code configured to cause the at least one processor to when the bandwidth availability is not the limited availability, adjust the scene to be transmitted to the end client at a full depth based on the characteristics associated with the scene.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the program code comprises:
first adjusting code configured to cause the at least one processor to adjust the scene to be transmitted to exclude one or more objects in the scene, wherein the one or more objects are at a distance beyond the first depth.

### Claim 11 (depends on 8)

The apparatus of claim 8, wherein the program code comprises:
fourth determining code configured to cause the at least one processor to determine a priority associated with one or more objects in the scene to be transmitted based on a distance of the one or more objects within the first depth and an imaging device capturing the scene; and
third adjusting code configured to cause the at least one processor to adjust the scene to be transmitted to include the one or more objects based on the threshold priority.

### Claim 12 (depends on 8)

The apparatus of claim 8, wherein the program code comprises:
fourth adjusting code configured to cause the at least one processor to adjust the scene to be transmitted to include one or more second objects in the scene, wherein the one or more second objects are at a distance within the first depth.

### Claim 13

A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device for adaptive streaming of lightfield or holographic immersive media, cause the one or more processors to:
determine a bandwidth availability associated with an end client and characteristics associated with a scene to be transmitted to the end client;
when the bandwidth availability is a limited availability, adjust the scene to be transmitted to the end client to a first depth based on the characteristics associated with the scene, wherein the first depth corresponds to the bandwidth availability, and wherein the first depth indicates a distance from a camera to a respective object; and
transmit an adaptive stream of the lightfield or the holographic immersive media comprising the adjusted scene.

### Claim 14 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the one or more instructions that, when executed by the one or more processors of the device for adaptive streaming of lightfield or holographic immersive media, cause the one or more processors to:
when the bandwidth availability is not the limited availability, adjust the scene to be transmitted to the end client at a full depth based on the characteristics associated with the scene.

### Claim 15 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein adjusting the scene to be transmitted comprises:
adjusting the scene to be transmitted to exclude one or more objects in the scene, wherein the one or more objects are at a distance beyond the first depth.

### Claim 16 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein adjusting the scene to be transmitted comprises:
determining a priority associated with one or more objects in the scene to be transmitted based on a distance of the one or more objects within the first depth and an imaging device capturing the scene; and
adjusting the scene to be transmitted to include the one or more objects based on the priority.

### Claim 17 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein adjusting the scene to be transmitted comprises:
adjusting the scene to be transmitted to include one or more objects in the scene, wherein the one or more second objects are at a distance within the first depth.
