# US 12,192,554 B2 · Electronic device content provisioning adjustments based on wireless communication channel bandwidth condition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,192,554 B2
- Document ID: US12192554B2
- Status: Granted
- Kind: B2
- Application number: 18/329,040
- Filed: 2023-06-05
- Published: 2023-12-07
- Granted: 2025-01-07
- Earliest claimed: 2018-09-28
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Moinul H. Khan; Jim C. Chou; Sorin C. Cismas
- Web page: https://patentgrep.com/patent/US12192554B2

## CPC

- H04N 21/2402: {Monitoring of the downstream path of the transmission network, e.g. bandwidth available (traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876)}
- H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
- H04L 1/0003: {by switching between different modulation schemes}
- H04L 1/0009: {by adapting the channel coding (H04L1/1812 takes precedence)}
- H04N 19/115: Selection of the code volume for a coding unit prior to coding
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/164: Feedback from the receiver or from the transmission channel
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04W 72/542: using measured or perceived quality
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.

## Claims

### Claim 1

A system that comprises:
a head-mounted device (HMD) configured to capture camera images, and to display content, wherein at least some of the content is virtual content; and
an electronic device in communication with the HMD via a wireless communication channel, configured to
perform image processing operations comprising one or more image processing algorithms applied to camera images received from the HMD, and to convey processed data to the HMD for display of the content by the HMD,
wherein, in response to a bandwidth condition of the wireless communication channel being less than a threshold, an operation of the HMD is adjusted to perform first adjusted image processing on the camera images, and the image processing operations of the electronic device are adjusted to reduce an amount of image processing operations performed by the electronic device,
wherein an amount of content data conveyed by the electronic device to the HMD via the wireless communication channel is reduced in accordance with the adjusted operation of the HMD and the adjusted operation of the electronic device.

### Claim 2 (depends on 1)

The system of claim 1, wherein the image processing operations are adjusted by selecting between different compression options for the content data to be conveyed to the wireless communication channel.

### Claim 3 (depends on 1)

The system of claim 1, wherein the image processing operations are adjusted by selecting between different foveation filter strength options.

### Claim 4 (depends on 1)

The system of claim 1, wherein the image processing operations comprise processing tracking data.

### Claim 5 (depends on 1)

The system of claim 1, wherein the image processing operations are adjusted by selectively combining a plurality of different compression options in response to the bandwidth condition of a wireless communication channel being less than a threshold for a predetermined amount of time, wherein the plurality of different compression options include data rate options, foveation filter strength options, color space options, frames per second adaptation options, and downscaling options.

### Claim 6 (depends on 5)

The system of claim 5, wherein the image processing operations are adjusted by adjusting the data rate options as a first priority in response to the bandwidth condition of the wireless communication channel being less than a threshold for a first time interval.

### Claim 7 (depends on 6)

The system of claim 6, wherein adjusting the foveation filter strength options is a second priority in response to the bandwidth condition of the wireless communication channel being less than a threshold for a second time interval greater than the first time interval.

### Claim 8 (depends on 1)

The system of claim 1, wherein the HMD is configured to merge the content data conveyed by the electronic device with the camera images.

### Claim 9

A non-transitory computer readable medium comprising computer readable code executable by one or more processors to:
perform image processing operations on camera images captured by a head mounted device (HMD); and
in response to a bandwidth condition of a communication channel between the HMD and an electronic device being less than a threshold:
cause the HMD to perform first adjusted image processing operations on the camera images,
cause the electronic device to perform second adjusted image processing operations on the camera images,
wherein an amount of content data conveyed by the electronic device to the HMD is reduced in accordance with the first adjusted image processing operations and the second adjusted image processing operations.

### Claim 10 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the image processing operations are adjusted by selecting between different compression options for the content data to be conveyed.

### Claim 11 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the image processing operations are adjusted by selecting between different foveation filter strength options.

### Claim 12 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the image processing operations comprise processing tracking data.

### Claim 13 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the image processing operations are adjusted by selectively combining a plurality of different compression options in response to the bandwidth condition of a wireless communication channel being less than a threshold for a predetermined amount of time, wherein the plurality of different compression options include data rate options, foveation filter strength options, color space options, frames per second adaptation options, and downscaling options.

### Claim 14 (depends on 13)

The non-transitory computer readable medium of claim 13, wherein the image processing operations are adjusted by adjusting the data rate options as a first priority in response to the bandwidth condition of the wireless communication channel being less than a threshold for a first time interval.

### Claim 15 (depends on 14)

The non-transitory computer readable medium of claim 14, wherein adjusting the foveation filter strength options is a second priority in response to the bandwidth condition of the wireless communication channel being less than a threshold for a second time interval greater than the first time interval.

### Claim 16 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the HMD is configured to merge the content data conveyed by the electronic device with the camera images.

### Claim 17

A method comprising:
performing image processing operations on camera images captured by a head mounted device (HMD); and
in response to a bandwidth condition of a communication channel between the HMD and an electronic device being less than a threshold:
causing the HMD to perform first adjusted image processing operations on the camera images, and
causing the electronic device to perform second adjusted image processing operations on the camera images,
wherein an amount of content data conveyed by the electronic device to the HMD via a wireless communication channel is reduced in accordance with the first adjusted image processing and the second adjusted image processing.

### Claim 18 (depends on 17)

The method of claim 17, wherein the image processing operations are adjusted by selectively combining a plurality of different compression options in response to the bandwidth condition of the wireless communication channel being less than a threshold for a predetermined amount of time, wherein the plurality of different compression options include data rate options, foveation filter strength options, color space options, frames per second adaptation options, and downscaling options.

### Claim 19 (depends on 18)

The method of claim 18, wherein the image processing operations are adjusted by adjusting the data rate options as a first priority in response to the bandwidth condition of the wireless communication channel being less than a threshold for a first time interval, and
wherein adjusting the foveation filter strength options is a second priority in response to the bandwidth condition of the wireless communication channel being less than a threshold for a second time interval greater than the first time interval.

### Claim 20 (depends on 17)

The method of claim 17, wherein the HMD is configured to merge the content data conveyed by the electronic device with the camera images.
