# US 2025/0220139 A1 · Optimizing media experience in conferencing with diverse participants

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0220139 A1
- Document ID: US20250220139A1
- Status: Published application
- Kind: A1
- Application number: 18/989,176
- Filed: 2024-12-20
- Published: 2025-07-03
- Earliest claimed: 2021-06-04
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Gurtej Singh G. Chandok; Christopher M. Garrido; Chieh Lu; Daniel B. Pollack; Karthick Santhanam; David L. Biderman; Jinbo Qui; Dazhong Zhang; Jose A. Lozano Hinojosa; Igor Kobzar
- Web page: https://patentgrep.com/patent/US20250220139A1

## CPC

- H04N 7/15: Conference systems
- H04N 7/152: {Multipoint control units therefor}
- H04N 19/40: using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Participant systems in an audiovisual (AV) conferencing can, in one embodiment, use methods to ensure that all participants have a common platform to support AV conferencing, such as a common codec, and also attempt to provide higher quality AV conferencing (e.g., better than the common codec) based on available bandwidth and other criteria. The participant systems can use the common codec as a fallback platform when bandwidth or other criteria dictate a reduction in the quality of the AV conferencing. Other embodiments are also disclosed.

## Claims

### Claim 1

A non-transitory machine readable medium storing executable program instructions which when executed by a first data processing system cause the first data processing system to perform a method in an environment that includes the first data processing system and a second data processing system and a third data processing system and a server, the method comprising:
transmitting, by the first data processing system to the server, codec capabilities of the first data processing system, the codec capabilities of the first data processing system indicating a first set of codecs in the first data processing system that are available for use in an audiovisual (AV) conference;
receiving, by the first data processing system, a second set of codec capabilities of the second data processing system, the second set of codec capabilities indicating a second set of codecs in the second data processing system that are available for use in the AV conference;
receiving, at the first data processing system, a request from the second data processing system to receive a first stream, encoded with a first codec, in the AV conference, the first codec in the first set of codecs in the first data processing system;
transmitting, by the first data processing system to the server, the first stream for delivery to the second data processing system;
receiving, by the first data processing system, a request from the third data processing system for a second stream, encoded with a second codec, in the AV conference, the second codec being in the first set of codecs and being different than the first codec;
creating, on demand and in response to the request from the third data processing system, the second stream in the AV conference; and
transmitting the second stream to the server for delivery to the third data processing system while the first data processing system continues to transmit the first stream to the server for delivery to the second data processing system.

### Claim 2 (depends on 1)

The non-transitory machine readable medium as in claim 1, wherein each codec in the first set of codecs and in the second set of codecs is configured to compress video content in an AV conference for transmission to other participants in the AV conference and is configured to decompress video content received in the AV conference.

### Claim 3 (depends on 1)

The non-transitory machine readable medium as in claim 1, wherein the second codec is a codec that is common to and available for use in the first, the second and the third data processing systems.

### Claim 4 (depends on 1)

The non-transitory machine readable medium as in claim 1 wherein the first and the second data processing systems execute one or more versions of a first operating system during the AV conference and the third data processing system executes a second operating system during the AV conference.

### Claim 5 (depends on 1)

The non-transitory machine readable medium as in claim 1, wherein the method further comprises:
receiving, at the first data processing system, a third stream in the AV conference from the second data processing system, the third stream encoded with the first codec; decoding the third stream using the first codec; receiving, at the first data processing system, a fourth stream in the AV conference from the third data processing system, the fourth stream encoded with the second codec; decoding the fourth stream using the second codec at the first data processing system; and displaying video from the third stream, video from the fourth stream and video from the first stream on a display of the first data processing system.

### Claim 6 (depends on 3)

The non-transitory machine readable medium as in claim 3, wherein the method further comprises:
monitoring, by the first data processing system, one or more of: uplink bandwidth from the first data processing system, thermal data about the thermal state of the first data processing system, or battery state about a battery in the first data processing system;
in response to one or more conditions determined from the monitoring, switching from transmitting to the second data processing system the first stream to transmitting to the second data processing system the second stream.

### Claim 7 (depends on 6)

The non-transitory machine readable medium as in claim 6, wherein the switching comprises: associating the second stream with a stream identifier of the first stream to cause the server to forward the second stream to the second data processing system.

### Claim 8 (depends on 6)

The non-transitory machine readable medium as in claim 6, wherein the method further comprises:
transmitting, by the first data processing system, an indication to the server, for delivery to the second data processing system, that the first data processing system has or will stop transmitting the first stream for delivery to the second data processing system;
receiving a request, from the second data processing system, for the second stream;
transmitting, by the first data processing system, the second stream to the server for delivery to the second data processing system.

### Claim 9

A method performed by a server in an environment that includes the server, a first data processing system and a second data processing system and a third data processing system, the method comprising:
receiving, by the server from the first data processing system, codec capabilities of the first data processing system, the codec capabilities of the first data processing system indicating a first set of codecs in the first data processing system that are available for use in an audiovisual (AV) conference;
transmitting, by the server to the first data processing system, a second set of codec capabilities of the second data processing system, the second set of codec capabilities indicating a second set of codecs in the second data processing system that are available for use in the AV conference;
transmitting, by the server to the first data processing system, a request from the second data processing system to receive a first stream, encoded with a first codec, in the AV conference, the first codec in the first set of codecs in the first data processing system;
receiving, by the server from the first data processing system, the first stream for delivery to the second data processing system;
transmitting, by the server to first data processing system, a request from the third data processing system for a second stream, encoded with a second codec, in the AV conference, the second codec being in the first set of codecs and being different than the first codec; and
receiving the second stream at the server for delivery to the third data processing system while the server continues to transmit the first stream to the second data processing system.

### Claim 10 (depends on 9)

The method as in claim 9, wherein each codec in the first set of codecs and in the second set of codecs is configured to compress video content in an AV conference for transmission to other participants in the AV conference and is configured to decompress video content received in the AV conference, and wherein the server is a set of one or more data processing systems.

### Claim 11 (depends on 10)

The method as in claim 10, wherein the second codec is a codec that is common to and available for use in the first, the second and the third data processing systems.

### Claim 12 (depends on 11)

The method as in claim 11, wherein the method further comprises:
switching from transmitting to the second data processing system the first stream to transmitting to the second data processing system the second stream.

### Claim 13 (depends on 12)

The method as in claim 12, wherein the switching comprises: receiving a stream identifier for the second stream to cause the server to forward the second stream to the second data processing system.

### Claim 14 (depends on 12)

The method as in claim 12, wherein the method further comprises:
receiving, by the server from the first data processing system, an indication, for delivery to the second data processing system, that the first data processing system has or will stop transmitting the first stream for delivery to the second data processing system;
transmitting a request, from the second data processing system, for the second stream;
receiving, by the server from the first data processing system, the second stream for delivery to the second data processing system.

### Claim 15

A method performed by a first data processing system in an environment that includes the first data processing system and a second data processing system and a third data processing system and a server, the method comprising:
transmitting, by the first data processing system to the server, codec capabilities of the first data processing system, the codec capabilities of the first data processing system indicating a first set of codecs in the first data processing system that are available for use in an audiovisual (AV) conference;
receiving, by the first data processing system, a second set of codec capabilities of the second data processing system, the second set of codec capabilities indicating a second set of codecs in the second data processing system that are available for use in the AV conference;
receiving, at the first data processing system, a request from the second data processing system to receive a first stream, encoded with a first codec, in the AV conference, the first codec in the first set of codecs in the first data processing system;
transmitting, by the first data processing system to the server, the first stream for delivery to the second data processing system;
receiving, by the first data processing system, a request from the third data processing system for a second stream, encoded with a second codec, in the AV conference, the second codec being in the first set of codecs and being different than the first codec;
creating, on demand and in response to the request from the third data processing system, the second stream in the AV conference; and
transmitting the second stream to the server for delivery to the third data processing system while the first data processing system continues to transmit the first stream to the server for delivery to the second data processing system.

### Claim 16 (depends on 15)

The method as in claim 15, wherein each codec in the first set of codecs and in the second set of codecs is configured to compress video content in an AV conference for transmission to other participants in the AV conference and is configured to decompress video content received in the AV conference.

### Claim 17 (depends on 15)

The method as in claim 15, wherein the second codec is a codec that is common to and available for use in the first, the second and the third data processing systems.

### Claim 18 (depends on 15)

The method as in claim 15 wherein the first and the second data processing systems execute one or more versions of a first operating system during the AV conference and the third data processing system executes a second operating system during the AV conference.

### Claim 19 (depends on 15)

The method as in claim 15, wherein the method further comprises:
receiving, at the first data processing system, a third stream in the AV conference from the second data processing system, the third stream encoded with the first codec; decoding the third stream using the first codec; receiving, at the first data processing system, a fourth stream in the AV conference from the third data processing system, the fourth stream encoded with the second codec; decoding the fourth stream using the second codec at the first data processing system; and displaying video from the third stream, video from the fourth stream and video from the first stream on a display of the first data processing system.

### Claim 20 (depends on 17)

The method as in claim 17, wherein the method further comprises:
monitoring, by the first data processing system, one or more of: uplink bandwidth from the first data processing system, thermal data about the thermal state of the first data processing system, or battery state about a battery in the first data processing system;
in response to one or more conditions determined from the monitoring, switching from transmitting to the second data processing system the first stream to transmitting to the second data processing system the second stream.

### Claim 21 (depends on 20)

The method as in claim 20, wherein the switching comprises: associating the second stream with a stream identifier of the first stream to cause the server to forward the second stream to the second data processing system.

### Claim 22 (depends on 20)

The method as in claim 20, wherein the method further comprises:
transmitting, by the first data processing system, an indication to the server, for delivery to the second data processing system, that the first data processing system has or will stop transmitting the first stream for delivery to the second data processing system;
receiving a request, from the second data processing system, for the second stream;
transmitting, by the first data processing system, the second stream to the server for delivery to the second data processing system.

### Claim 23

A non-transitory machine readable medium storing executable program instructions which when executed by a first data processing system cause the first data processing system to perform a method in an environment that includes the first data processing system and a second data processing system and a server, the method comprising:
transmitting, by the first data processing system to the server, codec capabilities of the first data processing system, the codec capabilities of the first data processing system indicating a first set of codecs in the first data processing system that are available for use in an audiovisual (AV) conference;
receiving, by the first data processing system, a second set of codec capabilities of the second data processing system, the second set of codec capabilities indicating a second set of codecs in the second data processing system that are available for use in the AV conference;
transmitting, by the first data processing system to the server, a request for a first stream encoded by a first codec at the second data processing system, the request based on criteria at the first data processing system of a highest quality codec that is common to the first and the second sets of codecs.
