# US 2020/0288085 A1 · Multiway audio-video conferencing with multiple communication channels per device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0288085 A1
- Document ID: US20200288085A1
- Status: Published application
- Kind: A1
- Application number: 16/735,584
- Filed: 2020-01-06
- Published: 2020-09-10
- Earliest claimed: 2017-09-29
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Yan YANG; Thomas P. DEVANNEAUX; Daniel B. POLLACK; Vu H. CHIEM
- Web page: https://patentgrep.com/patent/US20200288085A1

## CPC

- H04N 7/155: {involving storage of or access to video conference sessions (tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831)}
- H04L 67/55: Push-based network services
- H04N 7/148: {Interfacing a video terminal to a particular transmission medium, e.g. ISDN}
- H04N 7/152: {Multipoint control units therefor}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A device implementing a system for multiway audio-video conferencing includes a processor configured to receive, from a first device, indication of a first channel and a second channel for communicating content for an audio-video conference session. The first channel and the second channel correspond to different types of communication interfaces. The processor is further configured to receive, from the first device, a first request to subscribe to a first content stream for the audio-video conference session via the first channel, and to subscribe to a second content stream for the audio-video conference session via the second channel, and in response to receiving the first request, forward, to the first device, the first content stream via the first channel.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A method comprising:
receiving, by an electronic device, a request to initiate an audio-video conference session with a plurality of participants;
responsive to receiving the request, providing, for transmission to a server, a request to allocate the audio-video conference session, wherein the request comprises a respective identifier of at least one of the plurality of participants;
receiving, from the server and responsive to the at least one of the plurality of participants joining the audio-video conference session, an indication of a first content stream and a second content stream available from another electronic device corresponding to the at least one of the plurality of participants, the first and second content streams corresponding to different bit rates of streaming content for the audio-video conference session; and
providing, for transmission to the server, a request to receive the first content stream for the at least one of the plurality of participants of the audio-video conference session when the first content stream is available, and to receive the second content stream for the at least one of the plurality of participants when the first content stream is unavailable.

### Claim 22 (depends on 21)

The method of claim 21, further comprising:
receiving, from the server, an allocation response that comprises access information for the audio-video conference session; and
providing, for transmission to the server, the access information in conjunction with a first indication of a third content stream available from the electronic device for the audio-video conference session via a first communication interface and a second indication of whether the electronic device is configured to provide a fourth content stream for the audio-video conference session via a second communication interface, the first and second content streams corresponding to different bit rates of another streaming content for the audio-video conference session.

### Claim 23 (depends on 21)

The method of claim 21, wherein, the request is received by the electronic device via an another application used for a different mode of communication other than audio-video conferencing.

### Claim 24 (depends on 23)

The method of claim 23, further comprising:
receiving, from the server, the first content stream; and
displaying, via an audio-video conferencing application, the first content stream for the audio-video conference session.

### Claim 25 (depends on 24)

The method of claim 24, further comprising:
receiving, from the server, the second content stream in place of the first content stream; and
transitioning from displaying the first content stream to displaying the second content stream responsive to receiving the second content stream in place of the first content stream.

### Claim 26 (depends on 25)

The method of claim 25, wherein the transitioning is performed at a key frame of the first content stream.

### Claim 27 (depends on 25)

The method of claim 25, wherein the first content stream has a higher bit rate than the second content stream.

### Claim 28

A device comprising:
a memory; and
at least one processor configured to:
receive, from a server, an invitation to participate in an audio-video conference session having a plurality participants;
display a prompt for accepting the invitation;
responsive to receipt of an acceptance of the invitation, provide, for transmission to the server, a first indication of a first content stream available for the audio-video conference session via a first communication interface and a second indication of whether the device is configured to provide a second content stream for the audio-video conference session over a second communication interface, the first and second content streams corresponding to different bit rates of streaming content for the audio-video conference session; and
provide, for transmission to the server via the first communication interface, the first content stream for the audio-video conference session.

### Claim 29 (depends on 28)

The device of claim 28, wherein the at least one processor is further configured to:
when the second indication indicates that the device supports providing the second content stream for the audio-video conference session over the second communication interface, provide, for transmission to the server via the second communication interface, the second content stream for the audio-video conference session.

### Claim 30 (depends on 29)

The device of claim 29, wherein the at least one processor is further configured to:
concurrently provide, for transmission to the server, the first content stream via the first communication interface and the second content stream via the second communication interface.

### Claim 31 (depends on 28)

The device of claim 28, wherein the at least one processor is further configured to:
receive, from the server, a third content stream for the audio-video conference session, the third content stream corresponding to one of the plurality of participants; and
display the third content stream for the audio-video conference session.

### Claim 32 (depends on 31)

The device of claim 31, wherein the at least one processor is further configured to:
receive, from the server, a fourth content stream for the audio-video conference session, the fourth content stream corresponding to the one of the plurality of participants, and the third and fourth content streams corresponding to different bit rates of other streaming content for the audio-video conference session.

### Claim 33 (depends on 32)

The device of claim 32, wherein the at least one processor is further configured to:
concurrently receive, from the server, the third and fourth content streams.

### Claim 34 (depends on 33)

The device of claim 33, wherein the at least one processor is configured to:
switch from displaying the third content stream to displaying the fourth content stream for the audio-video conference session responsive to detecting a threshold amount of packet loss corresponding to the third content stream, wherein the fourth content stream has a lower bit rate than the third content stream.

### Claim 35 (depends on 32)

The device of claim 32, wherein each of the third and fourth content streams is independently displayable.

### Claim 36

A non-transitory machine readable medium comprising code that, when executed by one or more processors causes the one or more processors to perform operations, the code comprising:
code to receive, from a first electronic device associated with a first user, a request to initiate an audio-video conference session with a second user associated with a second electronic device and a third user associated with a third electronic device;
code to transmit respective access information for the audio-video conference session to the first, second, and third electronic devices;
code to receive, from the first, second, and third electronic devices, the respective access information and respective indications of content streams available from each of the first, second, and third electronic devices for the audio-video conference session; and
code to transmit session information for the audio-video conference session to the first, second, and third electronic devices, the session information indicating the content streams available from the first, second, and third electronic devices for the audio-video conference session.

### Claim 37 (depends on 36)

The non-transitory machine readable medium of claim 36, wherein the code further comprises:
code to receive, from the first electronic device, a request to receive a first content stream corresponding to the second electronic device when the first content stream is available, and to receive a second content stream corresponding to the second electronic device when the first content stream is unavailable;
code to receive, from the second electronic device, the first content stream; and
code to transmit, to the first electronic device, the first content stream.

### Claim 38 (depends on 37)

The non-transitory machine readable medium of claim 37, wherein the code further comprises:
code to receive, from the second electronic device, the second content stream concurrently with the first content stream;
code to determine that the first content stream has become unavailable; and
code to transmit, to the first electronic device, the second content stream in place of the first content stream.

### Claim 39 (depends on 38)

The non-transitory machine readable medium of claim 38, wherein the first and second content streams correspond to different bit rates.

### Claim 40 (depends on 36)

The non-transitory machine readable medium of claim 36, wherein the code further comprises:
code to receive, from the first electronic device, another indication of whether the first electronic device is configured to transmit content streams for the audio-video conference session over multiple communication interfaces.
