# US 2023/0403311 A1 · Videoconferencing with Reduced Quality Interruptions Upon Participant Join

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0403311 A1
- Document ID: US20230403311A1
- Status: Published application
- Kind: A1
- Application number: 18/450,096
- Filed: 2023-08-15
- Published: 2023-12-14
- Earliest claimed: 2022-04-15
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Stefan Karl Holmer; Danil Chapovalov
- Web page: https://patentgrep.com/patent/US20230403311A1

## CPC

- H04L 65/1093: by adding participants; by removing participants
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04L 65/80: Responding to QoS
- H04N 7/152: {Multipoint control units therefor}
- H04N 19/463: by compressing encoding parameters before transmission
- H04N 21/6379: directed to encoder {, e.g. for requesting a lower encoding rate}
- H04N 21/6547: comprising parameters, e.g. for client setup
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In an embodiment, a computing system can include one or more processors and one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the computing system to perform operations. The operations can include: receiving an internal encoder state of an encoder running on a first computing device being used to participate in a video conference currently in progress; receiving data indicative of a second computing device being used to join the video conference; compressing, based at least in part on receipt of the data, the internal encoder state to generate a compressed internal encoder state of the encoder; and/or transmitting the compressed internal encoder state to the second computing device to synchronize the internal encoder state of the encoder running on the first computing device with an internal decoder state of a decoder running on the second computing device.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

A computer-implemented method, comprising:
joining, by a first computing device operatively coupled to one or more processors, a video conference currently in progress, wherein the video conference comprises the first computing device and a second computing device, and wherein joining the video conference comprises running a decoder;
receiving, by the first computing device, data indicative of an internal encoder state of an encoder running on the second computing device; and
using, by the first computing device, the data indicative of the internal encoder state to synchronize an internal decoder state of the decoder running on the first computing device with the internal encoder state of the encoder running on the second computing device.

### Claim 22 (depends on 21)

The computer-implemented method of claim 21, wherein receiving the data indicative of the internal encoder state of the encoder running on the second computing device comprises:
receiving, by the first computing device from the second computing device, the data indicative of the internal encoder state of the encoder running on the second computing device.

### Claim 23 (depends on 21)

The computer-implemented method of claim 21, wherein receiving the data indicative of the internal encoder state of the encoder running on the second computing device comprises:
receiving, by the first computing device from a computing system that hosts the video conference, the data indicative of the internal encoder state of the encoder running on the second computing device.

### Claim 24 (depends on 21)

The computer-implemented method of claim 21, wherein the internal encoder state comprises at least one of: one or more portions of one or more reference frames of video data associated with the video conference; or statistical data corresponding to at least one of the one or more portions of the one or more reference frames or the one or more reference frames.

### Claim 25 (depends on 21)

The computer-implemented method of claim 21, wherein receiving the data indicative of the internal encoder state of the encoder running on the second computing device comprises:
receiving, by the first computing device from the second computing device, a compressed internal encoder state of the encoder running on the second computing device.

### Claim 26 (depends on 25)

The computer-implemented method of claim 25, wherein the compressed internal encoder state comprises at least one of: one or more compressed portions of one or more reference frames of video data associated with the video conference; or compressed statistical data corresponding to at least one of the one or more compressed portions of the one or more reference frames or the one or more reference frames.

### Claim 27 (depends on 25)

The computer-implemented method of claim 25, wherein using the data indicative of the internal encoder state to synchronize the internal decoder state of the decoder running on the first computing device with the internal encoder state of the encoder running on the second computing device comprises:
receiving, by the first computing device, an instruction from the second computing device instructing the first computing device to use the compressed internal encoder state to update the internal decoder state of the decoder running on the first computing device to synchronize the internal encoder state of the encoder with the internal decoder state of the decoder; and
using, by the first computing device, the compressed internal encoder state to synchronize the internal decoder state of the decoder running on the first computing device with the internal encoder state of the encoder running on the second computing device.

### Claim 28 (depends on 21)

The computer-implemented method of claim 21, wherein the method further comprises:
receiving, by the first computing device, a current delta frame of video data associated with the video conference from the second computing device, the current delta frame being current at a time the first computing device joins the video conference.

### Claim 29

A first computing device, comprising:
one or more processors; and
one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the first computing device to perform operations, the operations comprising:
joining a video conference currently in progress, wherein the video conference comprises the first computing device and a second computing device, and wherein joining the video conference comprises running a decoder;
receiving data indicative of an internal encoder state of an encoder running on the second computing device; and
using the data indicative of the internal encoder state to synchronize an internal decoder state of the decoder running on the first computing device with the internal encoder state of the encoder running on the second computing device.

### Claim 30 (depends on 29)

The first computing device of claim 29, wherein receiving the data indicative of the internal encoder state of the encoder running on the second computing device comprises:
receiving, from the second computing device, the data indicative of the internal encoder state of the encoder running on the second computing device.

### Claim 31 (depends on 29)

The first computing device of claim 29, wherein receiving the data indicative of the internal encoder state of the encoder running on the second computing device comprises:
receiving, from a computing system that hosts the video conference, the data indicative of the internal encoder state of the encoder running on the second computing device.

### Claim 32 (depends on 29)

The first computing device of claim 29, wherein the internal encoder state comprises at least one of: one or more portions of one or more reference frames of video data associated with the video conference; or statistical data corresponding to at least one of the one or more portions of the one or more reference frames or the one or more reference frames.

### Claim 33 (depends on 29)

The first computing device of claim 29, wherein receiving the data indicative of the internal encoder state of the encoder running on the second computing device comprises:
receiving, from the second computing device, a compressed internal encoder state of the encoder running on the second computing device.

### Claim 34 (depends on 33)

The first computing device of claim 33, wherein the compressed internal encoder state comprises at least one of: one or more compressed portions of one or more reference frames of video data associated with the video conference; or compressed statistical data corresponding to at least one of the one or more compressed portions of the one or more reference frames or the one or more reference frames.

### Claim 35 (depends on 33)

The first computing device of claim 33, wherein using the data indicative of the internal encoder state to synchronize the internal decoder state of the decoder running on the first computing device with the internal encoder state of the encoder running on the second computing device comprises:
receiving an instruction from the second computing device instructing the first computing device to use the compressed internal encoder state to update the internal decoder state of the decoder running on the first computing device to synchronize the internal encoder state of the encoder with the internal decoder state of the decoder; and
using the compressed internal encoder state to synchronize the internal decoder state of the decoder running on the first computing device with the internal encoder state of the encoder running on the second computing device.

### Claim 36 (depends on 29)

The first computing device of claim 29, wherein the operations further comprises:
receiving a current delta frame of video data associated with the video conference from the second computing device, the current delta frame being current at a time the first computing device joins the video conference.

### Claim 37

One or more non-transitory computer-readable media that store instructions that, when executed by one or more processors of a first computing device, cause the first computing device to perform operations, the operations comprising:
joining a video conference currently in progress, wherein the video conference comprises the first computing device and a second computing device, and wherein joining the video conference comprises running a decoder;
receiving data indicative of an internal encoder state of an encoder running on the second computing device; and
using the data indicative of the internal encoder state to synchronize an internal decoder state of the decoder running on the first computing device with the internal encoder state of the encoder running on the second computing device.

### Claim 38 (depends on 37)

The one or more non-transitory computer-readable media of claim 37, wherein receiving the data indicative of the internal encoder state of the encoder running on the second computing device comprises:
receiving, from the second computing device, the data indicative of the internal encoder state of the encoder running on the second computing device.

### Claim 39 (depends on 37)

The one or more non-transitory computer-readable media of claim 37, wherein receiving the data indicative of the internal encoder state of the encoder running on the second computing device comprises:
receiving, from a computing system that hosts the video conference, the data indicative of the internal encoder state of the encoder running on the second computing device.

### Claim 40 (depends on 37)

The one or more non-transitory computer-readable media of claim 37, wherein the internal encoder state comprises at least one of: one or more portions of one or more reference frames of video data associated with the video conference; or statistical data corresponding to at least one of the one or more portions of the one or more reference frames or the one or more reference frames.
