# US 2024/0205469 A1 · Apparatus and method for processing cloud streaming low latency playback

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0205469 A1
- Document ID: US20240205469A1
- Status: Published application
- Kind: A1
- Application number: 18/491,729
- Filed: 2023-10-20
- Published: 2024-06-20
- Earliest claimed: 2022-12-19
- Assignees: SK Planet Co., Ltd.
- Applicants: SK Planet Co., Ltd.
- Inventors: Ji-Yeon HWANG
- Web page: https://patentgrep.com/patent/US20240205469A1

## CPC

- H04N 21/2343: involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements {(video transcoding H04N19/40; media packet handling at the source H04L65/762)}
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed herein are an apparatus and method for processing cloud streaming low latency playback. The cloud streaming low latency playback processing method in a client apparatus according to an embodiment of the present disclosure may further include checking each piece of time information about decoded audio data and decoded video data to determine whether a time difference between the decoded audio data and video data, and adjusting one of a decoding speed of audio data and a decoding speed of video data when a time difference is greater than a preset threshold value.

## Claims

### Claim 1

A client apparatus, comprising:
a network interface configured to receive encoded audio data, encoded video data, and a control signal in a separated state;
a first decoder configured to decode the encoded audio data output from the network interface;
a second decoder configured to decode the encoded video data output from the network interface; and
a control unit configured to control the first decoder and the second decoder based on the control signal output from the network interface, and control audio data and video data output respectively from the first decoder and the second decoder to be played back through a user interface.

### Claim 2 (depends on 1)

The client apparatus of claim 1, wherein the control unit checks time information about each of the decoded audio data and the decoded video data, and controls the audio data and video data output respectively from the first decoder and the second decoder to be played back through the user interface when a time difference between the decoded audio data and the decoded video data is less than or equal to a preset threshold value.

### Claim 3 (depends on 1)

The client apparatus of claim 1, wherein the control unit checks time information about each of the decoded audio data and the decoded video data, and adjusts a decoding speed of one of the first decoder and the second decoder when a time difference between the decoded audio data and the decoded video data is greater than a preset threshold value.

### Claim 4 (depends on 2)

The client apparatus of claim 2, further comprising:
a first buffer configured to store the encoded audio data output from the network interface;
a second buffer configured to store the encoded video data output from the network interface; and
a buffer control unit configured to adjust sizes of the first buffer and the second buffer, and buffer the audio data and the video data in the first buffer and the second buffer.

### Claim 5 (depends on 4)

The client apparatus of claim 4, wherein:
the control unit checks time information about each of the decoded audio data and the decoded video data, and transmits time difference information to the buffer control unit when a time difference between the decoded audio data and the decoded video data is greater than a preset threshold value, and
the buffer control unit adjusts a size of one of the first buffer and the second buffer based on the time difference information so that the time difference is less than or equal to the preset threshold value.

### Claim 6 (depends on 4)

The client apparatus of claim 4, wherein the network interface receives the encoded audio data over a first communication network and receives the encoded video data over a second communication network.

### Claim 7 (depends on 6)

The client apparatus of claim 6, further comprising:
a network state check unit configured to periodically check a state of the communication networks,
wherein the control unit adjusts a size of one of the first buffer and the second buffer through the buffer control unit depending on a check result of the network state check unit, or adjusts a decoding speed of one of the first decoder and the second decoder.

### Claim 8

A cloud streaming processing method in a client apparatus, comprising:
receiving encoded audio data, encoded video data, and a control signal in a separated state;
decoding the received encoded audio data based on the control signal;
decoding the received encoded video data based on the control signal; and
outputting the decoded audio data and the decoded video data through a user interface.

### Claim 9 (depends on 8)

The cloud streaming processing method of claim 8, further comprising:
checking playback time information about each of the decoded audio data and the decoded video data to compare a time difference between the decoded audio data and the decoded video data; and
adjusting one of a decoding speed of audio data and a decoding speed of video data when the time difference between the decoded audio data and the decoded video data is greater than a preset threshold value.

### Claim 10 (depends on 8)

The cloud streaming processing method of claim 8, further comprising:
buffering the encoded audio data output from a network interface through a first buffer;
buffering the encoded video data output from the network interface through a second buffer;
checking playback time information about each of the decoded audio data and the decoded video data to compare a time difference between the decoded audio data and the decoded video data; and
adjusting sizes of the first buffer and the second buffer.
