# US 12,634,534 B2 · Electronic device and operation method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,634,534 B2
- Document ID: US12634534B2
- Status: Granted
- Kind: B2
- Application number: 18/124,188
- Filed: 2023-03-21
- Published: 2023-07-13
- Granted: 2026-05-19
- Earliest claimed: 2020-09-21
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Jongin Lee; Sehyun Kim; Kilsoo Choi; Jiwon Park
- Web page: https://patentgrep.com/patent/US12634534B2

## CPC

- H04N 21/2385: Channel allocation (H04N21/266 takes precedence); Bandwidth allocation (H04N21/24 takes precedence {; allocation of channels according to the instantaneous demands of the users in time-division multiplex systems H04J3/1682; admission control, resource allocation in open networks H04L12/5692; arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896; negotiating bandwidth in wireless networks H04W28/16})
- H04L 65/612: for unicast
- H04L 65/80: Responding to QoS
- H04N 21/26216: {involving the channel capacity, e.g. network bandwidth (admission control, resource allocation in open networks H04L12/5692; flow control in packet networks H04L47/10; establishing a schedule or organising the servicing of application requests taking into account QoS H04L67/61)}
- H04N 21/44209: {Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network (arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/44004: {involving video buffer management, e.g. video decoder buffer or video display buffer}
- H04N 21/44227: {Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network (configuring of peripheral devices in general G06F9/4411; monitoring connectivity in data switched networks H04L43/0811)}
- H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

An operating method of an electronic apparatus includes receiving multi-streams that include a first to N-th streams in a descending order of priority, obtaining multi-content corresponding to the multi-streams, and outputting the multi-content in a multi-view mode so that the multi-content corresponding to the multi-streams is respectively output to a plurality of partial screens. The receiving of the multi-streams includes determining a bit rate of each of the multi-streams according to priorities among the multi-streams and buffering each stream at the determined bit rate, and the multi-streams include a main stream having a higher priority and one or more sub-streams having a lower priority than the main stream.

## Claims

### Claim 1

An operating method of an electronic apparatus, the operating method comprising:
receiving multi-streams that include a first to N-th streams in a descending order of priority based on priorities related to the multi-streams, respectively, N being a natural number equal to or greater than 2;
performing adaptive streaming in the receiving to thereby allocate network bandwidth in the descending order of priority starting from a stream having a highest priority among the first to N-th streams based on the priorities related to the multi-streams, respectively;
obtaining multi-content corresponding to the multi-streams; and
outputting the multi-content in a multi-view mode so that the multi-content corresponding to the multi-streams is respectively output to a plurality of partial screens,
wherein the adaptive streaming comprises:
predicting whether an underflow will occur in a buffer receiving a stream with a higher priority, among a plurality of buffers, and
buffering the stream with the higher priority and during the buffering of the stream with the higher priority, simultaneously continuing the buffering of the multi-streams according to a next priority among the multi-streams, based on no occurrence of an underflow being predicted in the buffer receiving the stream with the higher priority,
wherein the buffering of the stream with the next priority among the priorities related to the multi-streams comprises:
predicting a time point at which the buffering of the stream with the next priority among the priorities related to the multi-streams is to be completed;
identifying a packet to be reproduced at the predicted time point among packets of the multi-streams; and
performing buffering from a packet of the stream with the next priority among the priorities related to the multi-streams to be output in synchronization with the identified packet.

### Claim 2 (depends on 1)

The operating method of claim 1, further comprising obtaining additional information about a stream among the multi-streams,
wherein the additional information comprises priority identification information representing the priorities related to the multi-streams.

### Claim 3 (depends on 1)

The operating method of claim 1, further comprising receiving an input of priority identification information through a user interface.

### Claim 4 (depends on 1)

The operating method of claim 1, wherein the adaptive streaming comprises buffering each stream among the multi-streams based on a state of the network bandwidth, a space of the plurality of buffers, respectively, each receiving each stream among the multi-streams, and a bit rate of each stream among the multi-streams.

### Claim 5 (depends on 1)

The operating method of claim 1, wherein the buffering comprises, when no occurrence of the underflow is predicted in a first buffer, among the plurality of buffers, respectively receiving each of first to K-th (where K is a natural number greater than or equal to 2 and less than N) streams and occurrence of an underflow is predicted in a second buffer, among the plurality of buffers, receiving a (K+1)th stream, simultaneously buffering the first to K-th streams.

### Claim 6 (depends on 1)

The operating method of claim 1, wherein according to the adaptive streaming, no buffering is performed from the stream with the next priority among the priorities related to the multi-streams based on occurrence of an underflow being predicted in the buffer receiving the stream with the higher priority among the priorities related to the multi-streams.

### Claim 7 (depends on 6)

The operating method of claim 6, wherein the adaptive streaming further comprises re-buffering the stream with the next priority among the priorities related to the multi-streams based on an amount of data in the buffer receiving the stream with the higher priority among the priorities related to the multi-streams being predicted to be greater than or equal to a certain value.

### Claim 8 (depends on 1)

The operating method of claim 1, wherein the time point at which the buffering of the stream with the next priority among the priorities related to the multi-streams is to be completed is a first time point and the outputting of the multi-content in the multi-view mode comprises:
obtaining a second time point at which the multi-content is to be reproduced in synchronization with each other; and
adjusting a reproduction speed of content obtained from the stream with the next priority among the priorities related to the multi-streams and synchronizing and reproducing the content with content obtained from a respective stream, from the second time point at which the multi-content is to be reproduced, and
the synchronizing and reproducing comprises:
when the reproduction speed of the stream with the next priority among the priorities related to the multi-streams is lower than a reproduction speed of the respective stream, performing buffering while dropping a packet of a slower stream or a frame of the content obtained from the respective stream; and
when the reproduction speed of the stream with the next priority among the priorities related to the multi-streams is higher than the reproduction speed of the respective stream, reading a packet of a faster stream slowly from a buffer among the plurality of buffers that is different from the buffer receiving the stream with the higher priority.

### Claim 9

An electronic apparatus comprising:
a streamer to perform adaptive streaming to thereby allocate network bandwidth in a descending order of priority based on priorities related to multi-streams, respectively, and receive the multi-streams that include a first to N-th streams in the descending order of priority, respectively, N being a natural number equal to or greater than 2;
performing the adaptive streaming in the receiving starting from a stream having a highest priority among the first to N-th streams based on the priorities related to the multi-streams, respectively;
a display;
a memory storing one or more instructions; and
a processor configured to execute the one or more instructions stored in the memory, wherein the processor is configured to:
by executing the one or more instructions, obtain multi-content corresponding to multi-streams received through the streamer and control the display such that the multi-content is output in a multi-view mode so that the multi-content corresponding to the multi-streams is respectively output to a plurality of partial screens,
wherein the adaptive streaming comprises:
predicting whether an underflow will occur in a buffer receiving a stream with a higher priority, among a plurality of buffers, and
buffering the stream with the higher priority and during the buffering of the stream with the higher priority, simultaneously continuing the buffering of the multi-streams according to a next priority among the multi-streams based on no occurrence of an underflow being predicted in the buffer receiving the stream with the higher priority,
wherein the buffering of the stream with the next priority among the priorities related to the multi-streams comprises:
predicting a time point at which the buffering of the stream with the next priority among the priorities related to the multi-streams is to be completed;
identifying a packet to be reproduced at the predicted time point among packets of the multi-streams; and
performing buffering from a packet of the stream with the next priority among the priorities related to the multi-streams to be output in synchronization with the identified packet.

### Claim 10 (depends on 9)

The electronic apparatus of claim 9, wherein the streamer is configured to obtain additional information about a stream among the multi-streams,
wherein the additional information comprises priority identification information representing the priorities related to the multi-streams.

### Claim 11 (depends on 9)

The electronic apparatus of claim 9, further comprising a user interface,
wherein an input of priority identification information representing the priorities related to the multi-streams is received through the user interface.

### Claim 12 (depends on 9)

The electronic apparatus of claim 9, wherein the streamer is configured to:
buffer each stream among the multi-streams based on a state of the network bandwidth, a space of the plurality of buffers each receiving each stream among the multi-streams, and a bit rate of each stream among the multi-streams.

### Claim 13

A non-transitory computer-readable recording medium having recorded thereon a program for implementing an operating method of an electronic apparatus, the operating method comprising:
receiving multi-streams that include a first to N-th streams in a descending order of priority based on priorities related to the multi-streams, respectively, N being a natural number equal to or greater than 2;
performing adaptive streaming in the receiving to thereby allocate network bandwidth in the descending order of priority starting from a stream having a highest priority among the first to N-th streams based on priorities related to the multi-streams, respectively;
obtaining multi-content corresponding to the multi-streams; and
outputting the multi-content in a multi-view mode so that the multi-content corresponding to the multi-streams is respectively output to a plurality of partial screens,
wherein the adaptive streaming comprises:
predicting whether an underflow will occur in a buffer receiving a stream with a higher priority, among a plurality of buffers, and
buffering the stream with the higher priority and during the buffering of the stream with the higher priority, simultaneously continuing the buffering of the multi-streams according to a next priority among the multi-streams, based on no occurrence of an underflow being predicted in the buffer receiving the stream with the higher priority,
wherein the buffering of the stream with the next priority among the priorities related to the multi-streams comprises:
predicting a time point at which the buffering of the stream with the next priority among the priorities related to the multi-streams is to be completed;
identifying a packet to be reproduced at the predicted time point among packets of the multi-streams; and
performing buffering from a packet of the stream with the next priority among the priorities related to the multi-streams to be output in synchronization with the identified packet.
