# US 10,771,854 B2 · Video streaming apparatus and method in electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,771,854 B2
- Document ID: US10771854B2
- Status: Granted
- Kind: B2
- Application number: 16/082,523
- Filed: 2017-03-03
- Published: 2019-03-28
- Granted: 2020-09-08
- Earliest claimed: 2016-03-05
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd
- Inventors: Ha-Kyung Jung; Hyun-Joo Lee; Jin-Hyoung Kim; Jiangwei Xu; Jin-Ho Lee
- Web page: https://patentgrep.com/patent/US10771854B2

## CPC

- H04N 21/6131: {involving transmission via a mobile phone network (wireless downlink channel access H04W74/006)}
- H04L 45/24: Multipath
- H04L 65/612: for unicast
- H04L 65/613: for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637)
- H04L 65/80: Responding to QoS
- H04N 21/238: Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams {(hybrid fiber coaxial [HFC] networks for downstream channel allocation for video distribution H04L12/2801; flow control in packet networks H04L47/10; real-time communication protocols in data switching networks H04L65/00; scheduling or organising the servicing of application requests H04L67/60)}
- H04N 21/2402: {Monitoring of the downstream path of the transmission network, e.g. bandwidth available (traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876)}
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04W 28/0205: {at the air interface (dynamic wireless traffic scheduling H04W72/12)}
- H04W 28/0231: {based on communication conditions (dynamic wireless traffic scheduling definition based on channel quality criteria H04W72/54)}
- H04W 28/0236: {radio quality, e.g. interference, losses or delay}
- H04W 40/12: based on transmission quality or channel quality
- H04W 40/248: {Connectivity information update}
- H04W 88/06: adapted for operation in multiple networks {or having at least two operational modes}, e.g. multi-mode terminals
- H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
- Y02D 30/70: in wireless communication networks
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

Disclosed is a 5G or pre-5G communication system. To this end, an electronic device transmits a request message to a server through each of a plurality of communication paths at least based on a multi-radio access technology, and receives a video segment from the server through each of the plurality of communication paths according to the request message. The electronic device estimates a transmission quality at each communication path on the basis of video segments received for each of the plurality of communication paths at a radio search point satisfying at least one preset condition. The electronic device can determine, by the transmission quality estimated according to each of the plurality of communication paths and the preset reference transmission quality, one communication mode, among a plurality of communication modes, for designating at least one communication path for supporting the video streaming, among the plurality of communication paths.

## Claims

### Claim 1

A video streaming method in an electronic device supporting multiple communication paths at least based on a multi-radio access technology, the video streaming method comprising:
sending a request message to a server through each of the multiple communication paths and receiving a video segment from the server through each of the multiple communication paths in response to the request message;
estimating a transmission quality in each of the multiple communication paths based on the received video segment received through each of the multiple communication paths;
determining one communication mode designating at least one communication path for supporting video streaming from among multiple communication modes, based on the transmission quality, estimated for each of the multiple communication paths, and a preset reference transmission quality,
wherein the multiple communication modes comprise a single transmission mode for supporting video streaming through one of the multiple communication paths, a main/backup transmission mode for supporting video streaming by using a first communication path as a main communication path and a second communication path as a backup communication path, and a merged transmission mode for supporting video streaming through two or more communication paths among the multiple communication paths; and
performing prefetching with respect to the video segment by using the backup communication path in case of serving video streaming by using the main communication path in the main/backup transmission mode.

### Claim 2 (depends on 1)

The video streaming method of claim 1, further comprising changing a current communication mode into the determined communication mode in case that the current communication mode is different from the determined communication mode.

### Claim 3 (depends on 1)

The video streaming method of claim 1, wherein determining the one communication mode comprises:
determining the merged transmission mode as a communication mode for supporting a video streaming service, in case that a first transmission quality estimated for the first communication path fails to satisfy a preset first reference transmission quality and a second transmission quality estimated for the second communication path fails to satisfy a preset second reference transmission quality; and
in case that the first transmission quality satisfies the preset first reference transmission quality, determining the main/backup transmission mode, which uses the first communication path as the main communication path and the second communication path as the backup communication path, as the communication mode for supporting the video streaming service.

### Claim 4 (depends on 1)

The video streaming method of claim 1, further comprising changing the communication mode from the merged transmission mode or the main/backup transmission mode to the single transmission mode using the first communication path, in case that connection to the second communication path is blocked while serving video streaming in the merged transmission mode or the main/backup transmission mode.

### Claim 5 (depends on 1)

The video streaming method of claim 1, wherein the receiving of the video segment comprises:
sending a request message to the server through each of the first communication path and the second communication path and receiving a video segment from the server through each of the first communication path and the second communication path in response to the request message, in case that connection to the second communication path is possible while serving video streaming in the single transmission mode using the first communication path, or connection to the first communication path is possible while serving video streaming in the single transmission mode using the second communication path.

### Claim 6

An electronic device, comprising:
a communication interface configured to perform wireless communication with a server through multiple communication paths at least based on a multi-radio access technology, for a video streaming service;
a memory in which a video segment received from the server is recorded in a designated region according to the video streaming service; and
a processor configured to control the video streaming service by using multiple communication modes,
wherein the processor is further configured to:
send a request message to the server through each of the multiple communication paths by using the communication interface,
receive a video segment from the server through each of the multiple communication paths in response to the request message,
estimate a transmission quality in each of the multiple communication paths based on the received video segment received through each of the multiple communication paths,
determine one communication mode from among the multiple communication modes based on a transmission quality estimated for each of the multiple communication paths and a preset reference transmission quality, wherein the multiple communication modes comprise a single transmission mode for supporting video streaming through one of the multiple communication paths, a main/backup transmission mode for supporting video streaming by using a first communication path as a main communication path and a second communication path as a backup communication path, and a merged transmission mode for supporting video streaming through two or more communication paths among the multiple communication paths, and
perform prefetching with respect to the video segment by using the backup communication path in case of serving video streaming by using the main communication path in the main/backup transmission mode.

### Claim 7 (depends on 6)

The electronic device of claim 6, wherein the processor is further configured to change a current communication mode into the determined communication mode in case that the current communication mode is different from the determined communication mode.

### Claim 8 (depends on 6)

The electronic device of claim 6, wherein the processor is further configured to:
determine the merged transmission mode as a communication mode for supporting the video streaming service, in case that a first transmission quality estimated for the first communication path fails to satisfy a preset first reference transmission quality and a second transmission quality estimated for the second communication path fails to satisfy a preset second reference transmission quality, and
in case that the first transmission quality satisfies the preset first reference transmission quality, determine the main/backup transmission mode, which uses the first communication path as the main communication path and the second communication path as the backup communication path, as the communication mode for supporting the video streaming service.

### Claim 9 (depends on 6)

The electronic device of claim 6, wherein the processor is further configured to change the communication mode from the merged transmission mode or the main/backup transmission mode to the single transmission mode using the first communication path, in case that connection to the second communication path is blocked while serving video streaming in the merged transmission mode or the main/backup transmission mode.

### Claim 10 (depends on 6)

The electronic device of claim 6, wherein the processor is further configured to send a request message to the server through each of the first communication path and the second communication path and receive a video segment from the server through each of the first communication path and the second communication path in response to the request message, in case that connection to the second communication path is possible while serving video streaming in the single transmission mode using the first communication path, or connection to the first communication path is possible while serving video streaming in the single transmission mode using the second communication path.

### Claim 11

A non-transitory computer-readable recording medium having recorded therein a program for executing operations of:
sending a request message to a server through each of multiple communication paths at least based on a multi-radio access technology and receiving a video segment from the server through each of the multiple communication paths in response to the request message;
estimating a transmission quality in each of the multiple communication paths based on the received video segment received through each of the multiple communication paths; and
determining one communication mode designating at least one communication path for supporting video streaming from among multiple communication modes, based on the transmission quality, estimated for each of the multiple communication paths, and a preset reference transmission quality, wherein the multiple communication modes comprise a single transmission mode for supporting video streaming through one of the multiple communication paths, a main/backup transmission mode for supporting video streaming by using a first communication path as a main communication path and a second communication path as a backup communication path, and a merged transmission mode for supporting video streaming through two or more communication paths among the multiple communication paths; and
performing prefetching with respect to the video segment by using the backup communication path in case of serving video streaming by using the main communication path in the main/backup transmission mode.

### Claim 12 (depends on 11)

The non-transitory computer-readable recording medium of claim 11, wherein executing operations further comprises:
changing a current communication mode into the determined communication mode in case that the current communication mode is different from the determined communication mode.

### Claim 13 (depends on 11)

The non-transitory computer-readable recording medium of claim 11, wherein determining the one communication mode comprises:
determining the merged transmission mode as a communication mode for supporting a video streaming service, in case that a first transmission quality estimated for the first communication path fails to satisfy a preset first reference transmission quality and a second transmission quality estimated for the second communication path fails to satisfy a preset second reference transmission quality; and
in case that the first transmission quality satisfies the preset first reference transmission quality, determining the main/backup transmission mode, which uses the first communication path as the main communication path and the second communication path as the backup communication path, as the communication mode for supporting the video streaming service.

### Claim 14 (depends on 11)

The non-transitory computer-readable recording medium of claim 11, wherein the executing operations further comprises:
changing the communication mode from the merged transmission mode or the main/backup transmission mode to the single transmission mode using the first communication path, in case that a connection to the second communication path is blocked while serving video streaming in the merged transmission mode or the main/backup transmission mode.

### Claim 15 (depends on 11)

The non-transitory computer-readable recording medium of claim 11, wherein receiving the video segment comprises:
sending a request message to the server through each of the first communication path and the second communication path and receiving a video segment from the server through each of the first communication path and the second communication path in response to the request message, in case that connection to the second communication path is possible while serving video streaming in the single transmission mode using the first communication path, or connection to the first communication path is possible while serving video streaming in the single transmission mode using the second communication path.