# US 10,484,148 B2 · Method and device for transmitting and receiving multimedia data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,484,148 B2
- Document ID: US10484148B2
- Status: Granted
- Kind: B2
- Application number: 15/319,231
- Filed: 2015-07-06
- Published: 2017-06-01
- Granted: 2019-11-19
- Earliest claimed: 2014-07-04
- Assignees: Samsung Electronics Co., Ltd.; University-Industry Cooperation Group of Kyung Hee University
- Applicants: Samsung Electronics Co., Ltd.; University-Industry Cooperation Group of Kyung Hee University
- Inventors: Young-Wan So; Kyung-Mo Park; Doug-Young Suh; Yong-Woo Cho
- Web page: https://patentgrep.com/patent/US10484148B2

## CPC

- H04H 60/11: Arrangements for counter-measures when a portion of broadcast information is unavailable
- H04L 1/0045: {Arrangements at the receiver end}
- H04L 1/1812: Hybrid protocols; Hybrid automatic repeat request [HARQ]
- H04L 1/1864: {ARQ related signaling (H04L1/1607 takes precedence)}
- H04N 21/236: Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream {(multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00)}
- H04N 21/2404: {Monitoring of server processing errors or hardware failure (error or fault detection G06F11/07; monitoring in general G06F11/30)}
- H04N 21/4425: Monitoring of client processing errors or hardware failure
- H04N 21/6473: {Monitoring network processes errors (for recovering from a failure of a protocol instance or entity H04L69/40)}
- H04H 2201/37: via a different channel
- H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Provided are a method and a device for transmitting and receiving multimedia data. The present invention comprises: receiving of multimedia data and confirming of loss data; determining, with respect to the degree of the loss of the received data, of whether or not the lost data can be recovered by means of application layer forward error correction (AL-FEC); if data recovery by means of the AL-FEC is not possible, making of an automatic retransmission request (ARQ) with respect to the lost data; and receiving of data retransmitted with respect to the ARQ and recovering of the lost data.

## Claims

### Claim 1

A method of receiving multimedia data in a hybrid network system, the method comprising:
receiving, by a transceiver, multimedia data from a broadcast server;
identifying lost data in the multimedia data;
determining, by at least one processor, whether reconstruction of the lost data is possible through an application layer forward error correction (AL-FEC) based on the lost data;
when the reconstruction of the multimedia data is not possible through the AL-FEC while receiving the multimedia data from the broadcast server, requesting, by the at least one processor to a broadband server, an automatic repeat request (ARQ) for a retransmission of the lost data in the multimedia data through an intermediate node of a network in the hybrid network system while receiving the multimedia data from the broadcast server;
receiving, by the transceiver from the broadband server, retransmitted data corresponding to the lost data that is retransmitted based on the ARQ; and
reconstructing the lost data based on the retransmitted data.

### Claim 2 (depends on 1)

The method as claimed in claim 1, wherein the determining of whether the reconstruction is possible comprises:
determining that the reconstruction is possible when a number of symbols belonging to one group of received packets is less than a predetermined number, and
determining that the reconstruction is impossible when the number of symbols belonging to the one group of the received packets is larger than or equal to the predetermined number.

### Claim 3 (depends on 1)

The method as claimed in claim 1, wherein the requesting of the ARQ comprises, when a multimedia service corresponds to a real-time service, requiring the ARQ, receiving the retransmitted data in a predetermined time on a basis of time required until receiving the retransmitted data and a time required for decoding, and determining that the ARQ is requested when the reconstruction is possible.

### Claim 4 (depends on 1)

The method as claimed in claim 1, wherein the ARQ includes group information of the lost data and information on a number of repair symbols required to decode data included in the group information.

### Claim 5 (depends on 1)

The method as claimed in claim 1, further comprising:
receiving, by the transceiver from the broadcast server, an address of the broadband server which is to transmit the ARQ.

### Claim 6 (depends on 1)

The method as claimed in claim 1, wherein the retransmitted data includes a repair symbol.

### Claim 7

An apparatus for receiving multimedia data in a hybrid network system, the apparatus comprising:
a transceiver;
at least one processor; and
a memory communicatively coupled to the at least one processor and configured to store instructions thereon,
wherein the at least one processor, upon execution of the instructions, is configured to:
control the transceiver to receive multimedia data from a broadcast server,
identify lost data in the multimedia data,
determine whether reconstruction of the lost data is possible through an application layer forward error correction (AL-FEC) based on the lost data,
when the reconstruction of the multimedia data is not possible through the AL-FEC while receiving the multimedia data from the broadcast server, control the transceiver to request an automatic repeat request (ARQ) for a retransmission of the lost data in the multimedia data through an intermediate node of a network in the hybrid network system while receiving the multimedia data from the broadcast server,
control the transceiver to receive retransmitted data corresponding to the lost data based on the ARQ from a broadband server, and
reconstruct the lost data based on the retransmitted data.

### Claim 8 (depends on 7)

The apparatus as claimed in claim 7, wherein the at least one processor is further configured to:
determine that the reconstruction is possible when a number of symbols belonging to one group of received packets is less than a predetermined number, and
determine that the reconstruction is impossible when the number of symbols belonging to the one group of the received packets is larger than or equal to the predetermined number.

### Claim 9 (depends on 7)

The apparatus as claimed in claim 7, wherein, when a multimedia service corresponds to a real-time service, the at least one processor is further configured to require the ARQ, receive the retransmitted data in a predetermined time on a basis of time required until receiving the retransmitted data and a time required for decoding, and determine that the ARQ is requested when the reconstruction is possible.

### Claim 10 (depends on 7)

The apparatus as claimed in claim 7, wherein the ARQ includes group information of the lost data and information on a number of repair symbols required to decode data included in the group information.

### Claim 11 (depends on 7)

The apparatus as claimed in claim 7, wherein the transceiver is further configured to receive an address of the broadband server which is to transmit the ARQ from the broadcast server.

### Claim 12 (depends on 7)

The apparatus as claimed in claim 7, wherein the retransmitted data includes a repair symbol.

### Claim 13

A method of transmitting multimedia data by a broadband server in a hybrid network system, the method comprising:
receiving, by a transceiver, multimedia data from a broadcast server;
receiving, by the transceiver from a client device, an automatic repeat request (ARQ) for the multimedia data through an intermediate node of a network in the hybrid network system;
generating or selecting, by at least one processor, symbols for reconstruction of lost data in the multimedia data based on information included in the ARQ; and
while the client device receives the multimedia data from the broadcast server, transmitting the symbols together with an ARQ response to the client device.

### Claim 14 (depends on 13)

The method as claimed in claim 13, wherein the ARQ includes group information of the lost data and information on a number of repair symbols required to decode data included in the group information.

### Claim 15

An apparatus for transmitting multimedia data in a hybrid network system, the apparatus comprising:
a transceiver;
at least one processor; and
a memory communicatively coupled to the at least one processor and configured to store instructions thereon,
wherein the at least one processor, upon execution of the instructions, is configured to:
control the transceiver to receive multimedia data from a broadcast server,
control the transceiver to receive an automatic repeat request (ARQ) for the multimedia data from a client device through an intermediate node of a network in the hybrid network system,
generate or select symbols for reconstruction of lost data in the multimedia data based on information included in the ARQ, and
while the client device is receiving the multimedia data from the broadcast server, transmit the symbols together with an ARQ response to the client device.

### Claim 16 (depends on 15)

The apparatus as claimed in claim 15, wherein the ARQ includes group information of the lost data and information on a number of repair symbols required to decode data included in the group information.
