# US 2024/0007518 A1 · Electronic device for transmitting plurality of media streams, and method therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0007518 A1
- Document ID: US20240007518A1
- Status: Published application
- Kind: A1
- Application number: 18/467,119
- Filed: 2023-09-14
- Published: 2024-01-04
- Earliest claimed: 2021-03-18
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Hanmin BANG; Jeongsik IN; Hyoksung CHOI
- Web page: https://patentgrep.com/patent/US20240007518A1

## CPC

- H04L 65/70: Media network packetisation
- H04L 65/65: Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
- H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)}
- H04L 65/765: {intermediate}
- H04L 65/80: Responding to QoS
- H04N 21/2343: involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements {(video transcoding H04N19/40; media packet handling at the source H04L65/762)}
- H04N 21/236: Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream {(multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00)}
- H04N 21/2365: Multiplexing of several video streams
- H04N 21/24: Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests {(monitoring of server performance or load G06F11/34; arrangements for observation, testing or troubleshooting for broadcast or for distribution combined with broadcast H04H20/12)}
- H04N 21/262: Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists {(scheduling strategies for dispatcher in multiprogramming arrangements G06F9/4881; arrangements for scheduling broadcast services or broadcast-related services H04H60/06; flow control in packet networks H04L47/10; establishing a time schedule or organising the servicing of application requests H04L67/62)}
- H04N 21/63: Control signaling {related to video distribution} between client, server and network components; Network processes for video distribution between server and clients {or between remote clients}, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing (real-time session protocols H04L65/1101; distributed application using peer-to-peer [P2P] networks H04L67/104)
- H04N 21/6437: Real-time Transport Protocol [RTP]
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An electronic device may include: at least one encoder, a communication module and at least one processor operatively connected to the at least one encoder and the communication module, wherein the at least one processor may be configured to encode each media stream inputted from a plurality of media sources, so as to sequentially generate frames via at least the encoder, and form, into one integrated packet, frames designated on the basis of attributes of frames generated from different media sources of the plurality of media sources, so as to transmit the integrated packet to an external electronic device through the communication module.

## Claims

### Claim 1

An electronic device comprising:
at least one encoder;
a communication module comprising communication circuitry; and
at least one processor operatively connected to the at least one encoder and the communication module,
wherein the at least one processor is configured to:
sequentially produce frames at least by encoding respective media streams from a plurality of media sources by the encoder;
configure frames of different media sources specified based on attributes of frames produced from different media sources of the plurality of media sources into a unified packet; and
transmit the unified packet to an external electronic device via at least the communication module.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the processor is configured to adjust and schedule the attributes of the frames sequentially produced by the encoder.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the processor is configured to synchronize production times of frames produced from at least two different media sources of the plurality of media sources.

### Claim 4 (depends on 2)

The electronic device of claim 2, wherein at least one of sizes and types of the frames produced from at least two different video sources of the plurality of media sources is produced differently at an identical time point.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein the processor is configured to:
configure waiting time windows, based on production conditions of the frames produced from different media sources of the plurality of media sources;
configure frames having a size less than a threshold value, based on the configured waiting time windows, into the unified packet which is one unified packet; and
transmit the unified packet to the external electronic device via at least the communication module.

### Claim 6 (depends on 5)

The electronic device of claim 5, wherein the processor is configured to:
configure frames having a size equal to or greater than a threshold value, among the frames produced from different media sources of the plurality of media sources, into independent packets, based on the waiting time windows; and
transmit the packets to an external electronic device via at least the communication module.

### Claim 7 (depends on 5)

The electronic device of claim 5, wherein the processor is configured to identify a transmission channel state and determine at least one of: a value of the waiting time window for configuring the unified packet, the number of times the unified packet is produced, or the number of different media sources.

### Claim 8 (depends on 7)

The electronic device of claim 7, wherein the processor is configured to identify the transmission channel state, based on at least one of: a packet loss rate, an accumulated packet loss rate, a bandwidth, the number of packets to be transmitted, or a packet production time.

### Claim 9 (depends on 1)

The electronic device of claim 1, wherein the processor is configured to control to transmit the unified packet, based on a real-time transport protocol (RTP).

### Claim 10 (depends on 1)

The electronic device of claim 1, wherein the unified packet is configured to include a field designating a payload size of each of the specified frames in a header.

### Claim 11

A method of an electronic device, the method comprising:
sequentially producing frames at least by encoding respective media streams from a plurality of media sources;
configuring frames of different media sources based on attributes of frames produced from different media sources of the plurality of media sources into one unified packet; and
transmitting the one unified packet to an external electronic device.

### Claim 12 (depends on 11)

The method of claim 11, further comprising adjusting and scheduling the attributes of the frames sequentially produced such that production times of frames produced from at least two different media sources of the plurality of media sources are synchronized and at least one of sizes and types of the frames produced from at least two different video sources of the plurality of media sources is produced differently at an identical time point.

### Claim 13 (depends on 11)

The method of claim 11, further comprising configuring waiting time windows, based on production conditions of the frames produced from different media sources of the plurality of media sources,
configuring frames having a size less than a threshold value, based on the configured waiting time windows, into the one unified packet, configuring frames having a size equal to or greater than a threshold value, among the frames produced from different media sources of the plurality of media sources, into independent packets, based on the waiting time windows, and transmitting the packets to the external electronic device.

### Claim 14 (depends on 13)

The method of claim 13, further comprising identifying a transmission channel state to determine at least one of a value of the waiting time window for configuring the unified packet, the number of times the unified packet is produced, or the number of different media sources, and identifying the transmission channel state, based on at least one of a packet loss rate, an accumulated packet loss rate, a bandwidth, the number of packets to be transmitted, or a packet production time.

### Claim 15 (depends on 11)

The method of claim 11, wherein the one unified packet is configured to include a field designating a payload size of each of the specified frames in a header.
