# US 2023/0274101 A1 · User terminal, broadcasting apparatus, broadcasting system comprising same, and control method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274101 A1
- Document ID: US20230274101A1
- Status: Published application
- Kind: A1
- Application number: 17/784,022
- Filed: 2020-12-07
- Published: 2023-08-31
- Earliest claimed: 2019-12-09
- Inventors: Kyung Cheol KIM
- Web page: https://patentgrep.com/patent/US20230274101A1

## CPC

- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G10L 15/005: {Language recognition}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- H04L 12/1827: {Network arrangements for conference optimisation or adaptation}
- H04L 12/1831: {Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status}
- H04L 51/046: Interoperability with other network applications or services
- H04L 51/10: Multimedia information
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Disclosed are a broadcasting apparatus, a user terminal, a broadcasting system comprising same, and a control method thereof. The broadcasting apparatus, according to one aspect, may comprise: a communication unit that supports a video call between user terminals connected to a chat room through a communication network; an extraction unit that generates a video file and an audio file by using a video call-related video file received through the communication unit, and extracts original language information for each caller by using at least one of the video file and the audio file; a translation unit that generates translation information obtained by translating the original language information according to the language of a selected country; and a control unit that controls an interpretation/translation video, in which at least one of the original language information and the translation information is mapped to the video call-related video file, to be transmitted to viewer terminals and the user terminals connected to the chat room.

## Claims

### Claim 1

A broadcasting apparatus comprising:
a communication unit for supporting a video call between user terminals connected to a chat room through a communication network;
an extraction unit for generating an image file and an audio file using a video call-related video file received through the communication unit, and extracting original language information for each caller using at least one among the image file and the audio file;
a translation unit for generating translation information of the original language information translated according to a language of a selected country; and
a control unit for controlling to transmit an interpreted/translated video, in which at least one among the original language information and the translation information is mapped to the video call-related video file, to viewer terminals and the user terminals connected to the chat room.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein the original language information includes at least one among voice original language information and text original language information, and the translation information includes at least one among voice translation information and text translation information.

### Claim 3 (depends on 1)

The apparatus according to claim 1, wherein the extraction unit extracts voice original language information for each caller by applying a frequency band analysis process to the audio file, and generates text original language information by applying a voice recognition process to the extracted voice original language information.

### Claim 4 (depends on 1)

The apparatus according to claim 1, wherein the extraction unit detects a sign language pattern by applying an image processing process to the image file, and generates text original language information based on the detected sign language pattern.

### Claim 5

A user terminal comprising:
a terminal communication unit for supporting a video call service through a communication network; and
a terminal control unit for controlling to display, on a display, a user interface configured to provide an interpreted/translated video, in which at least one among original language information and translation information is mapped to a video call-related video file, and provide an icon for receiving at least one or more video call-related setting commands and at least one or more translation-related setting commands.

### Claim 6 (depends on 5)

The apparatus according to claim 5, wherein the at least one or more video call-related setting commands include at least one among a speaking right setting command capable of setting a right to speak of a video caller, a command for setting the number of video callers, a command for setting the number of viewers, and a text transmission command.

### Claim 7 (depends on 6)

The apparatus according to claim 6, wherein the terminal control unit controls to display, on the display, a user interface configured to be able to change a method of providing the interpreted/translated video according to whether or not the speaking right setting command is input, or to provide a pop-up message including information on a caller having a right to speak.

### Claim 8

A control method of a broadcasting apparatus, the method comprising the steps of:
receiving a video call-related video file;
extracting original language information for each caller using at least one among an image file and an audio file generated from the video call-related video file;
generating translation information of the original language information translated according to a language of a selected country; and
controlling to transmit an interpreted/translated video, in which at least one among the original language information and the translation information is mapped to the video call-related video file, to terminals connected to a chat room.

### Claim 9 (depends on 8)

The method according to claim 8, wherein the extracting step includes the steps of:
extracting voice original language information for each caller by applying a frequency band analysis process to the audio file; and
generating text original language information by applying a voice recognition process to the extracted voice original language information.

### Claim 10 (depends on 8)

The method according to claim 8, wherein the extracting step includes the step of detecting a sign language pattern by applying an image processing process to the image file, and generating text original language information based on the detected sign language pattern.
