# US 12,192,573 B1 · Apparatus for converting and transmitting horizontal and vertical videos based on machine learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,192,573 B1
- Document ID: US12192573B1
- Status: Granted
- Kind: B1
- Application number: 18/739,932
- Filed: 2024-06-11
- Granted: 2025-01-07
- Earliest claimed: 2023-08-29
- Assignees: Megalive, Inc.
- Applicants: MegaLive, Inc.
- Inventors: Seeyoung Lee; Kyung Doc Yoo; Dae Hyun Kim; Jang-Ryeol Seong; Kyounghoon Han
- Web page: https://patentgrep.com/patent/US12192573B1

## CPC

- H04N 21/440272: {for performing aspect ratio conversion}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Provided is an apparatus for converting and transmitting horizontal and vertical videos based on machine learning. The apparatus for converting and transmitting horizontal and vertical videos based on machine learning includes a receiver unit which receives a horizontal video taken by a camera from the camera; an object detection unit which detects objects in the received horizontal video by using an object recognition model learned by machine learning; a video segmentation unit which generates a plurality of segmentation videos by using the result detected from the object detection unit; a video synthesis unit which arranges the plurality of segmentation videos to fit the size of a screen of a vertical video and generates a vertical video, wherein the segmentation videos may be videos segmented from the horizontal video including at least one object detected from the object detection unit, videos in which the additional videos are synthesized to videos segmented from the horizontal video to comprise at least one object detected from the object detection unit, or the additional videos.

## Claims

### Claim 1

An apparatus for converting and transmitting horizontal and vertical videos based on machine learning comprising:
a receiver unit which receives a horizontal video taken by a camera from the camera;
an object detection unit which detects objects in the received horizontal video by using an object recognition model learned by machine learning;
a video segmentation unit which generates a plurality of segmentation videos by using the result detected from the object detection unit;
a video synthesis unit which arranges the plurality of segmentation videos to fit the size of a screen of a vertical video and generates a vertical video,
wherein the segmentation videos are videos segmented from the horizontal video including at least one object detected from the object detection unit, videos in which the additional videos are synthesized to videos segmented from the horizontal video to comprise at least one object detected from the object detection unit, or the additional videos,
wherein the object detection unit calculates the importance of the object detected by using the object recognition model in consideration of the position or the size of the object arranged in the horizontal video and the video segmentation unit generates a segmentation position of the horizontal video according to the importance of objects calculated in the object detection unit and generates the segmentation videos.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the video segmentation unit segments a first segmentation video comprising a part of the plurality of objects in the horizontal video or the additional video and a second segmentation video comprising remaining objects in the horizontal video or the additional video and the video synthesis unit generates the vertical video by arranging the first segmentation video and the second segmentation video at the top and the bottom.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the additional videos comprise subtitles or chat windows inserted into the horizontal video, a Picture In Picture (PIP) videos displayed along with the horizontal video, videos taken by a camera other than the camera that transmits the horizontal video, or videos previously stored in a storage space.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the object recognition model is a model learned through machine learning to recognize people or things in the horizontal video as objects and to distinguish and recognize backgrounds and the objects.

### Claim 5 (depends on 1)

The apparatus of claim 1, further comprising a transmission unit which simultaneously transmits the horizontal video and the vertical video to a viewer's terminal so as to display one of the horizontal video and the vertical video on a screen of the viewer's terminal or transmits the horizontal video or the vertical video to a viewer's terminal in response to a selection signal received from the viewer's terminal.