# US 2021/0243407 A1 · Terminal and operating method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243407 A1
- Document ID: US20210243407A1
- Status: Published application
- Kind: A1
- Application number: 17/161,787
- Filed: 2021-01-29
- Published: 2021-08-05
- Earliest claimed: 2020-01-31
- Assignees: Hyperconnect Inc.
- Applicants: Hyperconnect, Inc.
- Inventors: Sang Il AHN; Kang San LEE
- Web page: https://patentgrep.com/patent/US20210243407A1

## CPC

- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- H04M 1/253: Telephone sets using digital voice transmission
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N 21/42202: {environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes}
- H04N 21/42203: {sound input device, e.g. microphone}
- H04N 21/4318: {by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/454: Content {or additional data} filtering, e.g. blocking advertisements
- H04N 21/4542: {Blocking scenes or portions of the received content, e.g. censoring scenes}
- G06N 20/00: Machine learning
- H04M 2201/50: Telephonic communication in combination with video communication
- H04N 2007/145: {Handheld terminals}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

Provided is a terminal. The terminal may include an input and output interface configured to receive a first video capturing a first user, a communication interface configured to transmit the first video or a first sound of the first user to a terminal of a counterpart and receive a second video or second sound, which is obtained by the terminal of the counterpart, through a video call session, a display configured to display the first video and the second video, and a processor configured to detect a specific event during the video call session, determine whether an inappropriate element is included in the first video or the first sound when the specific event is detected, and stop transmitting the first video or the first sound according to a result of the determination.

## Claims

### Claim 1

An application stored in a computer-readable storage medium for performing a method of providing a video call service, the application comprising:
establishing a video call session between a first terminal and a second terminal;
transmitting at least one of a first video and a first sound obtained from the first terminal corresponding to a first user to the second terminal;
receiving, by the first terminal, at least one of a second video and a second sound obtained from the second terminal corresponding to a second user;
detecting, by the first terminal, a specific event during the video call session;
determining, by the first terminal, whether an inappropriate element is included in the first video or the first sound in response to the detecting of the specific event; and
stopping, by the first terminal, the transmitting of the first video or the first sound of the first user according to a result of the determining.

### Claim 2 (depends on 1)

The application of claim 1, wherein the specific event comprises an event in which the first terminal is inclined in an arbitrary direction at an angular velocity exceeding a threshold angular velocity.

### Claim 3 (depends on 1)

The application of claim 1, wherein the determining of whether the inappropriate element is included in the first video or the first sound comprises:
determining whether the inappropriate element is included in the first video or the first sound, which is obtained after the specific event is detected, using a classification model trained with a correlation between the video or sound and the inappropriate element.

### Claim 4 (depends on 1)

The application of claim 1, wherein the specific event comprises an event in which a face of the first user disappears at a velocity exceeding a threshold velocity from the first video obtained by the first terminal.

### Claim 5 (depends on 1)

The application of claim 1, further comprising, when the first terminal stops the transmitting of the first video or the first sound, displaying an alternative video instead of the first video in the second terminal.

### Claim 6 (depends on 1)

The application of claim 1, further comprising:
monitoring, by the first terminal, whether an inappropriate element is included in a video or sound, which is obtained by the first terminal after the transmitting of the first video or the first sound stops, at a predetermined time interval; and
when the inappropriate element is not included in the video or sound as a result of the monitoring, resuming the transmitting of the video or sound obtained by the first terminal.

### Claim 7 (depends on 1)

The application of claim 1, wherein the specific event is a first specific event, and
the application further comprises:
detecting, by the first terminal, a second specific event after the first terminal stops the transmitting of the first video or the first sound;
when the second specific event is detected, determining whether an inappropriate element is included in a video or sound, which is obtained by the first terminal in response to the detecting of the second specific event; and
when the inappropriate element is not included in the video or sound, which is obtained by the first terminal after the second specific event is detected, resuming, by the first terminal, the transmitting of the video or sound, which is generated by the first terminal.

### Claim 8 (depends on 1)

The application of claim 1, wherein the specific event comprises an event in which the first terminal is inclined in an arbitrary direction at an angle exceeding a threshold angle.

### Claim 9 (depends on 1)

A computer-readable recording medium on which a program for the application according to claim 1 is recorded.

### Claim 10

A terminal comprising:
an input and output interface configured to receive at least one of a first video and a first sound which are related to a first user;
a communication interface configured to transmit the at least one of the first video and the first sound to a terminal of a counterpart and receive a second video or second sound, which is obtained by the terminal of the counterpart, through a video call session;
a display configured to display the first video and the second video; and
a processor configured to detect a specific event during the video call session, determine whether an inappropriate element is included in the first video or the first sound in response to the specific event, and stop transmitting the first video or the first sound according to a result of the determination.

### Claim 11 (depends on 10)

The terminal of claim 10, wherein the processor detects the specific event in at least one of a case in which the terminal is inclined in an arbitrary direction at an angular velocity exceeding a threshold angular velocity and a case in which the terminal is inclined in an arbitrary direction at an angle exceeding a threshold angle.

### Claim 12 (depends on 11)

The terminal of claim 11, wherein the processor determines whether the inappropriate element is included in the first video or the first sound, which is received after the specific event is detected, using a classification model trained using a correlation between the video or sound and the inappropriate element.

### Claim 13 (depends on 10)

The terminal of claim 10, wherein the processor monitors whether the inappropriate element is included in the first video or sound, which is received after the transmitting of the first voice or the first sound stops, at a predetermined time interval, and
resumes the transmitting of the video or sound when the inappropriate element is not found as a result of the monitoring.

### Claim 14 (depends on 10)

The terminal of claim 10, wherein the specific event is a first specific event, and the processor detects a second specific event after the transmitting of the first video or the first sound stops,
when the second specific event is detected, determines whether the inappropriate element is included in the video and sound which is received after the second specific event is detected, and
when the inappropriate element is not included, resumes the transmitting of the video or sound.

### Claim 15 (depends on 10)

The terminal of claim 10, wherein, before the specific event is detected, the processor determines whether the inappropriate element is included in the first video or the first sound every first period, and
when the specific event is detected, the processor determines whether the inappropriate element is included in the first video or the first sound in response to the detection of the specific event.

### Claim 16 (depends on 15)

The terminal of claim 15, wherein, when the specific event is detected, the processor determines whether the inappropriate element is included in the first video or the first sound every second period for a specific period of time.

### Claim 17 (depends on 1)

The application of claim 1, wherein the determining of whether the inappropriate element is included includes, before the event is detected, determining whether the inappropriate element is included in the first video or the first sound every first period, and
when the specific event is detected, determining whether the inappropriate element is included in the first video or the first sound every second period.
