# US 2018/0027042 A1 · Method and system for video call using two-way communication of visual or auditory effect

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0027042 A1
- Document ID: US20180027042A1
- Status: Published application
- Kind: A1
- Application number: 15/722,304
- Filed: 2017-10-02
- Published: 2018-01-25
- Earliest claimed: 2015-12-15
- Assignees: LINE Corporation
- Applicants: LINE Corporation
- Inventors: Keum Ryong KIM
- Web page: https://patentgrep.com/patent/US20180027042A1

## CPC

- H04L 65/80: Responding to QoS
- G06F 16/70: of video data
- H04L 65/1083: In-session procedures
- H04L 65/4015: {where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference}
- H04L 65/765: {intermediate}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 7/15: Conference systems
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video call method and system may use a two-way transmission of a visual effect or an auditory effect. A server may manage and store content that includes visual information or auditory information as an effect to apply to a video call in association with an effect identifier. A server may receive, during the video call, an effect identifier and may transmit the visual information or audio information associated with the effect identifier to a reception-side electronic device together with a data packet for the video call.

## Claims

### Claim 1

A video call method implemented by a computer comprising:
managing contents including visual information or auditory information;
determining contents for applying to a video call among the managed contents; and
transmitting the determined contents or an identifier corresponding to the determined contents in association with a data packet for the video call.

### Claim 2 (depends on 1)

The method of claim 1, wherein the determining contents determines information about at least one of a gender and an emotional state by analyzing at least one of a voice formant, a voice pitch, and a voice intensity included in the data packet, and determines contents based on the determined information.

### Claim 3 (depends on 1)

The method of claim 1, wherein the determining contents determines contents by using user facial feature information acquired by analyzing a video included in the data packet.

### Claim 4 (depends on 1)

The method of claim 1, wherein the determining contents determines contents corresponding to a location and a time zone where the contents are to be determined from accumulated information about a location and a time zone in which the managed contents are selected by users of a voice call.

### Claim 5 (depends on 1)

The method of claim 1, wherein the determining contents determines contents by using user body information measured at and transmitted from a sensor.

### Claim 6 (depends on 1)

The method of claim 1, wherein the determining contents determines contents by using at least one of state information set to a conversation application and a conversation log stored in the conversation application.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
changing at least one parameter of a transmission type of visual information included in the determined contents and a data transmission rate of auditory information included in the determined contents based on network traffic related to transmission of data packet for the video call,
wherein the transmitting in association with the data packet for the video call transmits the determined contents in accordance with the data packet for the video call according to the changed parameter.

### Claim 8 (depends on 7)

The method of claim 7, wherein
the transmission type comprises a first transmission type for synthesizing the visual information with the video included in the data packet and a second transmission type for transmitting the visual information separate from the video included the data packet to be overlaid on the video included the data packet, and
the changing at least one parameter changes the transmission type in accordance with the network traffic to one of the first transmission type and the second transmission type.

### Claim 9 (depends on 7)

The method of claim 7, wherein the transmitting in association with the data packet transmits the determined contents at the determined data transmission rate in order to synchronize an application time of the auditory information with respect to a voice signal included in the data packet.

### Claim 10

A non-transitory computer-readable recording medium storing computer readable instructions that, when executed by at least one processor in a computer, causes the at least one processor to perform a video call method, the call method comprising:
managing contents including visual information or auditory information;
determining contents for applying to a video call among the managed contents; and
transmitting the determined contents or an identifier corresponding to the determined contents in association with a data packet for the video call.

### Claim 11 (depends on 10)

The non-transitory computer-readable recording medium of claim 10, wherein the determining contents determines information about at least one of a gender and an emotional state by analyzing at least one of a voice format, a voice pitch, and a voice intensity included in the data packet, and determines contents based on the determined information.

### Claim 12 (depends on 10)

The non-transitory computer-readable recording medium of claim 10, wherein the determining contents determines contents by using user facial feature information acquired by analyzing a video included in the data packet.

### Claim 13 (depends on 10)

The non-transitory computer-readable recording medium of claim 10, wherein the determining contents determines contents corresponding to a location and a time zone where the contents are to be determined from accumulated information about a location and a time zone in which the managed contents are selected by users of a voice call.

### Claim 14 (depends on 10)

The non-transitory computer-readable recording medium of claim 10, wherein the determining contents determines contents by using user body information measured at and transmitted from a sensor.

### Claim 15 (depends on 10)

The non-transitory computer-readable recording medium of claim 10, the determining contents determines contents by using at least one of state information set to a conversation application and a conversation log stored in the conversation application.

### Claim 16 (depends on 10)

The non-transitory computer-readable recording medium of claim 10, wherein
the video call method further comprises changing at least one parameter of a transmission type of visual information included in the determined contents and a data transmission rate of auditory information included in the determined contents based on network traffic related to transmission of data packet for the video call,
the transmitting in association with the data packet for the video call transmits the determined contents in accordance with the data packet for the video call and the changed parameter.

### Claim 17

A video call system implemented by a computer comprises:
at least one processor configured to execute computer-readable instructions on the computer,
wherein the at least one processor manages contents including visual information or auditory information,
determines contents for applying to a video call among the managed contents, and
transmits the determined contents or an identifier corresponding to the determined contents in association with a data packet for the video call.

### Claim 18 (depends on 17)

The system of claim 17, wherein the at least one processor, for determining the contents, determines information about at least one of a gender and an emotional state by analyzing at least one of a voice formant, a voice pitch, and a voice intensity included in the date packet, and determines contents based on the determined information.

### Claim 19 (depends on 17)

The system of claim 17, wherein the at least one processor, for determining the contents, determines contents corresponding to a location and a time zone where the contents are to be determined from accumulated information about a location and a time zone in which the managed contents are selected by users of a voice call.

### Claim 20 (depends on 17)

The system of claim 17, wherein the at least one processor, for determining the contents, determines contents by using at least one of user body information measured at and transmitted from a sensor, facial feature information acquired by analyzing a video included in the data packet, state information set to a conversation application, and a conversation log stored in the conversation application.
