# US 2019/0320140 A1 · Electronic apparatus and method for controlling thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0320140 A1
- Document ID: US20190320140A1
- Status: Published application
- Kind: A1
- Application number: 16/386,921
- Filed: 2019-04-17
- Published: 2019-10-17
- Earliest claimed: 2018-04-17
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Dugin LYU
- Web page: https://patentgrep.com/patent/US20190320140A1

## CPC

- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 7/15: Conference systems
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- H04N 7/141: {between two video terminals, e.g. videophone (telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085)}
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Disclosed is an electronic apparatus for providing a video conference, and a method of controlling the same. The electronic apparatus includes a plurality of cameras, and a processor configured to execute instructions to: control to obtain, through a first camera from among the plurality of cameras, first video of a plurality of users who perform the video conference, determine a first user who is currently speaking among the plurality of users on a basis of the first video that is obtained through the first camera, control to obtain, through a second camera from among the plurality of cameras, second video of the determined first user, determine a second user who is expected to speak after the first user on a basis of the first video that is obtained through the first camera, control to obtain, through a third camera from among the plurality of cameras, third video of the determined second user, and control to output a screen in which the second video is simultaneously displayed with the third video.

## Claims

### Claim 1

An electronic apparatus for providing a video conference, the electronic apparatus comprising:
a plurality of cameras; and
a processor configured to execute instructions to:
control to obtain, through a first camera from among the plurality of cameras, first video of a plurality of users who perform the video conference,
determine a first user who is currently speaking among the plurality of users on a basis of the first video that is obtained through the first camera,
control to obtain, through a second camera from among the plurality of cameras, second video of the determined first user,
determine a second user who is expected to speak after the first user on a basis of the first video that is obtained through the first camera,
control to obtain, through a third camera from among the plurality of cameras, third video of the determined second user, and
control to output a screen in which the second video is simultaneously displayed with the third video.

### Claim 2 (depends on 1)

The electronic apparatus of claim 1, wherein the processor is configured to execute the instructions further to:
on a basis of the first video, determine, as the first user, a user of which a mouth shape change or a gesture change is determined to be greater than or equal to a preset threshold; or
on a basis of the first video, determine, as the first user, a user who is present in a determined direction of a gaze of at least one of the plurality of users.

### Claim 3 (depends on 1)

The electronic apparatus of claim 1, wherein the processor is configured to execute the instructions further to:
on a basis of the first video, determine a direction of a gaze of the first user, and determine, as the second user, a user who is present in the determined direction of the gaze.

### Claim 4 (depends on 1)

The electronic apparatus of claim 1, wherein the processor is configured to execute the instructions further to:
on a basis of the first video, identify one or more gestures among the plurality of users; and
based on determining that the first user performs a gesture in a specific direction, determine, as the second user, a user who is present in the specific direction.

### Claim 5 (depends on 1)

The electronic apparatus of claim 1, wherein the processor is configured to execute the instructions further to:
identify one or more gestures among the plurality of users on a basis of the first video; and
based on determining that a user among the plurality of users performs a gesture to raise a hand, determine, as the second user, the user who performs the gesture to raise the hand.

### Claim 6 (depends on 1)

The electronic apparatus of claim 1, wherein the processor is configured to execute the instructions further to:
based on determining a name being called by the first user, determine information on a face corresponding to the called name, among pre-stored information on faces of the plurality of users, and determine, as the second user, a user corresponding to the determined information on the face.

### Claim 7 (depends on 1)

The electronic apparatus of claim 1, wherein the processor is configured to execute the instructions further to:
identify a user who is expected to speak after the first user, on a basis of a pre-stored speaking order list;
determine, from among pre-stored information on faces of the plurality of users, information on a face corresponding to the identified user; and
determine, as the second user, a user corresponding to the identified information on the face.

### Claim 8 (depends on 1)

The electronic apparatus of claim 1, wherein the processor is configured to execute the instructions further to:
based on determining, on a basis of the first video that is obtained through the first camera, that the second user starts speaking, control to output the third video that is obtained through the third camera on a full screen.

### Claim 9 (depends on 1)

The electronic apparatus of claim 1, wherein the processor is configured to execute the instructions further to:
on a basis of pre-stored video conference history information, determine a location where initial speaking is performed at a place where the video conference is held, and control the second camera to obtain the second video of the identified location.

### Claim 10

A method for controlling an electronic apparatus, the method comprising:
obtaining, through a first camera from among a plurality of cameras, a plurality of users who perform the video conference;
determining a first user who is currently speaking among the plurality of users on a basis of the first video that is captured through the first camera;
obtaining, through a second camera from among the plurality of cameras, second video of the determined first user;
determining a second user who is expected to speak after the first user on a basis of the first video that is obtained through the first camera;
obtaining, through a third camera from among the plurality of cameras, third video of the determined second user; and
outputting a screen in which the second video is simultaneously displayed with the third video.

### Claim 11 (depends on 10)

The method for controlling of claim 10, wherein the determining the first user comprises:
on a basis of the first video, determining, as the first user, a user of which a mouth shape change or a gesture change is determined to be greater than or equal to a preset threshold; or
on a basis of the first video, determining, as the first user, a user who is present in a determined direction of a gaze of at least one of the plurality of users.

### Claim 12 (depends on 10)

The method for controlling of claim 10, wherein the determining the second user comprises, on a basis of the first video, determining a direction of a gaze of the first user, and determining, as the second user, a user who is present in the determined direction of the gaze.

### Claim 13 (depends on 10)

The method for controlling of claim 10, wherein the determining the second user comprises:
on a basis of the first video, identifying one or more gestures among the plurality of users; and
based on determining that the first user performs a gesture in a specific direction, determining, as the second user, a user who is present in the specific direction.

### Claim 14 (depends on 10)

The method for controlling of claim 10, wherein the determining the second user comprises:
identifying one or more gestures among the plurality of users on a basis of the first video; and
based on determining that a user among the plurality of users performs a gesture to raise a hand, determining, as the second user, the user who performs the gesture to raise the hand.

### Claim 15 (depends on 10)

The method for controlling of claim 10, wherein the determining the second user comprises:
based on determining a name being called by the first user, determining information on a face corresponding to the called name, among pre-stored information on faces of the plurality of users, and determining, as the second user, a user corresponding to the determined information on the face.

### Claim 16 (depends on 10)

The method for controlling of claim 10, wherein the determining the second user comprises:
identifying a user who is expected to speak after the first user, on a basis of a pre-stored speaking order list;
determining, from among pre-stored information on faces of the plurality of users, information on a face corresponding to the identified user; and
determining, as the second user, a user corresponding to the identified information on the face.

### Claim 17 (depends on 10)

The method for controlling of claim 10, further comprising:
based on determining, on a basis of the first video that is obtained through the first camera, that the second user starts speaking, outputting the third video that is obtained through the third camera on a full screen.

### Claim 18 (depends on 10)

The method for controlling of claim 10, further comprising:
on a basis of pre-stored video conference history information, determining a location where initial speaking is performed at a place where the video conference is held, and controlling the second camera to obtain the second video of the identified location.

### Claim 19 (depends on 10)

A non-transitory computer-readable recording medium having recorded thereon a program executable by a computer for performing the method of claim 10.
