# US 2024/0179390 A1 · Participant Video Communication Devices as Host and Attendee, and Video Conferencing System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0179390 A1
- Document ID: US20240179390A1
- Status: Published application
- Kind: A1
- Application number: 18/241,894
- Filed: 2023-09-03
- Published: 2024-05-30
- Earliest claimed: 2022-11-29
- Assignees: AmTRAN Technology Co., Ltd.
- Applicants: AmTRAN TECHNOLOGY CO., LTD
- Inventors: Kuo-Chih Lo
- Web page: https://patentgrep.com/patent/US20240179390A1

## CPC

- H04N 23/58: Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 7/13: Edge detection
- G06T 7/73: using feature-based methods
- G06V 40/161: {Detection; Localisation; Normalisation}
- H04N 5/268: Signal distribution or switching
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30201: Face
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A network video communication device includes a transmission circuit; a display; an image capture circuit, for capturing a first real-time image; and a processing circuit; wherein the network video communication device performs connecting a server and joining an online video conference; capturing the first real-time image of a first user; receiving a second video signal comprising a second real-time image captured by a second video communication device; displaying a video conference screen comprising the second real-time image; determining an identity or a status of the first user; processing the first real-time image of the first user to generate a first user information; transmitting the first user information to the second video communication device; receiving the second video signal comprising the adjusted real-time image with an adjusted field of view; displaying the second real-time image with the adjusted field of view in the video conference screen.

## Claims

### Claim 1

A network video communication device, comprising:
a transmission circuit;
a display;
an image capture circuit, for capturing a first real-time image; and
a processing circuit, coupled to the transmission circuit, the image capture circuit and the display; wherein the network video communication device performs following steps:
controlling, by the processing circuit, the transmission circuit to connect a server and join an online video conference as one of a plurality of participants of the online video conference;
controlling, by the processing circuit, the image capture circuit to capture the first real-time image of a first user local to the network video communication device;
receiving, by the transmission circuit, a second video signal, wherein the second video signal comprise a second real-time image captured by a second video communication device which is another one of the participants of the online video conference;
controlling, by the processing circuit, the display to display a video conference screen, wherein the video conference screen comprises the second real-time image;
determining, by the processing circuit, an identity or a status of the first user corresponding to the online video conference;
processing, by the processing circuit, the first real-time image of the first user to generate a first user information, wherein the first user information comprises an eye gaze direction of the first user if the identity or the status of the first user meets a requirement;
controlling, by the processing circuit, the transmission circuit to transmit the first user information to the second video communication device;
receiving, by the transmission circuit, the second video signal comprising the adjusted real-time image with an adjusted field of view, wherein the adjusted field of view is directed to a focus area corresponding to the eye gaze direction of the first user;
controlling, by the processing circuit, the display to display the second real-time image with the adjusted field of view in the video conference screen;
wherein the second real-time image with the adjusted field of view is transmitted to the participants of the online video conference.

### Claim 2 (depends on 1)

The network video communication device of claim 1, wherein the image capture circuit comprises a plurality of photographic lenses for capturing a plurality of images, wherein the processing circuit selects at least one of the captured images to be processed and generates the first real-time image.

### Claim 3 (depends on 1)

The network video communication device of claim 1, wherein the image capture circuit comprises an upper photographic lens, a bottom photographic lens, a middle photographic lens, a left photographic lens and a right photographic lens, and the image capture circuit covers a field of view more than 130 degrees horizontally and 105 degrees vertically.

### Claim 4 (depends on 1)

The network video communication device of claim 1, wherein the step of processing, by the processing circuit, the first real-time image of the first user to generate the first user information comprises:
performing edge detection on the first real-time image for detecting a user face position;
detecting eye characteristics for determining a user eye position corresponding to the user face position on the first real-time image; and
determining the user gazing direction according to the user eye position.

### Claim 5 (depends on 4)

The network video communication device of claim 4, wherein the step of processing, by the processing circuit, the first real-time image of the first user to generate the first user information further comprises:
calculating a user distance based on user face size information corresponding to the user face position on the first real-time image and focal length information of the image capture circuit.

### Claim 6 (depends on 4)

The network video communication device of claim 4, wherein the step of determining the user gazing direction according to the user eye position comprises:
determining a horizontal face midline and a vertical face midline of a user face at the user face position; and
comparing the user's eye positions with the horizontal face midline and the vertical face midline of the user face.

### Claim 7 (depends on 1)

The network video communication device of claim 1, further comprising:
a microphone, wherein the microphone receives a first real-time audio local to the network video communication device, and the processing circuit processes the first real-time audio to determine a direction and the status of the first user.

### Claim 8 (depends on 1)

The network video communication device of claim 1, wherein the identity or the status of the first user meets the requirement when the identity of the first user is a host of the online video conference or the status of the first user is current speaker of the online video conference.

### Claim 9

A network video communication device, comprising:
a transmission circuit;
an image capture circuit, for capturing real-time images; and
a processing circuit, coupled to the transmission circuit and the image capture circuit;
wherein the network video communication device performs following steps:
controlling, by the processing circuit, the transmission circuit to connect a server and join an online video conference as one of a plurality of participants of the online video conference;
controlling, by the processing circuit, the image capture circuit to capture a first real-time image of a user local to the network video communication device;
transmitting, by the transmission circuit, the first real-time image to at least one of the other participants of the online video conference;
receiving, by the transmission circuit, a first user information from a remote network video communication device, wherein the first user information comprises an eye gaze direction of a remote user of the remote network video communication device, the remote user is recognized as having a first identity or in a first status corresponding to the online video conference, and the remote video communication device is the at least one of the other participants of the online video conference;
processing, by the processing circuit, the first user information and controlling the image capture circuit to capture a second real-time image, wherein the second real-time image is captured with a field of view adjusted corresponding to the eye gaze direction of the remote user; and
transmitting, by the transmission circuit, a video signal including the second real-time image with the adjusted field of view to the at least one of the other participants of the online video conference.

### Claim 10 (depends on 9)

The network video communication device of claim 9, wherein the image capture circuit comprises a plurality of photographic lenses for capturing a plurality of images, wherein the processing circuit selects at least one of the captured images according to the first user information to merge into the second real-time image.

### Claim 11 (depends on 9)

The network video communication device of claim 9, wherein the image capture circuit comprises an upper photographic lens, a bottom photographic lens, a middle photographic lens, a left photographic lens and a right photographic lens, and the image capture circuit covers a field of view more than 130 degrees horizontally and 105 degrees vertically.

### Claim 12 (depends on 9)

The network video communication device of claim 9, wherein the network video communication device further performs following step:
performing, by the processing circuit, edge detection on the second real-time image with the adjusted field of view and determining an object-of-interest in the second real-time image with the adjusted field of view; and
controlling, by the processing circuit, the image capture circuit to zoom-in and capture an enlarged image of the object-of-interest as the second real-time image with the adjusted field of view.

### Claim 13 (depends on 9)

The network video communication device of claim 9, wherein the first identity of the remote user is a host of the online video conference, and the first status of the remote user is current speaker in the online video conference.

### Claim 14 (depends on 9)

The network video communication device of claim 9, further comprising: a display,
wherein the transmission circuit receives a video signal including a remote real-time image and the processing circuit controls the display to display the remote real-time image in a video conference screen.

### Claim 15 (depends on 9)

The network video communication device of claim 9, wherein the network video communication device further performs the following steps:
controlling, by the processing circuit, the image capture circuit to capture the first real-time image with a previous field of view and the second real-time image with the adjusted field of view at the same time; and
transmitting, by the transmission circuit, the video signal including the first real-time with the previous field of view and the second real-time image with the adjusted field of view to the at least one of the other participants of the online video conference.

### Claim 16

A method of video conference image processing, for a network video communication device comprising a transmission circuit, a display, an image capture circuit, a microphone and a processing circuit, the method of video conference image processing comprising:
connecting a server and joining an online video conference as one of a plurality of participants of the online video conference, wherein the participants of the online video conference comprise at least the network video communication device and a second video communication device remote to the network video communication device;
capturing a first real-time image of a first user local to the network video communication device;
capturing a first real-time audio local to the network video communication device;
receiving a second video signal, wherein the second video signal comprise a second real-time image captured by the second video communication device;
displaying a video conference screen including the second real-time image;
determining an identity of the first user corresponding to the online video conference, or determining a status of the first user based on the first real-time image of the first user or the first real-time audio;
processing the first real-time image of the first user to generate a first user information if the identity or the status of the first user meets a requirement, wherein the first user information comprises an eye gaze direction of the first user;
transmitting the first user information to the second video communication device;
receiving the second video signal comprising the second real-time image with an adjusted field of view, wherein the adjusted field of view is directed to a focus area corresponding to the eye gaze direction of the first user; and
displaying the video conference screen including the second real-time image with the adjusted field of view.

### Claim 17 (depends on 16)

The method of video conference image processing of claim 16, wherein the step of processing the first real-time image of the first user to generate the first user information comprises:
performing edge detection on the first real-time image for detecting a user face position;
detecting eye characteristics for determining a user eye position corresponding to the user face position on the first real-time image; and
determining the user gazing direction according to the user eye position.

### Claim 18 (depends on 17)

The method of video conference image processing of claim 17, wherein the step of processing the first real-time image of the first user to generate a first user information comprises:
calculating a user distance based on user face size information corresponding to the user face position on the first real-time image and focal length information of the image capture circuit.

### Claim 19 (depends on 17)

The network video communication device of claim 17, wherein the step of determining the user gazing direction according to the user eye position comprises:
determining a horizontal face midline and a vertical face midline of a user face at the user face position; and
comparing the user's eye positions with the horizontal face midline and the vertical face midline of the user face.

### Claim 20 (depends on 16)

The method of video conference image processing of claim 16, further comprising:
receiving a first real-time audio local to the network video communication device, and processing the first real-time audio to determine a direction and the status of the first user.

### Claim 21 (depends on 16)

The method of video conference image processing of claim 16, wherein the identity or the status of the first user meets the requirement when the identity of the first user is a host of the online video conference or the status of the first user is current speaker of the online video conference.

### Claim 22 (depends on 16)

The method of video conference image processing of claim 16, wherein the step of displaying the video conference screen including the second real-time image with the adjusted field of view comprises:
receiving a priority for the second real-time image with the adjusted field of view; and
arranging a screen area in the video conference screen corresponding to the received priority.
