# US 2019/0356883 A1 · Multiple simultaneous framing alternatives using speaker tracking

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356883 A1
- Document ID: US20190356883A1
- Status: Published application
- Kind: A1
- Application number: 15/981,299
- Filed: 2018-05-16
- Published: 2019-11-21
- Earliest claimed: 2018-05-16
- Assignees: Cisco Technology, Inc.
- Applicants: Cisco Technology, Inc.
- Inventors: Christian Fjelleng Theien; Rune Øistein Aas; Kristian Tangeland
- Web page: https://patentgrep.com/patent/US20190356883A1

## CPC

- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 7/152: {Multipoint control units therefor}
- H04N 7/01: Conversion of standards {, e.g. involving analogue television standards or digital television standards processed at pixel level}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In one embodiment, a video conference endpoint may detect a one or more participants within a field of view of a camera of the video conference endpoint. The video conference endpoint may determine one or more alternative framings of an output of the camera of the video conference endpoint based on the detected one or more participants. The video conference endpoint may send the output of the camera of the video conference endpoint to one or more far-end video conference endpoints participating in a video conference with the video conference endpoint. The video conference endpoint may send data descriptive of the one or more alternative framings of the output of the camera to the far-end video conference endpoints. The far-end video conference endpoints may utilize the data to display one of the one or more alternative framings.

## Claims

### Claim 1

A method comprising:
detecting, by a primary video conference endpoint, one or more participants within a field of view of a camera of the primary video conference endpoint;
determining, by the primary video conference endpoint, one or more alternative framings of an output of the camera of the primary video conference endpoint based on the detected one or more participants;
sending, by the primary video conference endpoint, the output of the camera of the primary video conference endpoint to one or more secondary video conference endpoints; and
sending, by the primary video conference endpoint, data descriptive of the one or more alternative framings of the output of the camera of the primary video conference endpoint to the one or more secondary video conference endpoints, wherein the one or more secondary conference endpoints can utilize the data to alter the output of the camera of the primary video conference endpoint to display one of the one or more alternative framings.

### Claim 2 (depends on 1)

The method of claim 1, wherein the output of the camera of the video conference endpoint is a high resolution video stream.

### Claim 3 (depends on 1)

The method of claim 1, wherein the sending the output includes sending the output of the camera of the primary video conference endpoint to one or more of the secondary video conference endpoints via a first channel.

### Claim 4 (depends on 3)

The method of claim 3, wherein the sending the data includes sending the data of the one or more alternative framings to one or more of the secondary video conference endpoints as metadata via a secondary metadata channel.

### Claim 5 (depends on 3)

The method of claim 3, wherein the sending the data includes sending the data of the one or more alternative framings to one or more of the secondary video conference endpoints as metadata with the output of the camera of the primary video conference endpoint via the first channel.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
detecting, by the primary video conference endpoint, a first participant of the one or more participants as an active speaker.

### Claim 7 (depends on 6)

The method of claim 6, wherein determining one or more alternative framings of an output of the camera of the primary video conference endpoint based on the detected one or more participants further comprises:
determining a wide framing that includes each of the one or more participants;
determining a tight framing that includes each of the one or more participants;
determining a first speaker framing that includes the active speaker and surroundings of the active speaker;
determining a second speaker framing that is a close-up of the active speaker; and
determining a thumbnail framing of each of the one or more participants.

### Claim 8

An apparatus comprising:
a network interface unit that enables communication over a network by a primary video conference endpoint; and
a processor coupled to the network interface unit, the processor configured to:
detect one or more participants within a field of view of a camera of the primary video conference endpoint;
determine one or more alternative framings of an output of the camera of the primary video conference endpoint based on the detected one or more participants;
send the output of the camera of the primary video conference endpoint to one or more secondary video conference endpoints; and
send data descriptive of the one or more alternative framings of the output of the camera of the primary video conference endpoint to the one or more secondary video conference endpoints, wherein the one or more secondary conference endpoints can utilize the data to alter the output of the camera of the primary video conference endpoint to display the one or more alternative framings.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the output of the camera of the video conference endpoint is a high resolution video stream.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the output of the camera of the primary video conference endpoint is sent to one or more of the secondary video conference endpoints via a first channel.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the data of the one or more alternative framings is sent to one or more of the secondary video conference endpoints as metadata via a secondary metadata channel.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein the data of the one or more alternative framings is sent to one or more of the secondary video conference endpoints as metadata with the output of the camera of the primary video conference endpoint via the first channel.

### Claim 13 (depends on 8)

The apparatus of claim 8, wherein the processor is further configured to:
detect a first participant of the one or more participants as an active speaker.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the processor, when determining one or more alternative framings of an output of the camera of the primary video conference endpoint based on the detected one or more participants, is further configured to:
determine a wide framing that includes each of the one or more participants;
determine a tight framing that includes each of the one or more participants;
determine a first speaker framing that includes the active speaker and surroundings of the active speaker;
determine a second speaker framing that is a close-up of the active speaker; and
determine a thumbnail framing of each of the one or more participants.

### Claim 15

A non-transitory processor readable medium storing instructions that, when executed by a processor, cause the processor to:
detect one or more participants within a field of view of a camera of a primary video conference endpoint;
determine one or more alternative framings of an output of the camera of the primary video conference endpoint based on the detected one or more participants;
send the output of the camera of the primary video conference endpoint to one or more secondary video conference endpoints; and
send data descriptive of the one or more alternative framings of the output of the camera of the primary video conference endpoint to the one or more secondary video conference endpoints, wherein the one or more secondary conference endpoints can utilize the data to alter the output of the camera of the primary video conference endpoint to display one of the one or more alternative framings.

### Claim 16 (depends on 15)

The non-transitory processor readable medium of claim 15, wherein the output of the camera of the video conference endpoint is a high resolution video stream.

### Claim 17 (depends on 15)

The non-transitory processor readable medium of claim 15, wherein the output of the camera of the primary video conference endpoint is sent to one or more of the secondary video conference endpoints via a first channel.

### Claim 18 (depends on 17)

The non-transitory processor readable medium of claim 17, wherein the data of the one or more alternative framings is sent to one or more of the secondary video conference endpoints as metadata via a secondary metadata channel.

### Claim 19 (depends on 15)

The non-transitory processor readable medium of claim 15, further comprising instructions that, when executed by the processor, cause the processor to:
detect a first participant of the one or more participants as an active speaker.

### Claim 20 (depends on 19)

The non-transitory processor readable medium of claim 19, further comprising instructions that, when executed by the processor, cause the processor, when determining one or more alternative framings of an output of the camera of the primary video conference endpoint based on the detected one or more participants, to:
determine a wide framing that includes each of the one or more participants;
determine a tight framing that includes each of the one or more participants;
determine a first speaker framing that includes the active speaker and surroundings of the active speaker;
determine a second speaker framing that is a close-up of the active speaker; and
determine a thumbnail framing of each of the one or more participants.
