# US 11,122,219 B2 · Mid-span device and system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,122,219 B2
- Document ID: US11122219B2
- Status: Granted
- Kind: B2
- Application number: 16/542,383
- Filed: 2019-08-16
- Published: 2020-02-20
- Granted: 2021-09-14
- Earliest claimed: 2018-08-19
- Assignees: Altia Systems, Inc.
- Applicants: Altia Systems, Inc.
- Inventors: John Zhang; Naveed Alam; Yashket Gupta; Ram Natarajan
- Web page: https://patentgrep.com/patent/US11122219B2

## CPC

- H04N 5/265: Mixing
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 21/43632: {involving a wired protocol, e.g. IEEE 1394 (high-speed IEEE 1394 serial bus H04L12/40052)}
- H04N 21/439: Processing of audio elementary streams
- H04N 21/440218: {by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 (conversion of standards in analogue television systems H04N7/01)}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A video processing device which can be implemented as a peripheral device is disclosed. The video processing device is configured to receive one or more videos and audio through a plurality interfaces. Further, the device receives one or more user input corresponding to one or more customization requests of the received video and the audio. The video processing device processes the video and the audio based on the received user input and outputs the processed video and audio via an output interface.

## Claims

### Claim 1

A peripheral video processing device, comprising:
a plurality of first interfaces to communicably connect the peripheral video device to a camera as a plug in, said first interfaces configured to receive one or more videos from the camera;
a second interface configured to receive audio from the camera;
a unit configured to split videos into multiple streams;
a pass-through processing unit configured to send the original stream as an output without any latency;
a module to receive one or more user inputs corresponding to one or more customization requests to customize the one or more videos and audio received;
one or more processing modules to make one or more customizations to one or more split videos and audio based on the one or more customization requests, wherein the one or more processing modules are configured to determine at least one of an active speaker in one or more received videos and a number of faces in the one or more received videos; and
an output interface to output customized video and audio.

### Claim 2 (depends on 1)

The video processing device of claim 1, wherein the one or more customizations comprises zooming in on the one or more videos.

### Claim 3 (depends on 1)

The video processing device of claim 1, wherein the one or more customizations comprises creating a composite video of the received one or more videos.

### Claim 4 (depends on 1)

The video processing device of claim 1, wherein the one or more videos are asynchronously received.

### Claim 5 (depends on 1)

The video processing device of claim 1, further comprising a plurality of buffers to store each of the received one or more videos.

### Claim 6 (depends on 1)

The video processing device of claim 1, wherein the one or more customizations comprises converting the received one or more videos into a H.264 video format.

### Claim 7 (depends on 1)

The video processing device of claim 1, wherein the one or more customizations comprises outputting a passthrough of the audio received.

### Claim 8 (depends on 1)

The video processing device of claim 1, wherein the output video corresponds to the video including the determined active speaker.

### Claim 9 (depends on 1)

The video processing device of claim 1, wherein the output interface outputs a plurality of videos simultaneously.

### Claim 10 (depends on 1)

The video processing device of claim 1, configured to recognize faces in the one or more received videos.

### Claim 11 (depends on 10)

The video processing device of claim 10, configured to recognize speech corresponding to the determined active speaker and generate one or more transcripts of the recognized speech.

### Claim 12 (depends on 11)

The video processing device of claim 11, wherein the generated one or more transcripts are associated with an ID of the active speaker.

### Claim 13

A video processing method comprising:
receiving one or more videos through a plurality of first interfaces at a peripheral device plugged in to a camera;
receiving, at the peripheral device, an audio via a second interface;
processing, by the peripheral device, the one or more videos and the audio based on the received one or more user inputs comprising splitting the videos into multiple streams and sending, by a pass-through unit the original video stream as an output without any latency;
receiving, at the peripheral device, one or more user inputs corresponding to one or more customization requests corresponding to the one or more videos received and the audio received;
customizing, by the peripheral device, the one or more videos and the audio based on the received one or more user inputs comprising determining at least one of an active speaker in one or more received videos and a number of faces in the one or more received videos; and
outputting, by the peripheral device, the customized video and audio via an output interface.
