# US 2016/0261825 A1 · Filtering video for video telephony and video conferencing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0261825 A1
- Document ID: US20160261825A1
- Status: Published application
- Kind: A1
- Application number: 14/957,155
- Filed: 2015-12-02
- Published: 2016-09-08
- Earliest claimed: 2015-03-03
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Abdullah Q. Chougle; Akash U. Dhoot; Shailendra Moyal
- Web page: https://patentgrep.com/patent/US20160261825A1

## CPC

- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V 40/161: {Detection; Localisation; Normalisation}
- G10L 15/00: Speech recognition (G10L17/00 takes precedence)
- G10L 25/57: for processing of video signals
- G11B 27/00: Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- H04N 5/144: {Movement detection (for video coding H04N19/503; analysis of motion in general G06T7/20)}
- H04N 7/15: Conference systems
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

In an approach to video filtering, a computer receives a first video frame of a presenter from a video feed that includes an audio feed. The computer receives a second video frame. The computer determines whether a difference between the first video frame and the second video frame exceeds a pre-defined threshold. In response to determining the difference between the first video frame and the second video frame exceeds the pre-defined threshold, the computer determines whether the difference between the first video frame and the second video frame is expected. In response to determining the difference between the first video frame and the second video frame is expected, the computer discards video data associated with the difference between the first video frame and the second video frame. The computer creates a third video frame, based, at least in part, on non-discarded video data.

## Claims

### Claim 1

A method for video filtering, the method comprising:
receiving, by one or more computer processors, a first video frame of a presenter from a video feed that includes an audio feed;
receiving, by the one or more computer processors, a second video frame;
determining, by the one or more computer processors, whether a difference between the first video frame and the second video frame exceeds a pre-defined threshold;
responsive to determining the difference between the first video frame and the second video frame exceeds the pre-defined threshold, determining, by the one or more computer processors, whether the difference between the first video frame and the second video frame is expected;
responsive to determining the difference between the first video frame and the second video frame is not expected, discarding, by the one or more computer processors, video data associated with the difference between the first video frame and the second video frame; and
creating, by the one or more computer processors, a third video frame, based, at least in part, on non-discarded video data.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
responsive to creating a third video frame, saving, by the one or more computer processors, the third video frame;
transmitting, by the one or more computer processors, the third video frame; and
discarding, by the one or more computer processors, the first video frame.

### Claim 3 (depends on 1)

The method of claim 1, further comprising, extracting, by the one or more computer processors, a face of the presenter and a background from the first video frame.

### Claim 4 (depends on 1)

The method of claim 1, further comprising, responsive to determining the difference between the first video frame and the second video frame exceeds a pre-defined threshold, determining, by the one or more computer processors, whether the difference between the first video frame and the second video frame is due to movement of a face of the presenter.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
responsive to determining the difference between the first video frame and the second video frame exceeds the pre-defined threshold, converting, by the one or more computer processors, the audio feed from speech to text; and
determining, by the one or more computer processors, whether the difference between the first video frame and the second video frame is expected, based, at least in part, on the converted audio feed.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining whether the difference between the first video frame and the second video frame is expected further comprises:
comparing, by the one or more computer processors, a converted audio feed to a pre-defined list of one or more acceptable disturbances; and
determining, by the one or more computer processors, whether at least a portion of the converted audio feed is included in the pre-defined list.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
responsive to determining at least a portion of the converted audio feed is not included in the pre-defined list, determining, by the one or more computer processors, whether the presenter opts to add at least the portion of the converted audio feed to the pre-defined list; and
responsive to determining the presenter opts to add at least the portion of the converted audio feed to the pre-defined list, adding, by the one or more computer processors, at least the portion of the converted audio feed to the pre-defined list.

### Claim 8 (depends on 6)

The method of claim 6, wherein the pre-defined list includes at least one or more acceptable disturbances, one or more introductory phrases, one or more acceptable phrases, and one or more names.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
prior to the steps of claim 1:
retrieving, by the one or more computer processors, a pre-defined list of one or more acceptable phrases;
converting, by the one or more computer processors, the audio feed from speech to text;
determining, by the one or more computer processors, whether a semantic relatedness of the converted audio feed to the pre-defined list exceeds a pre-defined threshold;
responsive to determining the semantic relatedness of the converted audio feed to the pre-defined list exceeds a pre-defined threshold, determining, by the one or more computer processors, whether the presenter opts to initiate video filtering; and
responsive to determining the presenter opts to initiate video filtering, initiating, by the one or more computer processors, video filtering.

### Claim 10 (depends on 9)

The method of claim 9, further comprising, responsive to determining the presenter does not opt to initiate video filtering, determining, by the one or more computer processors, whether the presenter opts to add one or more phrases to the pre-defined list.

### Claim 11

A computer program product for video filtering, the computer program product comprising:
one or more computer readable storage device and program instructions stored on the one or more computer readable storage device, the stored program instructions comprising:
program instructions to receive a first video frame of a presenter from a video feed that includes an audio feed;
program instructions to receive a second video frame;
program instructions to determine whether a difference between the first video frame and the second video frame exceeds a pre-defined threshold;
responsive to determining the difference between the first video frame and the second video frame exceeds the pre-defined threshold, program instructions to determine whether the difference between the first video frame and the second video frame is expected;
responsive to determining the difference between the first video frame and the second video frame is not expected, program instructions to discard video data associated with the difference between the first video frame and the second video frame; and
program instructions to create a third video frame, based, at least in part, on non-discarded video data.

### Claim 12 (depends on 11)

The computer program product of claim 11, the stored program instructions further comprising:
responsive to creating a third video frame, program instructions to save the third video frame;
program instructions to transmit the third video frame; and
program instructions to discard the first video frame.

### Claim 13 (depends on 11)

The computer program product of claim 11, the stored program instructions further comprising, program instructions to extract a face of the presenter and a background from the first video frame.

### Claim 14 (depends on 11)

The computer program product of claim 11, the stored program instructions further comprising, responsive to determining the difference between the first video frame and the second video frame exceeds a pre-defined threshold, program instructions to determine whether the difference between the first video frame and the second video frame is due to movement of a face of the presenter.

### Claim 15 (depends on 11)

The computer program product of claim 11, the stored program instructions further comprising:
responsive to determining the difference between the first video frame and the second video frame exceeds the pre-defined threshold, program instructions to convert the audio feed from speech to text; and
program instructions to determine whether the difference between the first video frame and the second video frame is expected, based, at least in part, on the converted audio feed.

### Claim 16

A computer system for video filtering, the computer system comprising:
one or more computer processors;
one or more computer readable storage device;
program instructions stored on the one or more computer readable storage device for execution by at least one of the one or more computer processors, the stored program instructions comprising:
program instructions to receive a first video frame of a presenter from a video feed that includes an audio feed;
program instructions to receive a second video frame;
program instructions to determine whether a difference between the first video frame and the second video frame exceeds a pre-defined threshold;
responsive to determining the difference between the first video frame and the second video frame exceeds the pre-defined threshold, program instructions to determine whether the difference between the first video frame and the second video frame is expected;
responsive to determining the difference between the first video frame and the second video frame is not expected, program instructions to discard video data associated with the difference between the first video frame and the second video frame; and
program instructions to create a third video frame, based, at least in part, on non-discarded video data.

### Claim 17 (depends on 16)

The computer system of claim 16, the stored program instructions further comprising:
responsive to creating a third video frame, program instructions to save the third video frame;
program instructions to transmit the third video frame; and
program instructions to discard the first video frame.

### Claim 18 (depends on 16)

The computer system of claim 16, the stored program instructions further comprising, program instructions to extract a face of the presenter and a background from the first video frame.

### Claim 19 (depends on 16)

The computer system of claim 16, the stored program instructions further comprising, responsive to determining the difference between the first video frame and the second video frame exceeds a pre-defined threshold, program instructions to determine whether the difference between the first video frame and the second video frame is due to movement of a face of the presenter.

### Claim 20 (depends on 16)

The computer system of claim 16, the stored program instructions further comprising:
responsive to determining the difference between the first video frame and the second video frame exceeds the pre-defined threshold, program instructions to convert the audio feed from speech to text; and
program instructions to determine whether the difference between the first video frame and the second video frame is expected, based, at least in part, on the converted audio feed.
