# US 2014/0207804 A1 · Video data filtering

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0207804 A1
- Document ID: US20140207804A1
- Status: Published application
- Kind: A1
- Application number: 14/225,528
- Filed: 2014-03-26
- Published: 2014-07-24
- Earliest claimed: 2011-01-05
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Sarbajit K. Rakshit
- Web page: https://patentgrep.com/patent/US20140207804A1

## CPC

- H04N 21/25891: {being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- G06F 16/40: of multimedia data, e.g. slideshows comprising image and additional audio data (retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70)
- G06F 16/435: Filtering based on additional data, e.g. user or group profiles
- G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G11B 27/3081: {used signal is a video-frame or a video-field (P.I.P)}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 21/4318: {by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 21/454: Content {or additional data} filtering, e.g. blocking advertisements
- H04N 21/4542: {Blocking scenes or portions of the received content, e.g. censoring scenes}
- H04N 21/4545: Input to filtering algorithms, e.g. filtering a region of the image
- H04N 21/45452: {applied to an object-based stream, e.g. MPEG-4 streams}
- H04N 21/4755: {for defining user preferences, e.g. favourite actors or genre (retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306)}
- H04N 21/4882: {for displaying messages, e.g. warnings, reminders (arrangements for providing short real-time information to substation in data switching networks H04L12/1895)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

A filtering method and system. The method includes receiving by a computer processor an audio/video data file and filtering data. The computer processor analyzes the filtering data with respect to the audio/video data file and retrieves specified audio/video data portions comprising data objects within frames of the audio/video data file. The computer processor removes gaps existing in the audio/video data file and receives tags comprising instructions for presenting video data of the audio/video data file, audio data of the audio/video data file, and the specified audio/video data portions. The computer processor stores the video data in a first layer of a multimedia file, the audio data in a second layer of the multimedia file, and the specified audio/video data portions in additional layers of the multimedia file. Each of the first layer, the second layer, and the additional layers comprises a tag layer comprising the tags.

## Claims

### Claim 1

A method comprising:
receiving, by a computer processor of a computing system, filtering data associated with filtering an audio/video data file comprising audio voice data, audio music data, title data, and video data;
first analyzing, by said computer processor, said filtering data with respect to said audio/video data file;
determining, by said computer processor based on results of said first analyzing, specified audio/video data portions of said audio/video data file, wherein said specified audio/video data portions comprise data objects within frames of said audio/video data file;
retrieving, by said computer processor from said audio/video data file in response to said determining, said specified audio/video data portions from said audio/video data file;
removing, by said computer processor, gaps existing in said audio/video data file resulting from said retrieving said specified audio/video data portions;
receiving, by said computer processor, tags comprising instructions for presenting said video data of said audio/video data file, said audio voice data of said audio/video data file, said audio music data, said title data, and said specified audio/video data portions;
storing, by said computer processor, said video data of said audio/video data file in a first individual layer of a multimedia file, said audio voice data of said audio/video data file in a second individual layer of said multimedia file, said audio music data in a third individual layer of said multimedia file, said title data in a fourth individual layer of said multimedia file, and said specified audio/video data portions in additional individual layers of said multimedia file, wherein each of said first individual layer, said individual second layer, said third individual layer, said individual fourth layer, and said additional individual layers comprises a dedicated tag layer comprising associated tags of said tags; and
presenting, by said computer processor, a graphical user interface (GUI) illustrating said video data in said first individual layer, said audio voice data of said audio/video data file in said second individual layer, said audio music data in said third individual layer, said title data in said fourth individual layer, said specified audio/video data portions in said additional individual layers, and each said dedicated tag layer comprising said associated tags, wherein GUI presents each said dedicated tag layer comprising an associated tag such that each said dedicated tag layer is presented adjacent to an associated layer of said first individual layer, said second individual layer, said third individual layer, said fourth individual layer, and each of said additional individual layers.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;
retrieving, by said computer processor from said first device, a first user profile associated with said first user;
second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and
transmitting, by said computer processor to said first user via said first device in response to said second analyzing, said video data, said audio voice data, and first audio/video data portions of said specified audio/video data portions, wherein said first audio/video data portions are associated with said first user profile, and wherein said first device presents said video data, said audio voice data, and said first audio/video data portions to said first user.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
receiving, by said computer processor from a second user accessing a second device, a command for enabling said audio/video data file, said second user differing from said first user;
retrieving, by said computer processor from said second device, a second user profile associated with said second user, second user profile differing from said first user profile;
third analyzing, by said computer processor, said second user profile with respect to each tag of said tags; and
transmitting, by said computer processor to said second user profile user via said second device in response to results of said second analyzing, said video data, said audio voice data, and second audio/video data portions of said specified audio/video data portions, wherein said second audio/video data portions differ from said first audio/video data portions, wherein said second audio/video data portions are associated with said second user profile, and wherein said second device presents said video data, said audio voice data, and said second audio/video data portions to said second user.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;
retrieving, by said computer processor from said first device, a first user profile associated with said first user;
second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and
transmitting, by said computer processor to said first user via said first device in response to results of said second analyzing, a message indicating that said first user is not authorized to receive any of said multimedia files.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;
retrieving, by said computer processor from said first device, a first user profile associated with said first user;
second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and
transmitting, by said computer processor to said first user via said first device in response to results of said second analyzing first audio/video data portions of said specified audio/video data portions, wherein said first audio/video data portions are associated with said first user profile, and wherein said first device presents said first audio/video data portions to said first user.

### Claim 6 (depends on 1)

The method of claim 1, wherein said first device comprises a device selected from the group consisting of an Internet enabled television, an Internet portal, and a wireless device.

### Claim 7 (depends on 1)

The method of claim 1, wherein each audio/video data portion of said specified audio/video data portions comprises data selected from the group consisting of a video object within a video frame, audio speech data, and text data.

### Claim 8 (depends on 1)

The method of claim 1, wherein said filtering data comprises rules associated with determining said specified audio/video data portions, and wherein said rules are selected from the group consisting of location based rules, age group based rules, organizational structure based rules, and confidential information based rules.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
receiving, by said computer processor from a user, filtering criteria indicating additionally filtering said audio/video data file;
retrieving, by said computer processor from said audio/video data file in response to said filtering criteria, additionally specified audio/video data portions from said audio/video data file; and
removing, by said computer processor, gaps existing in said audio/video data file resulting from said retrieving said additionally specified audio/video data portions.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
receiving, by said computer processor, scenario based filtering data associated with filtering said audio/video data file;
second analyzing, by said computer processor, said scenario based filtering data with respect to said audio/video data file;
determining, by said computer processor based on results of said second analyzing, second specified audio/video data portions of said audio/video data file;
receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;
determining, by said computer processor based on said scenario based filtering data, that said second specified audio/video data portions should be removed; and
retrieving, by said computer processor from said audio/video data file, said second specified audio/video data portions from said audio/video data file.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
providing at least one support service for at least one of creating, integrating, hosting, maintaining, and deploying computer-readable code in said computing system, wherein the code in combination with the computing system is capable of performing: said receiving said audio/video file, said receiving said filtering data, said first analyzing, said determining, said retrieving, said removing, said receiving said tags, said storing said video data, and said storing said multimedia file.

### Claim 12

A computer program product, comprising a computer readable storage device storing a computer readable program code, said computer readable program code comprising an algorithm that when executed by a computer processor of a computing system implements a method comprising:
receiving, by said computer processor, filtering data associated with filtering an audio/video data file comprising audio voice data, audio music data, title data, and video data;
first analyzing, by said computer processor, said filtering data with respect to said audio/video data file;
determining, by said computer processor based on results of said first analyzing, specified audio/video data portions of said audio/video data file, wherein said specified audio/video data portions comprise data objects within frames of said audio/video data file;
retrieving, by said computer processor from said audio/video data file in response to said determining, said specified audio/video data portions from said audio/video data file;
removing, by said computer processor, gaps existing in said audio/video data file resulting from said retrieving said specified audio/video data portions;
receiving, by said computer processor, tags comprising instructions for presenting said video data of said audio/video data file, said audio voice data of said audio/video data file, said audio music data, said title data, and said specified audio/video data portions;
storing, by said computer processor, said video data of said audio/video data file in a first individual layer of a multimedia file, said audio voice data of said audio/video data file in a second individual layer of said multimedia file, said audio music data in a third individual layer of said multimedia file, said title data in a fourth individual layer of said multimedia file, and said specified audio/video data portions in additional individual layers of said multimedia file, wherein each of said first individual layer, said individual second layer, said third individual layer, said individual fourth layer, and said additional individual layers comprises a dedicated tag layer comprising associated tags of said tags; and
presenting, by said computer processor, a graphical user interface (GUI) illustrating said video data in said first individual layer, said audio voice data of said audio/video data file in said second individual layer, said audio music data in said third individual layer, said title data in said fourth individual layer, said specified audio/video data portions in said additional individual layers, and each said dedicated tag layer comprising said associated tags, wherein GUI presents each said dedicated tag layer comprising an associated tag such that each said dedicated tag layer is presented adjacent to an associated layer of said first individual layer, said second individual layer, said third individual layer, said fourth individual layer, and each of said additional individual layers.

### Claim 13 (depends on 12)

The computer program product of claim 12, wherein said method further comprises:
receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;
retrieving, by said computer processor from said first device, a first user profile associated with said first user;
second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and
transmitting, by said computer processor to said first user via said first device in response to said second analyzing, said video data, said audio voice data, and first audio/video data portions of said specified audio/video data portions, wherein said first audio/video data portions are associated with said first user profile, and wherein said first device presents said video data, said audio voice data, and said first audio/video data portions to said first user.

### Claim 14 (depends on 13)

The computer program product of claim 13, wherein said method further comprises:
receiving, by said computer processor from a second user accessing a second device, a command for enabling said audio/video data file, said second user differing from said first user;
retrieving, by said computer processor from said second device, a second user profile associated with said second user, second user profile differing from said first user profile;
third analyzing, by said computer processor, said second user profile with respect to each tag of said tags; and
transmitting, by said computer processor to said second user profile user via said second device in response to results of said second analyzing, said video data, said audio voice data, and second audio/video data portions of said specified audio/video data portions, wherein said second audio/video data portions differ from said first audio/video data portions, wherein said second audio/video data portions are associated with said second user profile, and wherein said second device presents said video data, said audio voice data, and said second audio/video data portions to said second user.

### Claim 15 (depends on 12)

The computer program product of claim 12, wherein said method further comprises:
receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;
retrieving, by said computer processor from said first device, a first user profile associated with said first user;
second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and
transmitting, by said computer processor to said first user via said first device in response to results of said second analyzing, a message indicating that said first user is not authorized to receive any of said multimedia files.

### Claim 16 (depends on 12)

The computer program product of claim 12, wherein said method further comprises:
receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;
retrieving, by said computer processor from said first device, a first user profile associated with said first user;
second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and
transmitting, by said computer processor to said first user via said first device in response to results of said second analyzing first audio/video data portions of said specified audio/video data portions, wherein said first audio/video data portions are associated with said first user profile, and wherein said first device presents said first audio/video data portions to said first user.

### Claim 17 (depends on 12)

The computer program product of claim 12, wherein said first device comprises a device selected from the group consisting of an Internet enabled television, an Internet portal, and a wireless device.

### Claim 18 (depends on 12)

The computer program product of claim 12, wherein each audio/video data portion of said specified audio/video data portions comprises data selected from the group consisting of a video object within a video frame, audio speech data, and text data.

### Claim 19

A computing system comprising a computer processor coupled to a computer-readable memory unit, said memory unit comprising instructions that when executed by the computer processor implements a method comprising:
receiving, by said computer processor, filtering data associated with filtering an audio/video data file comprising audio voice data, audio music data, title data, and video data;
first analyzing, by said computer processor, said filtering data with respect to said audio/video data file;
determining, by said computer processor based on results of said first analyzing, specified audio/video data portions of said audio/video data file, wherein said specified audio/video data portions comprise data objects within frames of said audio/video data file;
retrieving, by said computer processor from said audio/video data file in response to said determining, said specified audio/video data portions from said audio/video data file;
removing, by said computer processor, gaps existing in said audio/video data file resulting from said retrieving said specified audio/video data portions;
receiving, by said computer processor, tags comprising instructions for presenting said video data of said audio/video data file, said audio voice data of said audio/video data file, said audio music data, said title data, and said specified audio/video data portions;
storing, by said computer processor, said video data of said audio/video data file in a first individual layer of a multimedia file, said audio voice data of said audio/video data file in a second individual layer of said multimedia file, said audio music data in a third individual layer of said multimedia file, said title data in a fourth individual layer of said multimedia file, and said specified audio/video data portions in additional individual layers of said multimedia file, wherein each of said first individual layer, said individual second layer, said third individual layer, said individual fourth layer, and said additional individual layers comprises a dedicated tag layer comprising associated tags of said tags; and
presenting, by said computer processor, a graphical user interface (GUI) illustrating said video data in said first individual layer, said audio voice data of said audio/video data file in said second individual layer, said audio music data in said third individual layer, said title data in said fourth individual layer, said specified audio/video data portions in said additional individual layers, and each said dedicated tag layer comprising said associated tags, wherein GUI presents each said dedicated tag layer comprising an associated tag such that each said dedicated tag layer is presented adjacent to an associated layer of said first individual layer, said second individual layer, said third individual layer, said fourth individual layer, and each of said additional individual layers.

### Claim 20 (depends on 19)

The computing system of claim 19, wherein said method further comprises:
receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;
retrieving, by said computer processor from said first device, a first user profile associated with said first user;
second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and
transmitting, by said computer processor to said first user via said first device in response to said second analyzing, said video data, said audio voice data, and first audio/video data portions of said specified audio/video data portions, wherein said first audio/video data portions are associated with said first user profile, and wherein said first device presents said video data, said audio voice data, and said first audio/video data portions to said first user.
