Automated video detection and correction
AssigneeInternational Business Machines Corporation
InventorsAaron K. Baughman, Stephen C Hammer
Life of this patent
Estimating the term…
Abstract
A method and system for improving automated video detection and correction is provided. The method includes retrieving a portion of a video stream and dividing the portion into video frames and an audio file. The video frames and audio file are analyzed, and a speech polarity of the audio file is detected. Likewise, a visual action epicenter of the portion of the video stream is detected and a fade portion of the portion of the video stream is removed. An edited fade portion associated with the fade portion is generated and patched into the video stream. The edited fade portion patched into the video stream is presented via a display device.
Claims20
An automated video detection and correction method comprising:
- retrieving, by a processor of a hardware device, a portion of a video stream;
- updating, by said processor, a document-based record configured to prevent additional system dispatchers from retrieving video files that have been processed;
- executing, by said processor, a query with respect to said document-based record;
- writing, by said processor in response to said executing said query, a JSON file into a disk-based queue for dispatch;
- dividing, by said processor executing said JSON file within said disk-based queue for referencing a location of said portion of said video stream, said portion into a plurality of video frames and an audio file, wherein said dividing comprises:
- associating each video frame of said plurality of video frames with a first specified time duration;
- dividing said audio file into a plurality of audio file portions;
- and
- associating each audio file portion of said plurality of audio file portions with a second specified time duration;
- analyzing, by said processor executing a first encoder apparatus of said hardware device, said plurality of video frames with respect to sound, action, speech, and graphics;
- analyzing, by said processor executing a second encoder apparatus of said hardware apparatus, each said audio file portion of said audio file;
- detecting, by said processor executing a natural language processing (NLP) system, a speech polarity of each said audio file portion of said audio file;
- detecting, by said processor based on analysis of an output of said first encoder apparatus, a visual action epicenter of said portion of said video stream;
- removing, by said processor based on said analysis of said output of said first encoder apparatus and analysis of an output of said second encoder apparatus, a fade portion fading into a background of said portion of said video stream;
- generating, by said processor based on said visual action epicenter and said fade portion, an edited fade portion associated with said fade portion, wherein said edited fade portion comprises first video frames for presentation within a foreground portion of said portion of said video stream, and wherein said generating said edited fade portion comprises randomly cropping and mirroring said fade portion into a set of new images comprised by said edited fade portion;
- patching, by said processor, said edited fade portion into said video stream;
- and
- presenting by said processor to users via a display device, said edited fade portion patched into said video stream.
A computer program product, comprising a computer readable hardware storage device storing a computer readable program code, said computer readable program code comprising an algorithm that when executed by a processor of a hardware device implements a method, said method comprising:
- retrieving, by said processor, a portion of a video stream;
- updating, by said processor, a document-based record configured to prevent additional system dispatchers from retrieving video files that have been processed;
- executing, by said processor, a query with respect to said document-based record;
- writing, by said processor in response to said executing said query, a JSON file into a disk-based queue for dispatch;
- dividing, by said processor executing said JSON file within said disk-based queue for referencing a location of said portion of said video stream, said portion into a plurality of video frames and an audio file, wherein said dividing comprises:
- associating each video frame of said plurality of video frames with a first specified time duration;
- dividing said audio file into a plurality of audio file portions;
- and
- associating each audio file portion of said plurality of audio file portions with a second specified time duration;
- analyzing, by said processor executing a first encoder apparatus of said hardware device, said plurality of video frames with respect to sound, action, speech, and graphics;
- analyzing, by said processor executing a second encoder apparatus of said hardware apparatus, each said audio file portion of said audio file;
- detecting, by said processor executing a natural language processing (NLP) system, a speech polarity of each said audio file portion of said audio file;
- detecting, by said processor based on analysis of an output of said first encoder apparatus, a visual action epicenter of said portion of said video stream;
- removing, by said processor based on said analysis of said output of said first encoder apparatus and analysis of an output of said second encoder apparatus, a fade portion fading into a background of said portion of said video stream;
- generating, by said processor based on said visual action epicenter and said fade portion, an edited fade portion associated with said fade portion, wherein said edited fade portion comprises first video frames for presentation within a foreground portion of said portion of said video stream, and wherein said generating said edited fade portion comprises randomly cropping and mirroring said fade portion into a set of new images comprised by said edited fade portion;
- patching, by said processor, said edited fade portion into said video stream;
- and
- presenting by said processor to users via a display device, said edited fade portion patched into said video stream.
A hardware device comprising a processor coupled to a computer-readable memory unit, said memory unit comprising instructions that when executed by the computer processor implements a method comprising:
- retrieving, by said processor, a portion of a video stream;
- updating, by said processor, a document-based record configured to prevent additional system dispatchers from retrieving video files that have been processed;
- executing, by said processor, a query with respect to said document-based record;
- writing, by said processor in response to said executing said query, a JSON file into a disk-based queue for dispatch;
- dividing, by said processor executing said JSON file within said disk-based queue for referencing a location of said portion of said video stream, said portion into a plurality of video frames and an audio file, wherein said dividing comprises:
- associating each video frame of said plurality of video frames with a first specified time duration;
- dividing said audio file into a plurality of audio file portions;
- and
- associating each audio file portion of said plurality of audio file portions with a second specified time duration;
- analyzing, by said processor executing a first encoder apparatus of said hardware device, said plurality of video frames with respect to sound, action, speech, and graphics;
- analyzing, by said processor executing a second encoder apparatus of said hardware apparatus, each said audio file portion of said audio file;
- detecting, by said processor executing a natural language processing (NLP) system, a speech polarity of each said audio file portion of said audio file;
- detecting, by said processor based on analysis of an output of said first encoder apparatus, a visual action epicenter of said portion of said video stream;
- removing, by said processor based on said analysis of said output of said first encoder apparatus and analysis of an output of said second encoder apparatus, a fade portion fading into a background of said portion of said video stream;
- generating, by said processor based on said visual action epicenter and said fade portion, an edited fade portion associated with said fade portion, wherein said edited fade portion comprises first video frames for presentation within a foreground portion of said portion of said video stream, and wherein said generating said edited fade portion comprises randomly cropping and mirroring said fade portion into a set of new images comprised by said edited fade portion;
- patching, by said processor, said edited fade portion into said video stream;
- and
- presenting by said processor to users via a display device, said edited fade portion patched into said video stream.
Dependencies are inferred from the claim text.