# US 10,372,993 B2 · Selectively retaining high-resolution segments of continuous video data stream > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,372,993 B2 - Document ID: US10372993B2 - Status: Granted - Kind: B2 - Application number: 15/401,375 - Filed: 2017-01-09 - Published: 2018-07-12 - Granted: 2019-08-06 - Earliest claimed: 2017-01-09 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: John W. Barrs, II; Michael S. Glenn; John G. McEachern; Eduardo Mejia - Web page: https://patentgrep.com/patent/US10372993B2 ## CPC - G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames} - G06V 20/49: {Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes} - H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) - H04N 19/17: the unit being an image region, e.g. an object - H04N 19/587: involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence - H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Processing of a continuous, high-resolution video data stream for reduced data storage is provided. The processing includes: analyzing the continuous, high-resolution data stream for one or more specified image elements of interest; identifying at least one image element of the one or more specified image elements of interest in the continuous video data stream; passing one or more video segments of the continuous video data stream as high-resolution video, the one or more video segments containing the identified at least one image element of the one or more specified image elements of interest; and reducing resolution of other portions of the continuous video data stream than the one or more video segments to low-resolution video, wherein low-resolution video includes less data than high-resolution video. ## Claims ### Claim 1 A computer-implemented method comprising: receiving an indication of multiple types of image elements of interest, the multiple types of image elements of interest being prespecified by a user; receiving a continuous video data stream, the continuous video data stream being a high-resolution video data stream; automatically processing the continuous video data stream to facilitate storage of the continuous video data stream, the automatically processing comprising: analyzing, by a processor, the continuous video data stream for any of the multiple user prespecified types of image elements within the continuous video data stream; automatically identifying, by the processor, at least one image element of the multiple user prespecified types of image elements in the continuous video data stream; based on the identifying, passing through unfiltered one or more video frames of the continuous video data stream as high-resolution video, the one or more video frames containing the identified at least one image element of the multiple user prespecified types of image elements; and reducing, by filtering, resolution of other portions of the continuous video data stream other than the one or more video frames to low-resolution video, wherein low-resolution video includes less data than high-resolution video. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein the one or more video frames define one or more video segments, the one or more video segments each being of a defined duration preselected by the user. ### Claim 3 (depends on 2) The computer-implemented method of claim 2, wherein the other portions of the continuous video data stream are a majority of the continuous video data stream. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, wherein the user interface further enables the user to prespecify one or more filter parameters used by the reducing resolution of the other portions of the continuous video data stream. ### Claim 5 (depends on 4) The computer-implemented method of claim 4, wherein the one or more filter parameters enable the user to prespecify a reduction in a resolution from the group consisting of a pixel resolution, a spatial resolution, a spectral resolution, and a temporal resolution, to achieve the low-resolution video. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, further comprising saving chronologically the one or more video frames of the continuous video data stream as the high-resolution video and the other portions of the continuous video data stream as the low-resolution video for a storage duration. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, wherein the user interface further enables the user to set the storage duration and to set an amount of filtering performed by the reducing resolution. ### Claim 8 (depends on 6) The computer-implemented method of claim 6, wherein the saving is to an off-site data storage facility remote from a video processing system performing the analyzing, automatically identifying, passing, and reducing. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, wherein the user interface enables the user to preselect the one or more prespecified types of image elements from a plurality of predefined types of image elements to be used in analyzing the continuous video data stream. ### Claim 10 (depends on 9) The computer-implemented method of claim 9, wherein the one or more prespecified types of image elements comprise one or more elements selected from the group consisting of: a facial image; a vehicle; a license plate; a weapon; and an object. ### Claim 11 A system for processing video data, the system comprising: a memory; and a processing unit communicatively coupled with the memory, wherein the system performs a method comprising: receiving an indication of multiple types of image elements of interest, the multiple types of image elements of interest being prespecified by a user; receiving a continuous video data stream, the continuous video data stream being a high-resolution video data stream; automatically processing the continuous video data stream to facilitate storage of the continuous video data stream, the automatically processing comprising: analyzing, by a processor, the continuous video data stream for any of the multiple user prespecified types of image elements within the continuous video data stream; automatically identifying, by the processor, at least one image element of the multiple user prespecified types of image elements in the continuous video data stream; based on the identifying, passing through unfiltered one or more video frames of the continuous video data stream as high-resolution video, the one or more video frames containing the identified at least one image element of the multiple user prespecified types of image elements; and reducing, by filtering, resolution of other portions of the continuous video data stream other than the one or more video frames to low-resolution video, wherein low-resolution video includes less data than high-resolution video. ### Claim 12 (depends on 11) The system of claim 11, wherein the one or more video frames define one or more video segments, the one or more video segments each being of a defined duration preselected by the user. ### Claim 13 (depends on 11) The system of claim 11, wherein the user interface further enables the user to prespecify one or more filter parameters used by the reducing resolution of the other portions of the continuous video data stream. ### Claim 14 (depends on 13) The system of claim 13, wherein the one or more filter parameters enable the user to prespecify a reduction in a resolution from the group consisting of a pixel resolution, a spatial resolution, a spectral resolution, and a temporal resolution, to achieve the low-resolution video. ### Claim 15 (depends on 11) The system of claim 11, further comprising saving chronologically the one or more video frames of the continuous video data stream as the high-resolution video and the other portions of the continuous video data stream as the low-resolution video for a storage duration. ### Claim 16 (depends on 15) The system of claim 15, wherein the user interface further enables the user to set the storage duration and to set an amount of filtering performed by the reducing resolution. ### Claim 17 (depends on 15) The system of claim 15, wherein the saving is to an off-site data storage facility remote from the system performing the analyzing, automatically identifying, passing, and reducing. ### Claim 18 (depends on 11) The system of claim 11, wherein the user interface enables the user to preselect the one or more prespecified types of image elements from a plurality of predefined types of image elements to be used in analyzing the continuous video data stream. ### Claim 19 A computer program product for processing a video data stream, the computer program product comprising: a non-transitory computer-readable storage medium readable by a processing unit and storing instructions for execution by the processing unit for performing a method comprising: receiving an indication of multiple types of image elements of interest, the multiple types of image elements of interest being prespecified by a user; receiving a continuous video data stream, the continuous video data stream being a high-resolution video data stream; automatically processing the continuous video data stream to facilitate storage of the continuous video data stream, the automatically processing comprising: analyzing, by a processor, the continuous video data stream for any of the multiple user prespecified types of image elements within the continuous video data stream; automatically identifying, by the processor, at least one image element of the multiple user prespecified types of image elements in the continuous video data stream; based on the identifying, passing through unfiltered one or more video frames of the continuous video data stream as high-resolution video, the one or more video frames containing the identified at least one image element of the multiple user prespecified types of image elements; and reducing, by filtering, resolution of other portions of the continuous video data stream other than the one or more video frames to low-resolution video, wherein low-resolution video includes less data than high-resolution video. ### Claim 20 (depends on 19) The computer program product of claim 19, further comprising saving chronologically the one or more video frames of the continuous video data stream as the high-resolution video and the other portions of the continuous video data stream as the low-resolution video for a storage duration.