# US 9,870,518 B2 · Data processing system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,870,518 B2 - Document ID: US9870518B2 - Status: Granted - Kind: B2 - Application number: 15/024,188 - Filed: 2014-03-25 - Published: 2016-08-11 - Granted: 2018-01-16 - Earliest claimed: 2013-12-16 - Assignees: Hanwha Techwin Co., Ltd. - Applicants: Hanwha Techwin Co., Ltd. - Inventors: Dong Jun Park; Hak Chul Shin; Yeon Geol Ryu - Web page: https://patentgrep.com/patent/US9870518B2 ## CPC - G06F 16/583: using metadata automatically derived from the content - G06F 16/58: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F 18/40: Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor - G06V 10/945: {User interactive design; Environments; Toolboxes} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Provided is a data processing system providing various user interfaces to users by analyzing and processing data collected via various routes, by using a parallel and distributive manner based on the assumption that generation, analysis, storage, and consumption of data is performed at various locations. ## Claims ### Claim 1 A data processing system comprising: a data generator comprising at least one network camera, at least one sensor, and an external data source, the data generator being configured to collect first data obtained by analyzing image data and audio data obtained using the at least one network camera, using first metadata from among predefined metadata, collect second data obtained by the at least one sensor, and collect third data provided from the external data source; a plurality of data analyzers comprising a first processor, a first storage, and a first user interface, the plurality of data analyzers being configured to store first analysis result data obtained by analyzing the first through third data received via a network, using second metadata from among the predefined metadata; a plurality of data storage units comprising a second processor, a second storage, and a second user interface, the plurality of data storage units being configured to store the first through third data and the first analysis result data via the network and store second analysis result data obtained by analyzing the first through third data and the first analysis result data by using third metadata from among the predefined metadata, wherein each of the first user interface and the second user interface provides, according to a request from a user terminal, at least one of the first data, the second data, the third data, the first analysis result, and the second analysis result data, wherein the second storage is configured to store the first through third data and the first analysis result data, wherein the second processor is configured to generate the second analysis result data obtained by analyzing the first through third data and the first analysis result data by using the third metadata from among the predefined metadata, wherein the second processor is configured to provide, according to the request from the user terminal, the second analysis result data, wherein the second processor comprises: a distributor configured to distribute the first through third data; and at least one of a simultaneous analyzer and a sequential analyzer, wherein the simultaneous analyzer comprises a first plurality of analysis modules, wherein each of the first plurality of analysis modules receives the first through third data distributed by the distribution module and performs analysis by using the third metadata, and wherein the sequential analyzer comprises a second plurality of analysis modules performing analysis in series on the first through third data distributed by the distribution module using the third metadata. ### Claim 2 (depends on 1) The data processing system of claim 1, wherein the at least one network camera comprises: a generator configured to generate the image data and the audio data; and a third processor configured to generate the first data based on third analysis result data obtained by analyzing the image data and the audio data by using the first metadata from among the predefined metadata. ### Claim 3 (depends on 1) The data processing system of claim 1, wherein the plurality of data analyzers comprise a data analyzer comprising: the first processor configured to generate the first analysis result data obtained by analyzing the first through third data by using the second metadata from among the predefined metadata; and the first user interface configured to provide, according to the request from the user terminal, the first analysis result data. ### Claim 4 (depends on 1) The data processing system of claim 1, wherein the plurality of data analyzers comprise a data analyzer comprising: the first processor configured to generate the first analysis result data obtained by analyzing the first through third data by using the second metadata from among the predefined metadata; and the first storage configured to store the first analysis result data. ### Claim 5 (depends on 1) The data processing system of claim 1, wherein the plurality of data analyzers comprise a data analyzer comprising: the first processor configured to generate the first analysis result data obtained by analyzing the first through third data by using the second metadata from among the predefined metadata; the first storage configured to store the first analysis result data; and the first user interface configured to provide, according to the request from the user terminal, the first analysis result data stored in the storage. ### Claim 6 (depends on 1) The data processing system of claim 1, wherein the first processor is configured to generate the first analysis result data obtained by analyzing the first through third data by using the second metadata from among the predefined metadata, wherein the first storage is configured to store the first analysis result data, and wherein the first interface is configured to provide, according to the request from the user terminal, the first analysis result data stored in the first storage. ### Claim 7 (depends on 1) The data processing system of claim 1, wherein the plurality of data storage units comprise a data storage unit comprising the second storage stores the first through third data and the first analysis result data. ### Claim 8 (depends on 1) The data processing system of claim 1, wherein the plurality of data storage units comprise a data storage unit comprising: the second storage configured to store the first through third data and the first analysis result data; and the second user interface configured to provide the first through third data and the first analysis result data according to the request from the user terminal. ### Claim 9 (depends on 1) The data processing system of claim 1, wherein the plurality of data storage units comprise a data storage unit comprising: the second storage configured to store the first through third data and the first analysis result data; and the second processor configured to generate the second analysis result data obtained by analyzing the first through third data and the first analysis result by using the third metadata from among the predefined metadata. ### Claim 10 (depends on 1) The data processing system of claim 1, wherein the plurality of data storage units comprise a data storage unit comprising: the second storage configured to store the first through third data and the first analysis result data; the second processor configured to generate the second analysis result data obtained by analyzing the first through third data and the first analysis result data by using the third metadata from among the predefined metadata; and the second user interface configured to provide, according to the request from the user terminal, the second analysis result data. ### Claim 11 (depends on 6) The data processing system of claim 6, wherein the first processor comprises: a distributor configured to distribute data; and at least one of a simultaneous analyzer and a sequential analyzer, wherein the simultaneous analyzer comprises a plurality of different analysis modules from one another, wherein each of the analysis modules receives the data distributed by the distribution module and performs analysis by using metadata predefined in each of the distribution modules, and wherein the sequential analyzer comprises a plurality of different analysis modules from one another, wherein an analysis module that has received data distributed by the distribution module performs analysis by using predefined metadata, and a next analysis module receives a result of the analysis and performs analysis by using predefined metadata and outputs a result of the analysis to another next analysis module. ### Claim 12 (depends on 11) The data processing system of claim 11, wherein the distributor periodically communicates with the analysis module to detect a state of the analysis module, and backs up data to be distributed when the analysis module operates abnormally. ### Claim 13 (depends on 1) The data processing system of claim 1, wherein the distributor periodically communicates with the analysis module to detect a state of the analysis module, and backs up data to be distributed when the analysis module operates abnormally. ### Claim 14 (depends on 1) The data processing system of claim 1, wherein the plurality of storage units are further configured to process stored data and analysis result by structuralizing and arranging the data and the analysis result so that the data and the analysis result are easy to search. ### Claim 15 (depends on 1) The data processing system of claim 1, wherein the first user interface and the second user interface are based on a plurality of user interface models, and are based on at least one of the first through third data, the first analysis result, and the second analysis result. ### Claim 16 (depends on 1) The data processing system of claim 1, wherein the user terminal downloads an application via which the data processing system is accessible. ### Claim 17 (depends on 16) The data processing system of claim 16, wherein the user terminal sets a search condition including predetermined time information to receive the user interface from the consumption means. ### Claim 18 (depends on 17) The data processing system of claim 17, wherein the search condition is transmitted to the plurality of data analyzers or the plurality of storage units via the network, or is directly transmitted to the plurality of data analyzers or the plurality of storage units.