US 2011/0258187 A1 · Relevance-Based Open Source Intelligence (OSINT) Collection

Abstract

In certain embodiments, a method for relevance-based open source intelligence (OSINT) collection includes accessing a request for information, determining a first data source associated with the request, and accessing a first data set collected from the first data source by a data collection component. The method further includes applying natural language processing to the first data set to generate a processed first data set and determining an aggregate relevance score associated with the first data source. The aggregate relevance is determined by determining a number of individual relevance scores associated with the first data source and aggregating the individual relevance scores. Each individual relevance score is determined based on a comparison of the processed first data set and a corresponding relevance criterion of a number of relevance criteria. The method further includes storing the aggregate relevance score associated with the first data source.

Claims23

Dependent claims

A method for relevance-based open source intelligence (OSINT) collection, comprising:

accessing a request for information;
determining a first web page associated with the request for information;
accessing first web page content collected from the first web page by a web crawler;
applying natural language processing to the first web page content to generate processed first web page content;
determining an aggregate relevance score associated with the first web page by:
determining a plurality of individual relevance scores associated with the first web page, each of the plurality of individual relevance scores being determined based on a comparison of the processed first web page content and a corresponding relevance criterion of a plurality of relevance criteria;
and
aggregating the plurality of individual relevance scores, the aggregate relevance score associated with the first web page being the aggregation of the plurality of individual relevance scores associated with the first web page;
and
storing the aggregate relevance score associated with the first web page.

7 more elements

A method for relevance-based open source intelligence (OSINT) collection, comprising:

accessing a request for information;
determining a first data source associated with the request for information;
accessing a first data set collected from the first data source by a data collection component;
applying natural language processing to the first data set to generate a processed first data set;
determining an aggregate relevance score associated with the first data source by:
determining a plurality of individual relevance scores associated with the first data source, each of the plurality of individual relevance scores being determined based on a comparison of the processed first data set and a corresponding relevance criterion of a plurality of relevance criteria;
and
aggregating the plurality of individual relevance scores, the aggregate relevance score associated with the first data source being the aggregation of the plurality of individual relevance scores associated with the first data source;
and
storing the aggregate relevance score associated with the first data source.

7 more elements

A system for relevance-based open source intelligence (OSINT) collection, comprising:

one or more processing units operable to:
access a request for information;
determine a first data source associated with the request for information;
access a first data set collected from the first data source by a data collection component;
apply natural language processing to the first data set to generate a processed first data set;
determine an aggregate relevance score associated with the first data source by:
determining a plurality of individual relevance scores associated with the first data source, each of the plurality of individual relevance scores being determined based on a comparison of the processed first data set and a corresponding relevance criterion of a plurality of relevance criteria;
and
aggregating the plurality of individual relevance scores, the aggregate relevance score associated with the first data source being the aggregation of the plurality of individual relevance scores associated with the first data source;
and
store the aggregate relevance score associated with the first data source.

8 more elements

Dependencies are inferred from the claim text.

Relevance-Based Open Source Intelligence (OSINT) Collection

Life of this patent

Relevance-Based Open Source Intelligence (OSINT) Collection

Life of this patent

Abstract

Claims23