Back to results
US 8,949,184 B2Granted
Data collector
AssigneeMicrosoft Technology Licensing, LLC
InventorsPatrick Sokolan, Dennis Doherty, Claude Duguay, William Radcliffe, Virgil Bourassa
Life of this patent
Estimating the term…
Abstract
A data collector may monitor a data source and identify updated data, which may be processed and prepared for inclusion into a search database. The data collector may have various handlers that may interact with a data source, which may be a database, web service, file system, collaboration system, or other source, and may store a identifying signature and content signature for each document or item. The signatures may be used to identify new, changed, or deleted items, and a payload may be created containing the updates.
Claims20
A system comprising:
- a processor;
- a data source monitor operating on said processor that communicates with a data source to retrieve documents within said data source;
- a state generator that stores a first state for each of said documents;
- a key generator that identifies a Uniform Resource Identifier for each of said documents and generates a hash of each of said Uniform Resource Identifiers to create a document identifier for each of said documents;
- a signature generator that generates a signature for each of said documents;
- a database comprising said first state and said document identifier for each of said documents;
- a document analyzer that:
- identifies a first document from said documents as being a changed document;
- and
- analyzes said first document to identify one or more types of content within said first document;
- and
- a communications engine that:
- creates a transmission package comprising at least one of the one or more types of said content and said document identifier for said document in response to said first document being analyzed to identify the one or more types of said content within said first document;
- and
- transmits said transmission package to a data consumer.
12 more elements
A method performed on a computer processor, said method comprising:
- monitoring a data source comprising a collection of documents;
- determining a first collection state comprising a state for each of said documents;
- storing said first collection state in a state database;
- for each of said documents:
- identifying a document identifier from a Uniform Resource Identifier;
- generating a document state from said document;
- looking up said document identifier and said document state in said state database to identify changed documents from said documents;
- for each of said changed documents:
- identifying one or more types of content within said changed document;
- creating a transmission package comprising at least one of the one or more types of said content and said document identifier for said changed document in response to identifying the one or more types of said content within said changed document;
- and
- transmitting said transmission package to a data consumer.
9 more elements
A system comprising:
- a processor;
- a data source monitor operating on said processor that communicates with a data source to retrieve documents within said data source, said data source comprising a collection of documents;
- a key generator that identifies a Uniform Resource Identifier for each of said documents and generates a hash of each of said Uniform Resource Identifiers to create a document identifier for each of said documents;
- a state database comprising a state and said document identifier for each of said documents, and further comprising a collection state;
- a state generator that:
- determines a first state for each of said documents to create a state collection, said first state comprising a signature;
- and
- stores said state collection in said state database;
- a document analyzer that:
- receives a set of changed documents from said documents;
- and
- for each of said changed documents in said set of changed documents, analyzes said changed document to identify one or more types of content within said changed document;
- and
- a communications engine that:
- creates a transmission package comprising at least one of the one or more types of said content and said document identifier for each of said changed documents in response to said changed document being analyzed to identify the one or more types of said content within said changed document;
- and
- transmits said transmission package to a data consumer.
14 more elements
Dependencies are inferred from the claim text.