US 9,430,547 B2Granted

Implementation of clustered in-memory database

AssigneeQbase, LLC

InventorsScott Lightner, Franz Weckesser, Telford Berkey, Joseph Becknell, Bryan Zimmerman, Mats Persson

Life of this patent

Estimating the term…

Loading patent…

Abstract

An in-memory database system and method for administrating a distributed in-memory database, comprising one or more nodes having modules configured to store and distribute database partitions of collections partitioned by a partitioner associated with a search conductor. Database collections are partitioned according to a schema. Partitions, collections, and records, are updated and removed when requested by a system interface, according to the schema. Supervisors determine a node status based on a heartbeat signal received from each node. Users can send queries through a system interface to search managers. Search managers apply a field processing technique, forward the search query to search conductors, and return a set of result records to the analytics agents. Analytics agents perform analytics processing on a candidate results records from a search manager. The search conductors comprising partitioners associated with a collection, search and score the records in a partition, then return a set of candidate result records after receiving a search query from a search manager.

Claims30

Dependent claims

A computing system hosting an in-memory database, the system comprising:

a partitioner node comprising a processor configured to, in response to receiving a collection of one or more records of the in-memory database, determine whether to compress the collection based on a machine-readable schema file associated with the collection, logically partition the collection into one or more partitions according to the schema file, and distribute the one or more partitions to one or more storage nodes according to the schema file;
a storage node comprising a non-transitory machine-readable main memory storing a partition of the in-memory database received from one or more partitioner nodes associated with the storage node according to the schema file;
a search manager node comprising a processor configured to receive a search query from a client device of the system, and transmit the search queries as search conductor queries to one or more search conductors upon receiving the search query from the client device, wherein the search query is a machine-readable computer file containing parameters associated with one or more records satisfying the search query, and wherein the search manager node transmits the search queries to the one or more search conductors in accordance with the schema file;
a search conductor node associated with one or more partitioners according to the schema file and comprising a processor configured to, in response to receiving a search conductor query from the search manager node:
query a set of one or more partitions of the in-memory database as indicated by the search conductor query, identify one or more candidate records of the in-memory database stored in the set of partitions queried by the search conductor, calculate a first score for each respective candidate record using a scoring algorithm, and transmit to the search manager node a set of one or more query results containing one or more candidate records satisfying a threshold value;
and
an analytics agent node comprising a processor configured to automatically generate a machine-readable computer file containing a set of one or more results derived from the set of query results, responsive to identifying in the set of query results received from the search manager node,
wherein each of the storage node, the search conductor node, and the analytics agent node is a distinct node.

5 more elements

A computer implemented method comprising:

receiving, by a search manager computer of a system hosting an in-memory database, binary data representing a search query containing parameters for querying the in-memory database, wherein the system comprises one or more storage nodes comprising a main memory storing one or more collections of the in-memory database, and wherein each collection contains one or more records of the in-memory database;
transmitting, by the computer, the search query to one or more search conductor nodes according to the search query, wherein the search query indicates a set of one or more collections of the in-memory database to be queried;
transmitting, by the computer, to one or more analytics agent nodes a set of search results based on the search query upon receiving from the one or more search conductors the set of search results containing one or more records of the in-memory database satisfying the search query, wherein each respective record of the set of search results is associated with a score that is based on a scoring algorithm indicated in the search query;
and
responsive to the computer receiving a computer file containing a set of one or more data linkages from the one or more analytics agent nodes:
updating, by the computer, the one or more records of the set of search results according to the set of one or more data linkages received from the one or more analytics agent nodes,
wherein each of the one or more storage nodes, the one or more search conductors, and the one or more analytics agent nodes is a distinct node.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 14/558,254Filed 2 Dec 2014 · us provisional application
Priority: 2 Dec 2013
Published: US 2015/0154200 A14 Jun 2015
Granted: 30 Aug 2016
Term ends: Not estimatedThe source records don’t support an estimate.

Classification7 codes

G06F 16/285
Relational databases: clustering or classification
G06F 16/13
File systems; File servers: file access structures, e.g. distributed indices
G06F 16/164
File or folder operations, e.g. details of user interfaces specifically adapted to file systems: file meta data generation
G06F 16/235
Updating: update request formulation