Method and apparatus for improving the performance of a database management system through a central cache mechanism

A method of organizing a multicache system within a primary memory of a host system for improving the performance of a number of processes running on the host system in processing complex database query statements, the multicache system including a plurality of local caches in main memory corresponding to the number of processes being run on the host system, each local cache being associated with a different one of the processes being run, the method comprising the steps of:

• (a) configuring at least one configured central cache system in a predefined area of primary memory shared by the processes, the central cache system being operatively coupled to each of the plurality of local cache systems associated therewith;
• (b) including in the central cache system, a number of shared control structures used for controlling access thereto;
• (c) including in the central cache system, a number of sets of central cache control structures corresponding to the number of central caches configured for storing code segments;
• and,
• (d) including in the central cache system, a control mechanism operatively coupled to the number of shared control structures and to the number of sets of central cache structures, the control mechanism being operative to control the configuration and operation of each of the configured central caches so that generated code segments produced by any one of the processes for executing a complex database query statement are stored automatically in the local cache associated with the process and in the central cache associated therewith for use by other processes configured to be associated with the same central cache in processing logically equivalent complex database query statements.

A computer main memory containing a number of segments for storing data and control structures for improving the performance of a number of processes on a host system in processing complex database query statements, the data and control structures comprising:

• (a) a plurality of local caches in a corresponding number of main memory segments corresponding to the number of processes being run on the host system, each local cache being associated with a different one of the processes being run;
• and
• (b) at least one configured central cache system located in a predefined area of another one of the segments of main memory shared by the processes, the central cache system being operatively coupled to each of the plurality of local cache systems associated therewith, said central cache system including:
• a number of shared control structures used for controlling access to the central cache system;
• and,
• a number of sets of central cache control structures corresponding to the number of central caches configured for storing code segments;
• the sets of central cache structures enabling configuration and operation of each of the central caches so that generated code segments produced by any one of the processes for executing a complex database query statement are stored automatically in the local cache associated with the process and in the central cache configured to be associated therewith for use by other processes associated with the same central cache in processing logically equivalent complex database query statements.

A multicache system configurable within a primary memory of a host system for improving the performance of a number of processes running on the host system in processing complex database query statements, the multicache system comprising:

• (a) a plurality of local caches in main memory corresponding to the number of processes being run on the host system, each local cache being associated with a different one of the processes being run;
• and
• (b) at least one configured central cache system located in a shared predefined area of primary memory, the central cache system being operatively coupled to each of the plurality of local cache systems associated therewith, said central cache system including:
• a number of shared control structures used for controlling access to the central cache system;
• a number of sets of central cache control structures corresponding to the number of central caches configured for storing code segments;
• and,
• a control mechanism operatively coupled to the number of shared control structures and to the number of sets of central cache structures, the control mechanism being operative to control the configuration and operation of each of the central caches so that generated code segments produced by any one of the processes for executing a complex database query statement are automatically stored in the local cache associated with the process and in the configured central cache associated therewith for use by other processes associated with the same central cache in processing logically equivalent complex database query statements;
• (c) a number of interfaces which operatively couple to the central cache system for configuring and operating the number of central caches;
• and,
• (d) a cache utility program component operatively coupled to receive utility directives entered into the system by a user and operatively coupled to the central cache system, the cache utility program component being operatively coupled to a first one of the number of interfaces, the cache utility program component in response to the user initiated directives being operative to issue utility functions for invoking the control mechanism to perform a sequence of operations for carrying out the specified functions.

A multicache system configurable within a primary memory of a host system for improving the performance of a number of processes running on the host system in processing complex database query statements, the multicache system comprising:

• (a) a plurality of local caches in main memory corresponding to the number of processes being run on the host system, each local cache being associated with a different one of the processes being run;
• and
• (b) at least one configured central cache system located in a shared predefined area of primary memory, the central cache system being operatively coupled to each of the plurality of local cache systems associated therewith, said central cache system including:
• a number of shared control structures used for controlling access to the central cache system;
• a number of sets of central cache control structures corresponding to the number of central caches configured for storing code segments;
• and,
• a control mechanism operatively coupled to the number of shared control structures and to the number of sets of central cache structures, the control mechanism being operative to control the configuration and operation of each of the central caches so that generated code segments produced by any one of the processes for executing a complex database query statement are automatically stored in the local cache associated with the process and in the configured central cache associated therewith for use by other processes associated with the same central cache in processing logically equivalent complex database query statements;
• (c) a number of interfaces which operatively couple to the cell cache system for configuring and operating the number of central caches;
• and,
• (d) a configuration file for storing user entered configuration parameters defining the characteristics of the central caches to be configured, the number of interfaces includes a second interface operatively coupled to the configuration file and to the central cache system, the second interface being operative when a process is put in execution to invoke the control mechanism for storing parameter information in specific ones of the shared control structures and into a specified one of the number of sets of central cache control structures derived from the configuration file.

A multicache system configurable within a primary memory of a host system for improving the performance of a number of processes running on the host system in processing complex database query statements, the multicache system comprising:

• (a) a plurality of local caches in main memory corresponding to the number of processes being run on the host system, each local cache being associated with a different one of the processes being run;
• and
• (b) at least one configured central cache system located in a shared predefined area of primary memory, the central cache system being operatively coupled to each of the plurality of local cache systems associated therewith, sad central cache system including:
• a number of shared control structures used for controlling access to the central cache system;
• a number of sets of central cache control structures corresponding to the number of central caches configured for storing code segments;
• and,
• a control mechanism operatively coupled to the number of shared control structures and to the number of sets of central cache structures, the control mechanism being operative to control the configuration and operation of each of the central caches so that generated code segments produced by any one of the processes for executing a complex database query statement are automatically stored in the local cache associated with the process and in the configured central cache associated therewith for use by other processes associated with the same central cache in processing logically equivalent complex database query statements;
• and,
• (c) a number of interfaces which operatively couple to the central cache system for configuring and operating the number of central caches;
• the number of interfaces including a fourth interface operatively coupled to receive command calls from processes running on the host system, the fourth interface being operatively coupled to the central cache system and operative in response to the command calls to invoke the control mechanism for carrying out operations specified by the command calls, the command calls including a generate central report command call used for generating statistics for the central cache system and a reset central statistics command call used for resetting statistics for the central cache system.

A multicache system configurable within a primary memory of a host system for improving the performance of a number of processes running on the host system in processing complex database query statements, the multicache system comprising:

• (a) a plurality of local caches in main memory corresponding to the number of processes being run on the host system, each local cache being associated with a different one of the processes being run;
• and
• (b) at least one configured central cache system located in a shared predefined area of primary memory, the central cache system being operatively coupled to each of the plurality of local cache systems associated therewith, said central cache system including:
• a number of shared control structures used for controlling access to the central cache system;
• a number of sets of central cache control structures corresponding to the number of central caches configured for storing code segments;
• and,
• a control mechanism operatively coupled to the number of stared control structures and to the number of sets of central cache structures, the control mechanism being operative to control the configuration and operation of each of the central caches so that generated code segments produced by any one of the processes for executing a complex database query statement are automatically stored in the local cache associated with the process and in the configured central cache associated therewith for use by other processes associated with the same central cache in processing logically equivalent complex database query statements;
• and,
• a persistent memory segment for storing the shared control structures, the memory including a number of memory sections, each section being associated with a different configured central cache and each section including first descriptor values for identifying one of the shared control structures corresponding to a directory control store structure and a set of descriptors for identifying one of the number of sets of central cache structures defining those components required for operating the configured central cache associated therewith, the persistent memory segment further including a separate section for storing a number of pairs of descriptors sequentially allocated to each configured central cache during the configuration thereof, each allocated pair of descriptors providing information to straggling processes pertaining to the central caches associated therewith for enabling the processes to detect that a central cache has been deleted from the central cache system.

A method of organizing a multicache system within a primary memory of a host system for improving the performance of a number of processes running on the host system in processing complex database query statements, the multicache system including a plurality of local caches in main memory corresponding to the number of processes being run on the host system, each local cache being associated with a different one of the processes being run, the method comprising the steps of:

• (a) configuring at least one central cache system in a shared predefined area of primary memory, the central cache system being operatively coupled to each of the plurality of local cache systems associated therewith;
• (b) including in the central cache system, a number of shared control structures used for controlling access thereto;
• (c) including in the central cache system, a number of sets of central cache control structures corresponding to the number of central caches configured for storing code segments;
• (d) including in the central cache system, a control mechanism operatively coupled to the number of shared control structures and to the number of sets of central cache structures, the control mechanism being operative to control the configuration and operation of each of the central caches so that generated code segments produced by any one of the processes for executing a complex database query statement are automatically stored in the local cache associated with the process and in the configured central cache associated therewith for use by other processes associated with the same central cache in processing logically equivalent complex database query statements;
• (e) including in the host system, a number of interfaces that operatively couple to the central cache system for configuring and operating the number of central caches;
• (f) including a cache utility program component operatively coupled to receive utility directives entered into the system by a user and operatively coupled to the control central cache system;
• operatively coupling the cache utility program component to a first one of the number of interfaces;
• and,
• (g) issuing utility functions by the cache utility program component in response to the user initiated directives for invoking the control mechanism to perform a sequence of operations for carrying out the specified functions.

A method of organizing a multicache system within a primary memory of a host system for improving the performance of a number of processes running on the host system in processing complex database query statements, the multicache system including a plurality of local caches in main memory corresponding to the number of processes being run on the host system, each local cache being associated with a different one of the processes being run, the method comprising the steps of:

• (a) configuring at least one configured central cache system in a shared predefined area of primary memory, the central cache system being operatively coupled to each of the plurality of local cache systems associated therewith;
• (b) including in the central cache system, a number of shared control structures used for controlling access thereto;
• (c) including in the central cache system, a number of sets of central cache control structures corresponding to the number of central caches configured for storing code segments;
• (d) including in the central cache system, a control mechanism operatively coupled to the number of shared control structures and to the number of sets of central cache structures, the control mechanism being operative to control the configuration and operation of each of the central caches so that generated code segments produced by any one of the processes for executing a complex database query statement are automatically stored in the local cache associated with the process and in the configured central cache associated therewith for use by other processes associated with the same central cache in processing logically equivalent complex database query statements
• (e) including in the host system a number of interfaces that operatively couple to the central cache system for configuring and operating the number of central caches, the host system including a configuration file for storing user entered configuration parameters defining the characteristics of the central caches to be configured and a second one of the interfaces being operatively coupled to the configuration file;
• and,
• (f) invoking the control mechanism by the second interface when a process is put in execution for storing parameter information in specific ones of the shared control structures and into a specified one of the number of sets of central cache control structures derived from the configuration file.

A method of organizing a multicache system within a primary memory of a host system for improving the performance of a number of processes running on the host system in processing complex database query statements, the multicache system including a plurality of local caches in main memory corresponding to the number of processes being run on the host system, each local cache being associated with a different one of the processes being run, the method comprising the steps of:

• (a) configuring at least one configured central cache system in a shared predefined area of primary memory, the central cache system being operatively coupled to each of the plurality of local cache systems associated therewith;
• (b) including in the central cache system, a number of shared control structures used for controlling access thereto;
• (c) including in the central cache system, a number of sets of central cache control structures corresponding to the number of central caches configured for storing code segments;
• (d) including in the central cache system, a control mechanism operatively coupled to the number of shared control structures and to the number of sets of central cache structures, the control mechanism being operative to control the configuration and operation of each of the central caches so that generated code segments produced by any one of the processes for executing a complex database query statement are automatically stored in the local cache associated with the process and in the configured central cache associated therewith for use by other processes associated with the same central cache in processing logically equivalent complex database query statements;
• (e) utilizing a persistent memory segment in the central cache system for storing the shared control structures, the memory segment including a number of memory sections, each section being associated with a different configured central cache and each including first descriptor values for identifying one of the shared structures corresponding to a directory control store structure and a set of descriptors for identifying one of the number of sets of central cache structures defining those components required for operating the configured central cache associated therewith;
• and,
• (f) utilizing a separate section for storing a number of pairs of descriptors sequentially allocated to each configured central cache during the configuration thereof, each allocated pair of descriptors providing information to straggling processes pertaining to the central caches associated therewith for enabling the processes to detect that a central cache has been deleted from the central cache system.