Method and system for managing partitioned data resources

In a computing environment, a method for implementing an association between a first data object and a second data object, the method comprising:

• forming a first association fragment which comprises information relevant to accessing the first data object;
• and
• forming a second association fragment which comprises information relevant to accessing the second data object, wherein:
• the first association fragment and second association fragment cooperate to cause an association to effectively be formed between the first data object and the second data object,
• the first data object and the first association fragment are located in a first partition of storage, and
• the second data object and the second association fragment are located in a second partition of the storage.

A data processing system implemented method managing associations among a plurality of data objects, said plurality of data objects are categorized by data type and associated with data stored in a plurality of location subdivisions based on the data type, the method comprising:

• receiving a first request for a data object associated first data object from a client, said request includes a first data object identifier, wherein said first data object is categorized as being a first data type;
• identifying a first location subdivision for the first data object identifier;
• accessing first fragmented association information corresponding with said first location subdivision, wherein the first fragmented association information includes association information related to data objects stored in said first location subdivision;
• finding, in the first fragmented association information, a data object associated with said first data object based on the first data object identifier;
• and
• returning information related to the data object or objects associated with said first data object to the client.

A data processing system implemented method for managing associations among a plurality of data objects, the method comprising:

• categorizing the plurality of data objects by data type;
• subdividing ones of the data objects of a first data type into a first plurality of subdivisions;
• subdividing ones of the data objects of a second data type into a second plurality of subdivisions;
• storing the ones of the data objects in the first plurality of subdivisions in a respective first plurality of location subdivisions;
• storing the ones of the data objects in the second plurality of subdivisions in a respective second plurality of location subdivisions;
• defining associations between each of the data objects in each of the first plurality of location subdivisions and all of the data objects in each of the second plurality of location subdivisions;
• forming a fragmented association record corresponding with each location subdivision of the first plurality of location subdivisions, wherein each of the fragmented association records comprises association information related to data objects stored in one of the first plurality of location subdivisions;
• defining associations between each of the data objects in each of the second plurality of location subdivisions and all of the data objects in each of the first plurality of location subdivisions;
• and
• forming a fragmented association record corresponding with each location subdivision of the second plurality of location subdivisions, wherein each of the fragmented association records comprises association information related to data objects stored in one of the second plurality of location subdivisions.

A data processing system implemented program product embodied on a processing system readable medium for implementing a method for managing associations among a plurality of data objects, said plurality of data objects are categorized by data type and associated with data stored in a plurality of location subdivisions based on the data type, the program product comprising:

• instructions for receiving a request for a data object associated first data object from a client, said request includes a first data object identifier, wherein said first data object is categorized as being a first data type;
• instructions for identifying a first location subdivision for the first data object identifier;
• instructions for accessing first fragmented association information corresponding with said first location subdivision, wherein the first fragmented association information includes association information related to data objects stored in said first location subdivision;
• instructions for finding, in the first fragmented association information a data object associated with said first data object based on the first data object identifier;
• and
• instructions for returning information related to the data object or objects associated with said first data object to the client.

The program product recited in claim 40, wherein the first data object identifier is a unique primary key (PK) and the instructions for identifying a first location subdivision for the first data object identifier further comprises:

• instructions for implementing a satellite cache service for holding a plurality of primary key (PK)-location subdivision maps, wherein said satellite cache service and said association service are implemented in a local domain;
• instructions for accessing the plurality of primary key (PK)-location subdivision maps held by the satellite cache service;
• and
• instructions for looking up a location subdivision identifier for the first location subdivision in the plurality of PK-location subdivision maps from the satellite cache service based on the unique PK for the first data object.

A data processing system implemented program product embodied on a data processing system readable medium for implementing a method for managing associations among a plurality of data objects, the program product comprising:

• instructions for categorizing a plurality of data objects by data type;
• instructions for subdividing the data objects of a first data type into a first plurality of subdivisions;
• instructions for subdividing the data objects of a second data type into a second plurality of subdivisions;
• instructions for storing the data objects in the first plurality of subdivisions in a respective first plurality of location subdivisions;
• instructions for storing the data objects in the second plurality of subdivisions in a respective second plurality of location subdivisions;
• instructions for defining associations between each of the data objects in each of the first plurality of location subdivisions and all of the data objects in each of the second plurality of location subdivisions;
• instructions for forming a fragmented association record corresponding with each of the location subdivisions of the first plurality of location subdivisions, wherein each of the fragmented association records comprises association information related to ones of the data objects stored in one of the first plurality of location subdivisions;
• instructions for defining associations between each of the data objects in each of the second plurality of location subdivisions and all of the data objects in each of the first plurality of location subdivisions;
• and
• instructions for forming a fragmented association record corresponding with each of the location subdivisions of the second plurality of location subdivisions, wherein each of the fragmented association records comprises association information related to ones of the data objects stored in one of the second plurality of location subdivisions.

A system for managing associations among a plurality of data objects, the system comprising a plurality of network domains, wherein each of the network domains comprises:

• a first data processing system of a plurality of multipurpose data processing systems including a first processor and a first memory for running a first partition service, said first partition service being configured to manage data of a first data type stored locally in said memory;
• a second data processing system of the plurality of multipurpose data processing systems including a processor and a memory for running a second partition service, said second partition service being configured to manage data of a second data type stored locally in said second memory;
• a third data processing system including a processor and a memory for running a satellite service, said satellite service being configured to maintain a plurality of primary key (PK)-partition maps for identifying a partition service managing a data object by a unique PK;
• a fourth data processing system including a processor and a memory for running a first fragmented association engine information corresponding with said first partition service, said first fragmented association engine being configured to manage association information related to data objects managed by said first partition service;
• a fifth data processing system including a processor and a memory for running a second fragmented association engine information corresponding with said second partition service, said second fragmented association engine being configured to manage association information related to data objects managed by said second partition service;
• and
• a sixth data processing system including a processor and a memory for running a steward service, said steward service being configured to manage a plurality of PKs for the first data type.