Affinitizing datasets based on efficient query processing

One or more computer-storage media having computer-executable instructions embodied thereon that, when executed, perform a method of affinitizing datasets based on efficient query processing, the method comprising:

• receiving a plurality of datasets within a data stream;
• partitioning the data stream;
• determining a first dataset and a second dataset of the plurality of datasets are related to one another based on partitioning the data stream;
• assigning a first affinity identifier to the first dataset and a second affinity identifier to the second dataset based on determining the first dataset and the second dataset are related to one another;
• breaking the first dataset and the second dataset into a plurality of extents, each extent of the plurality of extents having an affinity identifier of the dataset from which it originated;
• and
• storing a portion of the plurality of extents across a plurality of distributed computing devices, wherein extents that share an affinity identifier are stored on computing devices that are in close proximity to one another by identifying a location of a first extent having the common affinity identifier and placing a second extent having the common affinity identifier as close to the location of the first extent as possible given availability within the data center at the time of storing the second extent.

One or more computer-storage media having computer-executable instructions embodied thereon that, when executed, perform a method of affinitizing datasets based on efficient query processing, the method comprising:

• receiving a first plurality of datasets within a first data stream;
• receiving a second plurality of datasets within a second data stream;
• partitioning the first data stream;
• partitioning the second data stream to match the partitioning of the first data stream;
• determining a first dataset of the first plurality of datasets and a second dataset of the second plurality of datasets are related to one another based on the partitioning of the first data stream matching the partitioning of the second data stream;
• assigning a common affinity identifier to the first dataset and the second dataset based on determining the first dataset and the second dataset are related to one another;
• breaking the first dataset and the second dataset into a plurality of extents, each extent of the plurality of extents having the common affinity identifier of the dataset from which it originated;
• and
• storing a portion of the plurality of extents across a plurality of distributed computing devices at a data center, wherein extents having the common affinity identifier are stored on computing devices located within the data center as close to each other as possible given availability within the data center at the time of storing the extents having the common affinity identifier.