Methods and systems for fast allocation of fragmented caches

A system comprising:

• a processor;
• a non-transitory computer-readable medium storing instructions that when executed by the processor, cause the processor to perform operations including:
• receiving, at a processor, a request for an address to a buffer stored in a magazine associated with the processor, wherein the magazine associated with the processor is configured to store a set of addresses, each address of the set of addresses corresponding to a location of a buffer in memory;
• detecting, in response to the receiving the request for the buffer, that the magazine associated with the processor is empty;
• requesting, in response to detecting that the magazine associated with the processor is empty, additional memory from a depot layer that includes a repository of references to magazines;
• determining that the depot layer cannot satisfy the request for the additional memory;
• executing, by the depot layer, a call to a slab layer, the call to slab layer including the request for the additional memory;
• identifying, by the slab layer, one or more partially-allocated slabs, each partially-allocated slab including a set of buffers, wherein each partially-allocated slab of the one or more partially-allocated slabs includes one or more free buffers can be allocated;
• generating a new magazine;
• storing, in the new magazine, a set of addresses, each address of the set of addresses corresponding to a buffer of a partially-allocated slab of the one or more partially-allocated slabs;
• transferring from the slab layer to the depot layer a reference to the new magazine;
• and
• transferring from the depot layer to the processor, the reference to the new magazine.

A non-transitory computer-readable medium storing instructions that when executed by a processor, cause the processor to perform operations including:

• receiving, at a processor, a request for an address to a buffer stored in a magazine associated with the processor, wherein the magazine associated with the processor is configured to store a set of addresses, each address of the set of addresses corresponding to a location of a buffer in memory;
• detecting, in response to the receiving the request for the buffer, that the magazine associated with the processor is empty;
• requesting, in response to detecting that the magazine associated with the processor is empty, additional memory from a depot layer that includes a repository of references to magazines;
• determining that the depot layer cannot satisfy the request for the additional memory;
• executing, by the depot layer, a call to a slab layer, the call to slab layer including the request for the additional memory;
• identifying, by the slab layer, one or more partially-allocated slabs, each partially-allocated slab including a set of buffers, wherein each partially-allocated slab of the one or more partially-allocated slabs includes one or more free buffers can be allocated;
• generating a new magazine;
• storing, in the new magazine, a set of addresses, each address of the set of addresses corresponding to a buffer of a partially-allocated slab of the one or more partially-allocated slabs;
• transferring from the slab layer to the depot layer a reference to the new magazine;
• and
• transferring from the depot layer to the processor, the reference to the new magazine.