Memory cache entry management with pinned cache entries

A system comprising:

• a memory device;
• and
• a processing device coupled to the memory device, the processing device to perform operations comprising:
• maintaining a plurality of data structures configured to track a state of entries of a memory cache, wherein a first data structure of the plurality of data structures comprises identifiers for pinned entries of a memory cache, a second data structure of the plurality of data structures comprises identifiers for unpinned entries of the memory cache that have been accessed once, and a third data structure of the plurality of data structures comprises identifiers for unpinned entries of the memory cache that have been accessed more than once;
• receiving a request to pin an entry;
• determining that an identifier associated with the entry to pin is included in the second data structure or the third data structure;
• adding the identifier associated with the pinned entry to the first data structure;
• detecting, at a time period, that one or more entries of the memory cache are to be removed from the memory cache in accordance with an eviction protocol;
• selecting, of at least one of the second data structure or the third data structure, one or more identifiers of one or more unpinned entries with state data that satisfies an eviction criterion associated with the eviction protocol, wherein the state data of the one or more unpinned entries corresponds to state data of the pinned entry;
• and
• removing the one or more unpinned entries from the memory cache while maintaining the pinned entry in the memory cache.

A non-transitory computer readable storage medium comprising instructions for a server that, when executed by a processing device, cause the processing device to perform operations comprising:

• maintaining a plurality of data structures configured to track a state of entries of a memory cache, wherein a first data structure of the plurality of data structures comprises identifiers for pinned entries of a memory cache, a second data structure of the plurality of data structures comprises identifiers for unpinned entries of the memory cache that have been accessed once, and a third data structure of the plurality of data structures comprises identifiers for unpinned entries of the memory cache that have been accessed more than once;
• receiving a request to pin an entry;
• determining that an identifier associated with the entry to pin is included in the second data structure or the third data structure;
• adding the identifier associated with the pinned entry to the first data structure;
• detecting, at a time period, that one or more entries of the memory cache are to be removed from the memory cache in accordance with an eviction protocol;
• selecting, of at least one of the second data structure or the third data structure, one or more identifiers of one or more unpinned entries with state data that satisfies an eviction criterion associated with the eviction protocol, wherein the state data of the one or more unpinned entries corresponds to state data of the pinned entry;
• and
• removing the one or more unpinned entries from the memory cache while maintaining the pinned entry in the memory cache.