Storing and obtaining attribute data of attributes of machine learning models

A system comprising:

• an inference cache;
• a memory associated with the inference cache;
• and
• a controller, associated with the inference cache, the controller to:
• store first attribute data, regarding first attributes of a first machine learning model, in the memory,
• wherein the first machine learning model is a first trained machine learning model;
• store second attribute data, regarding second attributes of a second machine learning model, in the memory,
• wherein the second machine learning model is a second trained machine learning model;
• obtain, from the memory, one of the first attribute data or the second attribute data based on a request to generate an inference,
• wherein a location of the one of the first attribute data or the second attribute data, in the memory, is determined using the inference cache;
• and
• utilize the one of the first attribute data or the second attribute data to generate the inference.

A computer program product comprising:

• one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions comprising:
• program instructions to store addresses of first attribute data, regarding first attributes of a first trained machine learning model, in an inference cache;
• program instructions to store addresses of second attribute data, regarding second attributes of a second trained machine learning model, in the inference cache;
• and
• program instructions to obtain, from a memory associated with the inference cache, one of the first attribute data or the second attribute data based on a request to generate an inference,
• wherein the one of the first attribute data or the second attribute data is obtained using the addresses of the first attribute data or the addresses of the second attribute data.