Circuits, methods, and articles of manufacture for hyper-dimensional computing systems and related applications

A method of operating a trained machine learning model, the method comprising:

• providing a trained hyperdimensional machine learning model that includes a plurality of trained hypervector classes, wherein each of the trained hypervector classes includes N elements;
• eliminating selected ones of the N elements from the trained hypervector classes based on whether a selected element of the N elements is equal to zero or about equal to zero to provide one or more pruned trained hypervector classes included in a pruned hyperdimensional machine learning model;
• quantizing a query hypervector received for an inference operation using the pruned hyperdimensional machine learning model to provide a quantized query hypervector;
• and
• determining a similarity between the quantized query hypervector and the one or more pruned trained hypervector classes to perform the inference operation.

A method of providing recommendations on items for use by users, the method comprising:

• generating a user characterization hypervector for each user of a system to which recommendations for items are made wherein each user characterization hypervector combines a rating hypervector that encodes a respective rating given by the user for each item rated by the user with a hypervector for each item rated by the user;
• generating an item characterization hypervector for each of the items for which the recommendations are made to the users wherein each item characterization hypervector combines a hypervector for each rating given a respective user on the item with a user hypervector that encodes the respective user that provided the rating;
• and
• determining a prediction that a target user will give to a potential recommended item that has not been used by the target user based on a similarity between the user characterization hypervector for the target user and the item characterization hypervector for the potential recommended item.

A method of operating a hyper-dimensional machine learning model, the method comprising:

• encoding a feature vector representing non-binary data by quantizing the feature vector to select a base hypervector to be combined with a respective ID hypervector representing a position of data included in the feature vector to provide a non-binary query hypervector;
• applying a threshold to each dimension of the non-binary query hypervector to provide a binary query hypervector;
• training the hyper-dimensional machine learning model using the binary query hypervector as training data where the hyper-dimensional machine learning model is initialized to include N hypervectors in each of K classes in the model;
• identifying which of the K classes includes the binary query hypervector to provide a selected class for the binary query hypervector;
• and then
• checking similarity between the binary query hypervector and the N hypervectors included in the selected class to provide an identified N hypervector within the class that is most similar to the binary query hypervector;
• and
• updating the hyper-dimensional machine learning model by performing a bit-wise substitution to replace data located at a sub-set of indices in the identified N hypervector with data from a corresponding sub-set of indices in the binary query hypervector.

A method of operating a machine learning model, the method comprising:

• training a hyperdimensional machine learning model by determining a cosine similarity between training data hypervectors and K initial class hypervectors to provide K trained class hypervectors;
• normalizing the K trained class hypervectors to provide K normalized initial class hypervectors;
• determining a dot product between a query hypervector and the K normalized initial class hypervectors to determine a closest similarity among the K normalized initial class hypervectors and the query hypervector;
• grouping similar ones of the K normalized initial class hypervectors into M-sized groups to provide a K/M sized category stage and a K sized main stage for an associative search and associating each entry in the K/M sized category stage with an entry in the K sized main stage to provide a multi-stage hyperdimensional machine learning model;
• quantizing each dimension of elements of the K normalized initial class hypervectors using a combination of two powers of two to provide a quantized multi-stage hyperdimensional machine learning model;
• and
• applying a validation data set to the quantized multi-stage hyperdimensional machine learning model to provide an error corrected quantized multi-stage hyperdimensional machine learning model.

A system configured to control operations of programmable logic circuits, the system comprising:

• a plurality of programmable logic circuits each configured to process a respective portion of a workload assigned to the plurality of programmable logic circuits;
• a central controller circuit included in at least one of the plurality of programmable logic circuits, the central controller circuit configured to control respective operating frequencies and voltage levels provided to each of the plurality of programmable logic circuits to process the respective portion of the workload, the central controller circuit further comprising:
• a workload counter circuit configured to determine the respective portion of the workload assigned to the at least one of the plurality of programmable logic circuits that includes the central controller circuit during a current time interval to provide a workload count;
• a workload prediction model circuit coupled to the workload counter circuit, the workload prediction model circuit configured to identify the respective operating frequencies and voltage levels for a future time interval based on a prediction of the workload that will be assigned to the plurality of programmable logic circuits in the future time interval;
• and
• a misprediction circuit coupled to the workload counter circuit and to the workload prediction model circuit, the misprediction circuit configured to adjust a model for the workload prediction model circuit based on an error detected between the prediction of the workload prediction model circuit and the workload count.

A system configured to process data, the system comprising:

• a plurality of ReRAM memory blocks, wherein each memory block is configured to couple accessed data to an array of bitlines to perform logical operations on the accessed data within the array of bitlines to provide output data from the respective memory block;
• a data lane that couples the output data from each of the plurality of ReRAM memory blocks together;
• an accumulator circuit, coupled to the data lane, that is configured to output a stochastic representation of the output data received from the plurality of ReRAM memory blocks;
• and
• a bitline segmentation switch that extends across the bitlines and is configured segment each of the memory blocks into smaller memory blocks when deactivated, wherein a gate of the bitline segmentation switch extends into a substrate of the ReRAM memory blocks between adjacent wordlines to switchably couple the bitlines together.