Similarity matching using compute-in-memory

A method comprising:

• storing a plurality of embedding vectors in memory circuitry;
• receiving, by similarity circuitry, a search vector;
• determining, by the similarity circuitry, similarities between the search vector and the plurality of embedding vectors;
• identifying one or more matched embedding vectors based on the similarities;
• and
• outputting information corresponding to the one or more matched embedding vectors.

A memory system, comprising:

• a plurality of memory banks comprising read ports and configured to store a plurality of embedding vectors;
• and
• similarity circuitry disposed at the read ports of the plurality of memory banks, the similarity circuitry configured to:
• receive a search vector;
• for at least a subset of the plurality of memory banks, determine one or more similarities between the search vector and one or more embedding vectors read from a read port of that memory bank;
• based on the one or more determined similarities, identify one or more matched embedding vectors;
• and
• output, from the memory system, information corresponding to the one or more matched embedding vectors.