Bi-directional low-rank adaptation for machine unlearning and information retention

An apparatus, comprising:

• one or more network interfaces;
• a processor coupled to the one or more network interfaces and configured to execute one or more processes;
• and
• a memory configured to store a process that is executable by the processor, the process when executed configured to:
• identify specific knowledge to be unlearned in a machine learning model;
• identify layers of the machine learning model that are responsible for the specific knowledge to be unlearned;
• apply a low rank adaptation unlearning component to each of the layers of the machine learning model that are responsible for the specific knowledge to be unlearned;
• and
• apply a low rank adaptation retention component to layers of the machine learning model that are not responsible for the specific knowledge to be unlearned.

A tangible, non-transitory, computer-readable medium storing program instructions that cause a device to execute a process comprising:

• identifying specific knowledge to be unlearned in a machine learning model;
• identifying layers of the machine learning model that are responsible for the specific knowledge to be unlearned;
• applying a low rank adaptation unlearning component to each of the layers of the machine learning model that are responsible for the specific knowledge to be unlearned;
• and
• applying a low rank adaptation retention component to layers of the machine learning model that are not responsible for the specific knowledge to be unlearned.