Systems and methods for scaling artificial intelligence memories
AssigneeBlumira Inc.
InventorMatthew Warner
Life of this patent
Estimating the term…
Abstract
The present disclosure pertains to systems and methods for scaling artificial intelligence (AI) memories, addressing storage and relevancy in generative AI frameworks. The described aspects involve an approach for memory management where event summaries and contextual metadata are stored and memories are compressed to conserve storage space while retaining significant information. Various other methods and systems are also disclosed.
Claims20
A computer-implemented method comprising:
- storing, within a storage subsystem of a generative artificial intelligence system, structured memory representation comprising vectorized and semantic event data, wherein the memory of the event comprises a summary of the event and context associated with the event;
- determining that the memory has decreased in importance for use in responding to prompts provided to the generative artificial intelligence system;
- in response to the determination that the memory has decreased in importance, compressing the memory such that the compressed memory uses less storage space in the storage subsystem than an uncompressed memory of the event;
- replacing the uncompressed memory with the compressed memory in the storage subsystem;
- and
- using the compressed memory to respond to a prompt provided to the generative artificial intelligence system.
A system comprising:
- one or more physical processors;
- physical memory comprising computer-executable instructions that, when executed by the one or more physical processors, cause the one or more physical processors to:
- store, within a storage subsystem of a generative artificial intelligence system, memory of an event, wherein the memory of the event comprises a summary of the event and context associated with the event, and
- determine that the memory has decreased in importance for use in responding to prompts provided to a generative artificial intelligence system,
- in response to the determination that the memory has decreased in importance, compress the memory such that the compressed memory uses less storage space in the storage subsystem than an uncompressed memory of the event, and
- replace the uncompressed memory with the compressed memory in the storage subsystem;
- and
- use the compressed memory to respond to a prompt provided to the generative artificial intelligence system.
A non-transitory computer-readable medium comprising computer-executable instructions that, when executed by one or more physical processors of a computing device, cause the computing device to:
- store, within a storage subsystem of a generative artificial intelligence system, memory of an event, wherein the memory of the event comprises a summary of the event and context associated with the event, and
- determine that the memory has decreased in importance for use in responding to prompts provided to a generative artificial intelligence system,
- in response to the determination that the memory has decreased in importance, compress the memory such that the compressed memory uses less storage space in the storage subsystem than an uncompressed memory of the event, and
- replace the uncompressed memory with the compressed memory in the storage subsystem;
- and
- use the compressed memory to respond to a prompt provided to the generative artificial intelligence system.
Dependencies are inferred from the claim text.