# US 11,928,146 B2 · Perpetual system for capturing, curating, preserving, storing, positioning, reliving, and sharing memories

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,928,146 B2
- Document ID: US11928146B2
- Status: Granted
- Kind: B2
- Application number: 17/477,897
- Filed: 2021-09-17
- Published: 2022-03-17
- Granted: 2024-03-12
- Earliest claimed: 2020-09-17
- Assignees: Memorythium Corporation
- Applicants: Memorythium Corporation
- Inventors: Geoff Evans
- Web page: https://patentgrep.com/patent/US11928146B2

## CPC

- G06F 16/45: Clustering; Classification
- G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G06N 20/00: Machine learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Techniques for maintaining and curating memories stored as data objects are described. A computing device receives a data object. The computing device analyzes, using a model, the data object to determine one or more classifications for the data object. The computing device stores the data object and the one or more classifications for the data object in a storage component of the computing device.

## Claims

### Claim 1

A method comprising:
receiving, by one or more processors of a computing device, a first data object;
analyzing, by the one or more processors and using a model, the first data object to determine one or more classifications for the first data object;
storing, by the one or more processors, the first data object and the one or more classifications for the first data object in a storage component of the computing device along with a plurality of data objects;
defining, by the one or more processors, one or more privacy settings for the first data object, the one or more privacy settings defining access for one or more other users of a social platform over which the first data object is shared with the one or more other users;
generating, by the one or more processors, a graphical environment comprising at least the first data object of the plurality of data objects and the one or more privacy settings for the first data object;
sending, by the one or more processors, the graphical environment to a server device of the social platform with the one or more privacy settings for the graphical environment;
generating, by the one or more processors and based on the model, an artificial intelligence profile comprising one or more of vocal characteristics of the user, relationships for the user, personal information for the user, likes for the user, dislikes for the user, visual characteristics for the user, experiences of the user, and any other defining characteristic for the user;
generating, by the one or more processors, a computerized avatar that acts in accordance with the artificial intelligence profile; and
including, by the one or more processors, the computerized avatar in the graphical environment.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first data object comprises one or more of a video object, a picture object, a text object, and an audio object.

### Claim 3 (depends on 1)

The method of claim 1, wherein receiving the first data object comprises one or more of:
retrieving the first data object from a database associated with a social media platform;
receiving the first data object sent from a media capture device;
receiving the first data object from a secondary computing device via a wired transmission or a wireless transmission; and
receiving a transmission including the first data object from a secondary storage device.

### Claim 4 (depends on 1)

The method of claim 1, wherein receiving the first data object comprises:
determining, based on one or more privacy settings, that a user has granted permission for the first data object to be received by the computing device; and
in response to determining that the user has granted permission for the first data object to be received by the computing device, receiving the first data object.

### Claim 5 (depends on 1)

The method claim 1, wherein the model comprises a machine learning model, and wherein analyzing the first data object comprises analyzing, by the one or more processors and using the machine learning model, one or more of content of the first data object and metadata for the first data object to determine the one or more classifications for the first data object.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
receiving, by the one or more processors, the machine learning model from a server device that trains the machine learning model using data objects received from each of a plurality of computing devices.

### Claim 7 (depends on 5)

The method of claim 5, further comprising one or more of:
receiving, by the one or more processors, training data from a server device and updating, by the one or more processors, the machine learning model based on the training data; and
receiving, by the one or more processors, personal data collected by a third-party internet service and updating, by the one or more processors, the machine learning model based on the personal data.

### Claim 8 (depends on 5)

The method of claim 5, further comprising:
outputting, by the one or more processors, the one or more classifications for the first data object;
receiving, by the one or more processors, an indication of first user input altering one or more of the one or more classifications to create one or more updated classifications;
receiving, by the one or more processors, an indication of second user input confirming one or more of the one or more classifications to create one or more confirmed classifications;
updating, by the one or more processors, the machine learning model based on the one or more updated classifications and the one or more confirmed classifications.

### Claim 9 (depends on 5)

The method of claim 5, further comprising:
performing, by the one or more processors, an initial analysis on the first data object to determine one or more uncertainties regarding the content of the first data object;
creating, by the one or more processors, one or more inquiries for each of the one or more uncertainties;
receiving, by the one or more processors, an answer for one or more of the one or more inquiries; and
determining, by the one or more processors, the one or more classifications for the first data object based on the answer for the one or more of the one or more inquiries.

### Claim 10 (depends on 9)

The method of claim 9, wherein the one or more inquiries comprise one or more of one or more textual inquiries, one or more audible inquiries, and one or more chatbot inquiries, wherein the method further comprises:
outputting, by the one or more processors, the one or more inquiries.

### Claim 11 (depends on 9)

The method of claim 9, wherein creating the one or more inquiries comprise creating, by the one or more processors, the one or more inquiries for each of the one or more uncertainties using the model.

### Claim 12 (depends on 9)

The method of claim 9, further comprising:
analyzing, by the one or more processors and using the model, one or more of a narrative descriptive of the first data object and the answer to each respective inquiry of the one or more inquiries to further classify the respective data object with a feeling for the respective data object; and
grouping, by the one or more processors, the first data object with other data objects that are classified with similar feelings.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
providing, by the one or more processors, memory therapy by presenting one or more data objects that have a same feeling classification.

### Claim 14 (depends on 1)

The method of claim 1, wherein analyzing the first data object comprises determining, by the one or more processors, content for the first data object comprising one or more of:
audio analysis to determine one or more audible words or sounds present in the first data object,
graphical analysis to determine one or more living or non-living objects present in the first data object,
optical character recognition to determine one or more visible words in the first data object, and
metadata analysis to determine one or more of a location, time, and date of capture for the first data object.

### Claim 15 (depends on 1)

The method of claim 1, wherein the one or more classifications for the first data object comprise one or more of:
one or more persons contained in the first data object,
one or more animals contained in the first data object,
one or more objects contained in the first data object,
one or more events associated with the first data object,
one or more locations associated with the first data object,
one or more dates associated with the first data object,
one or more times associated with the first data object,
one or more relationships with one or more subjects contained in the first data object, and
one or more times of year at which the first data object was created.

### Claim 16 (depends on 1)

The method of claim 1, wherein each of the one or more classifications comprise either a previously created classification associated with a second data object stored in the storage component or a newly created classification not associated with any other data object in the storage component.

### Claim 17 (depends on 1)

The method of claim 1, further comprising:
outputting, by the one or more processors, one or more requests for subjective feelings of the user regarding the first data object;
receiving, by the one or more processors, an indication of user input indicative of the subjective feelings of the user regarding the first data object; and
storing, by the one or more processors, the subjective feelings of the user regarding the first data object in the storage component with the first data object and the one or more classifications.

### Claim 18 (depends on 17)

The method of claim 17, further comprising:
updating, by the one or more processors, the model based on the subjective feelings of the user regarding the first data object.

### Claim 19 (depends on 1)

The method of claim 1, further comprising:
editing, by the one or more processors, the first data object to remove one or more portions of the first data object prior to create an edited data object; and
storing, by the one or more processors, the edited data object in the storage component.

### Claim 20 (depends on 19)

The method of claim 19, wherein editing the first data object comprises:
determining, by the one or more processors, each of the one or more portions of the first data object to be removed as a portion that includes undesirable content.

### Claim 21 (depends on 1)

The method of claim 1, wherein the method further comprises:
storing, by the one or more processors, the plurality of data objects in the storage component, wherein each of the plurality of data objects is stored with one or more classifications for the respective data object.

### Claim 22 (depends on 21)

The method of claim 21, further comprising:
receiving, by the one or more processors, an indication of user input indicative of one or more requested classifications;
in response to receiving the indication of user input, retrieving, by the one or more processors and from the storage component, one or more of the plurality of data objects with respective classifications that are equal to the one or more requested classifications, wherein the one or more of the plurality of data objects includes a second data object; and
outputting, by the one or more processors, at least an indication of the second data object.

### Claim 23 (depends on 1)

The method of claim 1, further comprising:
outputting, by the one or more processors, a request for a narrative descriptive of the first data object, wherein the narrative comprises a written narrative or an audible narrative;
receiving, by the one or more processors, an indication of user input that includes the narrative for the first data object; and
storing, by the one or more processors, the narrative for the first data object in the storage component.

### Claim 24 (depends on 23)

The method of claim 23, further comprising:
outputting, by the one or more processors, the first data object; and
outputting, by the one or more processors with the first data object, the narrative for the first data object.

### Claim 25 (depends on 1)

The method of claim 1, further comprising:
receiving, by the one or more processors, a request to access the first data object;
outputting, by the one or more processors, the first data object; and
increasing, by the one or more processors, an access counter for the first data object.

### Claim 26 (depends on 25)

The method of claim 25, wherein the storage component stores the plurality of data objects including the first data object, and wherein the method further comprises:
outputting, by the one or more processors, an interface for accessing a subset of the plurality of data objects, the subset including a number of data objects with a greatest respective access counter.

### Claim 27 (depends on 1)

The method of claim 1, further comprising:
generating, by the one or more processors, a second graphical environment comprising a second set of one or more of the plurality of data objects; and
sending, by the one or more processors, the second graphical environment to the server device of the social platform with a second set of one or more privacy settings for the graphical environment.

### Claim 28 (depends on 1)

The method of claim 1, further comprising:
receiving, by the one or more processors, an indication of user input indicative of a requested update to the graphical environment;
generating, by the one or more processors and based on the requested update to the graphical environment, an updated graphical environment; and
sending, by the one or more processors, the updated graphical environment to the server device of the social platform.

### Claim 29 (depends on 1)

The method of claim 1, further comprising:
requesting, by the one or more processors, a friendly graphical environment from the server device, wherein the friendly graphical environment comprises one or more data objects associated with a second user different than the user;
in response to the server device determining that the user is allowed access to the friendly graphical environment, receiving, by the one or more processors, the friendly graphical environment; and
outputting, by the one or more processors, the friendly graphical environment.

### Claim 30 (depends on 1)

The method of claim 1, wherein the graphical environment includes a particular arrangement of the one or more of the plurality of data objects, and wherein the graphical environment comprises one or more of:
a flat graphical user interface containing the particular arrangement;
a virtual reality user interface containing the particular arrangement;
an augmented reality user interface containing the particular arrangement;
an audio user interface containing the particular arrangement; and
an extended reality user interface containing the particular arrangement.

### Claim 31 (depends on 1)

The method of claim 1, wherein the computerized avatar is configured to interact with one or more other users in the graphical environment of the user.

### Claim 32 (depends on 1)

The method of claim 1, further comprising:
defining, by the one or more processors, a longevity setting comprising a permission or denial of permission for the computer device to allow access to one or more aspects of the storage component after the user passes away.

### Claim 33 (depends on 1)

The method of claim 1, further comprising:
removing, by the one or more processors, personally identifiable information from one or more objects in the storage component to generate a set of anonymous information; and
sending, by the one or more processors, the set of anonymous information to the server device to be used for training a universal machine learning model.

### Claim 34 (depends on 1)

The method of claim 1, wherein the computing device is a standalone computing device that includes the storage component.

### Claim 35 (depends on 1)

The method of claim 1, wherein the storage component comprises a cloud storage component that the computing device accesses via a network.

### Claim 36 (depends on 1)

The method of claim 1, wherein storing the first data object comprises:
creating, by the one or more processors, a reference to the first data object in a blockchain.

### Claim 37 (depends on 1)

The method of claim 1, wherein receiving the first data object comprises:
recording, by the one or more processors, a video conference with a plurality of users to create a video recording, wherein the one or more classifications for the first data object include each of the plurality of users in the video conference; and
saving, by the one or more processors, the video recording as the first data object.

### Claim 38 (depends on 1)

The method of claim 1, further comprising:
receiving, by the one or more processors, one or more user death directives;
receiving, by the one or more processors, an indication of user input that completes one of the one or more user death directives; and
issuing, by the one or more processors, a user-defined reward to the user that completed the one of the one or more user death directives.

### Claim 39 (depends on 1)

The method of claim 1, wherein the computing device includes a removable storage component.

### Claim 40 (depends on 1)

The method of claim 1, further comprising:
creating, by the one or more processors, a financial account for the user; and
storing, by the one or more processors, currency in the financial account, wherein the currency comprises one or more of pre-deposited currency or cryptocurrency.

### Claim 41 (depends on 40)

The method of claim 40, further comprising:
defining, by the one or more processors, one or more financial directives in the model;
determining, by the one or more processors and using the model, that a potential purchase is available that satisfies one of the one or more financial directives;
recommending, by the one or more processors and to a trustee designated by the user, to complete the potential purchase using the currency in the financial account.

### Claim 42 (depends on 41)

The method of claim 41, further comprising:
receiving, by the one or more processors, a request for a second potential purchase from the trustee;
determining, by the one or more processors and using the model, that the second potential purchase fails to satisfy any of the one or more financial directives; and
declining, by the one or more processors, the second potential purchase.

### Claim 43 (depends on 40)

The method of claim 40, further comprising:
linking, by the one or more processors, the financial account to a physical charge card funded by the financial account.

### Claim 44 (depends on 1)

The method of claim 1, further comprising:
receiving, by the computing device, a physical specimen of DNA for the user; and
storing, by the computing device, the physical specimen of the DNA for the user.

### Claim 45 (depends on 1)

The method of claim 1, further comprising:
creating, by the one or more processors, a non-fungible token (NFT); and
attaching, by the one or more processors, the NFT to the first data object.

### Claim 46 (depends on 45)

The method of claim 45, further comprising:
receiving, by the one or more processors, a second data object;
analyzing, by the one or more processors and using the model, the second data object to determine one or more classifications for the second data object;
storing, by the one or more processors, the second data object and the one or more classifications for the second data object in the storage component of the computing device;
creating, by the one or more processors, a second NFT; and
attaching, by the one or more processors, the second NFT to the second data object.

### Claim 47 (depends on 45)

The method of claim 45, further comprising:
posting, by the one or more processors, the first data object and the NFT to a marketplace;
receiving, by the one or more processors, a payment to rent or purchase the NFT and the first data object; and
placing, by the one or more processors, the payment in a financial account associated with the user.

### Claim 48 (depends on 1)

The method of claim 1, wherein the computing device only includes a single physical port that connects the computing device to a power source.

### Claim 49

A computing device comprising:
a memory; and
one or more processors configured to:
receive a first data object;
analyze, using a model, the first data object to determine one or more classifications for the first data object;
store the first data object and the one or more classifications for the first data object in the memory of the computing device along with a plurality of data objects;
define one or more privacy settings for the first data object, the one or more privacy settings defining access for one or more other users of a social platform over which the first data object is shared with the one or more other users;
generate a graphical environment comprising at least the first data object of the plurality of data objects and the one or more privacy settings for the first data object;
send the graphical environment to a server device of the social platform with the one or more privacy settings for the graphical environment;
generate, based on the model, an artificial intelligence profile comprising one or more of vocal characteristics of the user, relationships for the user, personal information for the user, likes for the user, dislikes for the user, visual characteristics for the user, experiences of the user, and any other defining characteristic for the user;
generate a computerized avatar that acts in accordance with the artificial intelligence profile; and
include the computerized avatar in the graphical environment.

### Claim 50

A non-transitory computer-readable storage medium comprising instructions that, when executed by one or more processors of a computing device, cause the one or more processors to:
receive a first data object;
analyze, using a model, the first data object to determine one or more classifications for the first data object;
store the first data object and the one or more classifications for the first data object in a storage component of the computing device along with a plurality of data objects;
define one or more privacy settings for the first data object, the one or more privacy settings defining access for one or more other users of a social platform over which the first data object is shared with the one or more other users;
generate a graphical environment comprising at least the first data object of the plurality of data objects and the one or more privacy settings for the first data object;
send the graphical environment to a server device of the social platform with the one or more privacy settings for the graphical environment;
generate, based on the model, an artificial intelligence profile comprising one or more of vocal characteristics of the user, relationships for the user, personal information for the user, likes for the user, dislikes for the user, visual characteristics for the user, experiences of the user, and any other defining characteristic for the user;
generate a computerized avatar that acts in accordance with the artificial intelligence profile; and
include the computerized avatar in the graphical environment.