# US 2022/0035822 A1 · Automated object checklist

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0035822 A1
- Document ID: US20220035822A1
- Status: Published application
- Kind: A1
- Application number: 16/943,493
- Filed: 2020-07-30
- Published: 2022-02-03
- Earliest claimed: 2020-07-30
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: ENRICO VANNINI; Louise Suzanne Elliott; ABDUL MUMIN CHOUDHURY; Martin A. Ross
- Web page: https://patentgrep.com/patent/US20220035822A1

## CPC

- G06F 16/24575: {using context}
- G06F 16/235: {Update request formulation}
- G06F 16/2358: {Change logging, detection, and notification (replication G06F16/27)}
- G06F 16/2457: with adaptation to user needs
- G06N 5/022: Knowledge engineering; Knowledge acquisition
- G06V 10/768: {using context analysis, e.g. recognition aided by known co-occurring patterns}
- G06V 10/778: Active pattern-learning, e.g. online learning of image or video features
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06N 20/00: Machine learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Provided is a method, computer program product, and system for building an object checklist used to predict which objects should accompany a user during an occasion. A processor may monitor observation data related to the user from an observation device. The processor may analyze the observation data to identify an object associated with the user. The processor may collect contextual data related to the identified object and the user. The processor may compare the contextual data to a usage pattern threshold related to the identified object and one or more other objects. In response to the usage pattern threshold being met, the processor may output an alert to the user. The alert may indicate that an exception to a usage pattern related to the identified object has occurred.

## Claims

### Claim 1

A computer-implemented method comprising:
monitoring observation data related to a user from an observation device;
analyzing the observation data to identify an object associated with the user;
collecting contextual data related to the identified object and the user;
comparing the contextual data to a usage pattern threshold related to the identified object and one or more other objects; and
in response to the usage pattern threshold being met, outputting an alert to the user, wherein the alert indicates that an exception to a usage pattern related to the identified object has occurred.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the alert is selected from the group consisting of:
notifying the user that a second object related to the identified object is missing;
notifying the user that a second object unrelated to the identified object has been detected; and
notifying the user that the identified object is not typically associated with the user on a current occasion.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving an input from the user in response to the alert, wherein the input is used to verify the accuracy of the alert;
analyzing the input in relation to the usage pattern of the identified object; and
updating, based on the analyzing, the usage pattern threshold related to the identified object.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising:
collecting a set of training observation data related to the user from the observation device;
analyzing the set of training observation data to identify a set of objects carried by the user on a plurality of occasions;
collecting a set of training contextual data related to the identified set of objects and the user;
determining a correlation between the identified set of objects and the set of training contextual data to determine a usage pattern for each of the identified set of objects related to the user; and
generating, based on the correlation, a set of usage pattern thresholds for each of the identified set of objects.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, wherein the connection between a first object and a second object is based, in part, on a number of observations of the first object and the second object being identified together on the plurality of occasions.

### Claim 6 (depends on 4)

The computer-implemented method of claim 4, wherein collecting the set of training observation data is performed over a predetermined time period.

### Claim 7 (depends on 4)

The computer-implemented method of claim 4, wherein collecting the set of training observation data is performed over a predetermined number of observations.

### Claim 8 (depends on 4)

The computer-implemented method of claim 4, further comprising adjusting the set of usage pattern thresholds based, in part, on analyzing a second set of training observation data.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein the contextual data comprises at least one selected from the group consisting of: timestamp data; weather condition data; calendar data; textual data related to the user and the identified object; location data; spoken content; and metadata.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the contextual data comprises at least one selected from the group consisting of calendar data, textual data, and spoken content, and wherein the method further comprises analyzing the contextual data using natural language understanding.

### Claim 11 (depends on 1)

The computer-implemented method of claim 1, wherein the observation device is selected from the group consisting of:
a radio frequency identification (RFID) reader;
an Internet of Things (IoT) camera;
a smart speaker; and
a sensor.

### Claim 12

A system comprising:
a processor; and
a computer-readable storage medium communicatively coupled to the processor and storing program instructions which, when executed by the processor, cause the processor to perform a method comprising:
monitoring observation data related to a user from an observation device;
analyzing the observation data to identify an object associated with the user;
collecting contextual data related to the identified object and the user;
comparing the contextual data to a usage pattern threshold related to the identified object and one or more other objects; and
in response to the usage pattern threshold being met, outputting an alert to the user, wherein the alert indicates that an exception to a usage pattern related to the identified object has occurred.

### Claim 13 (depends on 12)

The system of claim 12, wherein the alert is selected from the group consisting of:
notifying the user that a second object related to the identified object is missing;
notifying the user that a second object unrelated to the identified object has been detected; and
notifying the user that the identified object is not typically associated with the user on a current occasion.

### Claim 14 (depends on 12)

The system of claim 12, wherein the method performed by the processor further comprises:
collecting a set of training observation data related to the user from the observation device;
analyzing the set of training observation data to identify a set of objects carried by the user on a plurality of occasions;
collecting a set of training contextual data related to the identified set of objects and the user;
determining a correlation between the identified set of objects and the set of training contextual data to determine a usage pattern for each of the identified set of objects related to the user; and
generating, based on the correlation, a set of usage pattern thresholds for each of the identified set of objects.

### Claim 15 (depends on 14)

The system of claim 14, wherein the connection between a first object and a second object is based, in part, on a number of observations of the first object and the second object being identified together on the plurality of occasions.

### Claim 16 (depends on 14)

The system of claim 14, wherein collecting the set of training observation data is performed over a predetermined time period.

### Claim 17

A computer program product comprising a computer-readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:
monitoring observation data related to a user from an observation device;
analyzing the observation data to identify an object associated with the user;
collecting contextual data related to the identified object and the user;
comparing the contextual data to a usage pattern threshold related to the identified object and one or more other objects; and
in response to the usage pattern threshold being met, outputting an alert to the user, wherein the alert indicates that an exception to a usage pattern related to the identified object has occurred.

### Claim 18 (depends on 17)

The computer program product of claim 17, wherein the alert is selected from the group consisting of:
notifying the user that a second object related to the identified object is missing;
notifying the user that a second object unrelated to the identified object has been detected; and
notifying the user that the identified object is not typically associated with the user on a current occasion.

### Claim 19 (depends on 17)

The computer program product of claim 17, wherein the method performed by the processor further comprises:
collecting a set of training observation data related to the user from the observation device;
analyzing the set of training observation data to identify a set of objects carried by the user on a plurality of occasions;
collecting a set of training contextual data related to the identified set of objects and the user;
determining a correlation between the identified set of objects and the set of training contextual data to determine a usage pattern for each of the identified set of objects related to the user; and
generating, based on the correlation, a set of usage pattern thresholds for each of the identified set of objects.

### Claim 20 (depends on 19)

The computer program product of claim 19, wherein the connection between a first object and a second object is based, in part, on a number of observations of the first object and the second object being identified together on the plurality of occasions.
