# US 2019/0318283 A1 · System and method for adaptively executing user routines based on user interactions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318283 A1
- Document ID: US20190318283A1
- Status: Published application
- Kind: A1
- Application number: 16/262,745
- Filed: 2019-01-30
- Published: 2019-10-17
- Earliest claimed: 2018-04-12
- Assignees: Crosswind Communications
- Applicants: Crosswind Communications
- Inventors: James P. Kelly; Bruce A. Sharpe
- Web page: https://patentgrep.com/patent/US20190318283A1

## CPC

- G06Q 10/0633: Workflow analysis
- G06N 20/00: Machine learning
- G06Q 10/06334: {using forecasting or predicting}
- G06Q 10/1093: Calendar-based scheduling for persons or groups
- G08B 21/24: Reminder alarms, e.g. anti-loss alarms
- G06V 40/172: {Classification, e.g. identification}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

For each workflow, processing logic determines a current time of the day and identifies a workflow stage corresponding to the time of the day, and retrieves a content item corresponding to the workflow stage. The content item is transmitted to one or more user devices of the user to be presented thereon. A response is received from at least one of the user devices representing a user response to the content item. The user response and time of the response are recorded in an event log that stores the user interaction history of the user. Subsequently, a machine-learning engine is invoked to perform an analysis on the user interaction history in the event log to determine user routine pattern of the user for each workflow. Timing as well as other parameters of one or more subroutines of the workflows may be modified based on the analysis.

## Claims

### Claim 1

A computer-implemented method for executing routines associated with a user, the method comprising:
maintaining, at a server, one or more workflows for managing daily routines of a user located at a premise, each workflow having one or more workflow stages, each workflow stage being associated with a subroutine configured to be executed at a particular time of a day;
for each of the workflows, iteratively performing
determining a current time of a day,
identifying a workflow stage corresponding to the current time of the day,
executing a subroutine corresponding to the workflow stage, including
retrieving a content item corresponding to the workflow stage,
transmitting the content item to one or more preconfigured user devices of the user to be played thereon,
receiving a response from at least one of the preconfigured user devices representing a user response to the content item, and
logging the user response and timing of the user response in an event log storing user interaction history of the routine;
invoking a machine-learning engine to analyze the user interaction history in the event log to determine a user behavior of the user for each workflow; and
modifying at least timing of at least one subroutine of at least one workflow based on the user behavior.

### Claim 2 (depends on 1)

The method of claim 1, wherein the content item comprises a wakeup alarm to wake up the user from sleeping, and wherein the method further comprises:
monitoring one or more motion sensors disposed at a plurality of locations within the premise;
receiving a signal from at least one of the motion sensors indicating the user has a motion action; and
recording a timestamp of the signal as a wakeup time of the user.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
monitoring one or more motion sensors disposed at a plurality of locations within the premise;
in response to determining there is no motion action of the user for a predetermined period of time based on monitoring the motion sensors; and
transmitting the content item to the user devices to remind the user to move around.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
monitoring a doorbell device of a front door of the premise over the network;
receiving a signal received from the doorbell device indicating that a visitor has arrived at the front door of the premise;
in response to the signal, accessing a calendar system associated with the user to determine whether an appointment has been scheduled around the current time of the day; and
transmitting the content item having information to the at least one user device to indicate whether a visitor is expected to visit the premise, in response to determining that an appointment has been scheduled.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
receiving an image of the visitor from the doorbell device, wherein the image was captured by a camera of the doorbell device;
matching the image with contact information of the visitor scheduled to visit;
transmitting the contact information of the visitor to the at least one user device if there is a match.

### Claim 6 (depends on 1)

The method of claim 1, wherein the content item comprises a reminder message to remind the user to take a predetermined medicine, and wherein the method further comprises:
monitoring a pill dispenser disposed within the premise over the network;
receiving a signal from the pill dispenser indicating a medicine pill has been removed from the pill dispenser; and
in response to the signal, recording time at which the medicine pill was removed.

### Claim 7 (depends on 6)

The method of claim 6, further comprising
examining the signal to determine whether the medicine pill has been removed from a predetermined slot of the medicine pill dispenser associated with the current time of the day; and
transmitting a confirmation message to the at least one of the user devices to request the user to confirm whether a correct medicine pill has been taken.

### Claim 8 (depends on 1)

The method of claim 1, wherein the content item comprises a reminder message to remind the user to take a vital measurement using a vital measurement device, and wherein the method further comprises:
receiving a measurement reading from the vital measurement device over the network; and
storing the measurement reading and time of the measurement in a database, wherein the vital measurement includes at least one of a blood pressure, heartrate, weight, or a sugar level measurement.

### Claim 9 (depends on 1)

The method of claim 1, wherein the content item comprises a reminder message to remind the user to have a meal, and wherein the method further comprises:
sending a query to prompt the user for ingredient of the meal; and
in response to receiving the ingredient of the meal, storing ingredient information and time of the meal in a database.

### Claim 10 (depends on 1)

The method of claim 1, wherein the content item comprises a reminder message to remind the user that there is an appointment scheduled at a particular point in time and prompt the user whether the user wish to arrange transportation, and wherein the method further comprises:
receiving a confirmation from the user for arranging transportation; and
in response to the confirmation, transmitting a request to a remote server to arrange a vehicle to pick up the user.

### Claim 11 (depends on 1)

The method of claim 1, further comprising
accessing a calendar system associated with the user to determine whether an appointment has been scheduled within a predetermined proximity of the current time of the day;
transmitting a query to the at least one user device to query whether the user needs to arrange a transportation; and
in response to a positive response from the user device, transmitting a request to a third server over the network to arrange the transportation to the premise.

### Claim 12 (depends on 1)

The method of claim 1, wherein the premise is an assisted living environment, and wherein the user is an ageing person residing in the assisted living environment.

### Claim 13

A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations of executing routines associated with a user, the operations comprising:
maintaining, at a server, one or more workflows for managing daily routines of a user located at a premise, each workflow having one or more workflow stages, each workflow stage being associated with a subroutine configured to be executed at a particular time of a day;
for each of the workflows, iteratively performing
determining a current time of a day,
identifying a workflow stage corresponding to the current time of the day,
executing a subroutine corresponding to the workflow stage, including
retrieving a content item corresponding to the workflow stage,
transmitting the content item to one or more preconfigured user devices of the user to be played thereon,
receiving a response from at least one of the preconfigured user devices representing a user response to the content item, and
logging the user response and timing of the user response in an event log storing user interaction history of the routine;
invoking a machine-learning engine to analyze the user interaction history in the event log to determine a user behavior of the user for each workflow; and
modifying at least timing of at least one subroutine of at least one workflow based on the user behavior.

### Claim 14 (depends on 13)

The machine-readable medium of claim 13, wherein the content item comprises a wakeup alarm to wake up the user from sleeping, and wherein the operations further comprise:
monitoring one or more motion sensors disposed at a plurality of locations within the premise;
receiving a signal from at least one of the motion sensors indicating the user has a motion action; and
recording a timestamp of the signal as a wakeup time of the user.

### Claim 15 (depends on 13)

The machine-readable medium of claim 13, wherein the operations further comprise:
monitoring one or more motion sensors disposed at a plurality of locations within the premise;
in response to determining there is no motion action of the user for a predetermined period of time based on monitoring the motion sensors; and
transmitting the content item to the user devices to remind the user to move around.

### Claim 16 (depends on 13)

The machine-readable medium of claim 13, wherein the operations further comprise:
monitoring a doorbell device of a front door of the premise over the network;
receiving a signal received from the doorbell device indicating that a visitor has arrived at the front door of the premise;
in response to the signal, accessing a calendar system associated with the user to determine whether an appointment has been scheduled around the current time of the day; and
transmitting the content item having information to the at least one user device to indicate whether a visitor is expected to visit the premise, in response to determining that an appointment has been scheduled.

### Claim 17 (depends on 16)

The machine-readable medium of claim 16, wherein the operations further comprise:
receiving an image of the visitor from the doorbell device, wherein the image was captured by a camera of the doorbell device;
matching the image with contact information of the visitor scheduled to visit;
transmitting the contact information of the visitor to the at least one user device if there is a match.

### Claim 18 (depends on 13)

The machine-readable medium of claim 13, wherein the content item comprises a reminder message to remind the user to take a predetermined medicine, and wherein the operations further comprise:
monitoring a pill dispenser disposed within the premise over the network;
receiving a signal from the pill dispenser indicating a medicine pill has been removed from the pill dispenser; and
in response to the signal, recording time at which the medicine pill was removed.

### Claim 19

A data processing system, comprising:
a processor; and
a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations of executing routines associated with a user, the operations comprising:
maintaining, at a server, one or more workflows for managing daily routines of a user located at a premise, each workflow having one or more workflow stages, each workflow stage being associated with a subroutine configured to be executed at a particular time of a day;
for each of the workflows, iteratively performing
determining a current time of a day,
identifying a workflow stage corresponding to the current time of the day,
executing a subroutine corresponding to the workflow stage, including retrieving a content item corresponding to the workflow stage,
transmitting the content item to one or more preconfigured user devices of the user to be played thereon,
receiving a response from at least one of the preconfigured user devices representing a user response to the content item, and
logging the user response and timing of the user response in an event log storing user interaction history of the routine;
invoking a machine-learning engine to analyze the user interaction history in the event log to determine a user behavior of the user for each workflow; and
modifying at least timing of at least one subroutine of at least one workflow based on the user behavior.

### Claim 20 (depends on 19)

The system of claim 19, wherein the content item comprises a wakeup alarm to wake up the user from sleeping, and wherein the operations further comprise:
monitoring one or more motion sensors disposed at a plurality of locations within the premise;
receiving a signal from at least one of the motion sensors indicating the user has a motion action; and
recording a timestamp of the signal as a wakeup time of the user.