# US 2021/0174971 A1 · Activity tracking and classification for diabetes management system, apparatus, and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174971 A1
- Document ID: US20210174971A1
- Status: Published application
- Kind: A1
- Application number: 17/255,170
- Filed: 2019-06-29
- Published: 2021-06-10
- Earliest claimed: 2018-06-25
- Assignees: The Regents of the University of California
- Applicants: The Regents of the University of California
- Inventors: Ramesh C. Jain; Ping H. Wang; Hyungik Oh
- Web page: https://patentgrep.com/patent/US20210174971A1

## CPC

- G06Q 50/00: Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism (healthcare informatics G16H)
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- A61B 5/1112: {Global tracking of patients, e.g. by using GPS}
- A61B 5/1118: {Determining activity level}
- A61B 5/4866: {Evaluating metabolism (using breath test A61B5/083)}
- A61B 5/6898: {Portable consumer electronic devices, e.g. music players, telephones, tablet computers}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- G06Q 10/1093: Calendar-based scheduling for persons or groups
- G16H 10/20: for electronic clinical trials or questionnaires
- G16H 15/00: ICT specially adapted for medical reports, e.g. generation or transmission thereof
- G16H 20/10: relating to drugs or medications, e.g. for ensuring correct administration to patients
- G16H 20/30: relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
- G16H 20/70: relating to mental therapies, e.g. psychological therapy or autogenous training
- G16H 40/67: for remote operation
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

Activity tracking and classification for diabetes management is disclosed. In an example, an application operating on a user device or a server is configured to collect and synchronize lifelog data of a patient to atomic time intervals based on a time the lifelog data occurred or was recorded. The application or server is configured to segment the atomic intervals into daily activity intervals of first-level activities by determining if consecutive atomic intervals have a similar pattern of physical activity using at least a portion of the lifelog data. The application or server next selects a common daily activity model that corresponds to the patient and performs second-level activity recognition for each of the daily activity intervals using the selected common daily activity model. The application or server then generates, for display a personal chronical of the recognized second-level activities.

## Claims

### Claim 1

An activity tracking and classification apparatus comprising:
an interface configured to receive, from an application operating on a user device, lifelog data;
a memory device storing a plurality of common daily activity models for respective patients; and
a processor communicatively coupled to the interface and the memory device and configured to:
assign and synchronize the lifelog data to atomic intervals based on a time the lifelog data occurred or was recorded by the application operating on the user device,
segment the atomic intervals into daily activity intervals of first-level activities by determining if consecutive atomic intervals have a similar pattern of physical activity using at least a portion of the lifelog data,
select a common daily activity model from the memory device that corresponds to a patient of the user device,
perform second-level activity recognition for each of the daily activity intervals using the selected common daily activity model, and
generate, for display at the user device or a clinician device, a personal chronical of the recognized second-level activities.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the processor is configured to:
compare the recognized second-level activities to recommended activities for diabetes management;
determine a recommendation based on the comparison; and
transmit a message indicative of the recommendation to the user device to cause the patient to modify at least one of their future second-level activities for diabetes management or compliance to a prescribed routine.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the processor is configured to generate the personal chronical by chronologically ordering the recognized second-level activities.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the first-level activities are daily activities that are determined from at least a portion of the lifelog data and include at least one of walking, being still, running, cycling, driving, direction communication, indirect communication, and using the user device.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the lifelog data includes location data, force data, activity data, and application data.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein:
the location data includes at least one of a latitude, a longitude, a venue name, a venue type, a venue likelihood, or a point-of-interest;
the force data includes at least one of acceleration data or angular acceleration data;
the activity data includes at least one of an activity type, a duration, or an activity level; and
the application data includes at least one of an application name, an application type, a usage duration, an indication of direct communication, an indication of remote communication, an indication of a photo or video recording, a media type, a sound setting, or calendar event information.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the application is configured to record the lifelog data from at least one of application usage on the user device, GPS data on the user device, force data on the user device, a camera on the user device, a microphone on the user device, an activity tracking device that is communicatively coupled to the user device, or a sensor device that is communicatively coupled to the user device.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the atomic intervals have non-overlapping durations between 30 seconds, 60 seconds, 2 minutes, 5 minutes, or 10 minutes, and
wherein the daily activity intervals are non-overlapping.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the processor is configured to use a binary interval growing (“BIG”) algorithm to determine whether consecutive atomic intervals have the similar pattern of physical activity, and
wherein the processor is configured to classify each atomic interval as corresponding to a physical activity of moving or non-moving in conjunction with determining the first-level activity of whether consecutive atomic intervals have the similar pattern of physical activity.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the processor is configured to perform the second-level activity recognition for each of the daily activity intervals by creating hierarchal groupings that organize first and second-level activities based on attributes and interrelationships,
wherein the attributes and interrelationships include at least one of a temporal aspect, a spatial aspect, an experiential aspect, a causal aspect, a structural aspect, or an informational aspect.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the patient has diabetes or is at risk of developing diabetes, and the processor is configured to at least one of provide glucose control for the patient to help prevent hyperglycemia and hypoglycemia, optimize the patient's metabolism and body weight, enhance the patient's health for metabolic syndrome, optimize medical care delivery for the patient, and improve the patient's well-being.

### Claim 12

A memory device storing instructions, which when executed by a processor, cause the processor to:
receive lifelog data associated with a patient;
synchronize the lifelog data to atomic intervals based on a time the lifelog data occurred or was recorded;
segment the atomic intervals into daily activity intervals of first-level activities by determining if consecutive atomic intervals have a similar pattern of physical activity using at least a portion of the lifelog data;
select a common daily activity model that corresponds to a patient that is associated with the lifelog data;
perform second-level activity recognition for each of the daily activity intervals using the selected common daily activity model; and
generate, for display at a user device or a clinician device, a personal chronical of the recognized second-level activities.

### Claim 13 (depends on 12)

The memory device of claim 12, wherein the first-level activities have a direct correspondence with at least some of the lifelog data and the second-level activities provide a greater context to an activity of the patient compared to the first-level activities.

### Claim 14 (depends on 12)

The memory device of claim 12, wherein the instructions, which when executed by the processor, cause the processor to use the common daily activity model of the patient to perform at least one of a Formal Concept Analysis (“FCA”) or a Bagging Formal Concept Analysis (“BFCA”) of the daily activity intervals of the first-level activities using at least a portion of the lifelog data for performing second-level activity recognition.

### Claim 15 (depends on 12)

The memory device of claim 12, wherein the instructions, which when executed by the processor, cause the processor to cause an application operating on the user device to display at least one user interface that prompts the patient to provide at least some of the lifelog data.

### Claim 16 (depends on 12)

The memory device of claim 12, wherein the instructions, which when executed by the processor, cause the processor to receive the lifelog data from at least one of an application operating on the user device, a sensor device associated with the user, or a third-party server.

### Claim 17 (depends on 12)

The memory device of claim 12, wherein the instructions, which when executed by the processor, cause the processor to associate the recognized second-level activities with the respective daily activity intervals.

### Claim 18 (depends on 12)

The memory device of claim 12, wherein the instructions, which when executed by the processor, cause the processor to:
compare the recognized second-level activities to recommended activities for diabetes management;
determine a recommendation based on the comparison;
transmit a first message indicative of the recommendation to the clinician device;
receive from the clinician device a response message indicative that the recommendation is approved; and
transmit a second message indicative of the recommendation to the user device.

### Claim 19 (depends on 12)

The memory device of claim 12, wherein the instructions, which when executed by the processor, cause the processor to:
compare the recognized second-level activities to recommended activities for diabetes management;
determine a recommendation based on the comparison; and
transmit a message indicative of the recommendation to the user device.

### Claim 20 (depends on 19)

The memory device of claim 19, wherein the instructions, which when executed by the processor, cause the processor to:
use the recognized second-level activities to determine a time/day to transmit the message to the user device such that the recommendation relates to causing the patient to change at least one of the recognized second-level activities in the future at a time/day the patient normally performs the recognized second-level activity.

### Claim 21 (depends on 12)

The memory device of claim 12, wherein the instructions, which when executed by the processor, cause the processor to:
calculate derivative lifelog data from at least a portion of the lifelog data, the derivative lifelog data comprising a mathematical combination of the portion of the lifelog data;
segment the atomic intervals into daily activity intervals using additionally at least a portion of the derivative lifelog data; and
perform the second-level activity recognition for each of the daily activity intervals using the selected common daily activity model in conjunction with interrelations among at least a portion of the lifelog data and at least a portion of the derivative lifelog data.

### Claim 22 (depends on 12)

The memory device of claim 12, wherein the processor is located on at least one of a user device or a server.
