# US 2024/0202598 A1 · Semi-automated labeling of time-series sensor data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202598 A1
- Document ID: US20240202598A1
- Status: Published application
- Kind: A1
- Application number: 18/541,134
- Filed: 2023-12-15
- Published: 2024-06-20
- Earliest claimed: 2022-12-16
- Assignees: Qeexo, Co.
- Applicants: Qeexo, Co.
- Inventors: Stephanie Pavlick; Elias Lee Fallon; William Isaac Levine; Hasan Smeir
- Web page: https://patentgrep.com/patent/US20240202598A1

## CPC

- G06N 20/00: Machine learning
- G06F 16/24575: {using context}
- G06F 16/2477: {Temporal data queries}
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06N 3/09: Supervised learning
- G06N 5/04: Inference or reasoning models
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for semi-automated labeling of data for machine learning training. Data is collected via time-series sensors to form an unlabeled dataset. After receiving one or more event type labels for a subset of the dataset, thereby forming a labeled dataset, the remainder of the unlabeled dataset is automatically labeled. Potential new labels for the remainder of the unlabeled dataset are determined via cross correlation between the labeled dataset and unlabeled dataset. The potential new labels are presented as training data for a machine learning algorithm.

## Claims

### Claim 1

A method for semi-automated labeling of datasets, the method comprising:
collecting data via one or more time-series sensors to form an unlabeled dataset corresponding to raw sensor data;
receiving one or more event type labels for a subset of the unlabeled dataset thereby forming a labeled dataset;
generating a new convolved dataset by convolving the labeled dataset with the unlabeled dataset corresponding to the raw sensor data;
automatically determining potential new labels for any unlabeled segments remaining in the unlabeled dataset via cross correlation between the labeled dataset and the unlabeled dataset; and
presenting the new labelled data as training data and/or testing data for a machine learning algorithm.

### Claim 2 (depends on 1)

The method of claim 1, wherein the time-series sensors include one or more of the following: accelerometers, gyroscopes, magnetometers, thermometers, pressure sensors, ultrasonic time-of-flight sensors, humidity sensors, and microphones.

### Claim 3 (depends on 1)

The method of claim 1, wherein the dataset includes one or more recorded events of interest.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining the potential new labels includes determining whether the one or more event type labels is an event label or a background label.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining the potential new labels includes summing cross correlation results across all sensor data streams in the dataset.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining the potential new labels includes collapsing all raw data in the dataset into one dimension.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining the potential new labels includes identifying candidate potential new labels using multiple peak identification in a given segment.

### Claim 8

A system for semi-automated labeling of datasets, the system comprising:
one or more time-series sensors;
a processor; and
memory, the memory storing instructions for executing a method, the method comprising:
collecting data via one or more time-series sensors to form an unlabeled dataset corresponding to raw sensor data;
receiving one or more event type labels for a subset of the unlabeled dataset thereby forming a labeled dataset;
generating a new convolved dataset by convolving the labeled dataset with the unlabeled dataset corresponding to the raw sensor data;
automatically determining potential new labels for any unlabeled segments remaining in the unlabeled dataset via cross correlation between the labeled dataset and the unlabeled dataset; and
presenting the potential new labels as training data for a machine learning algorithm.

### Claim 9 (depends on 8)

The system of claim 8, wherein the time-series sensors include one or more of the following: accelerometers, gyroscopes, magnetometers, thermometers, pressure sensors, ultrasonic time-of-flight sensors, humidity sensors, and microphones.

### Claim 10 (depends on 8)

The system of claim 8, wherein the dataset includes one or more recorded events of interest.

### Claim 11 (depends on 8)

The system of claim 8, wherein determining the potential new labels includes determining whether the one or more event type labels is an event label or a background label.

### Claim 12 (depends on 8)

The system of claim 8, wherein determining the potential new labels includes summing cross correlation results across all sensor data streams in the dataset.

### Claim 13 (depends on 8)

The system of claim 8, wherein determining the potential new labels includes collapsing all raw data in the dataset into one dimension.

### Claim 14 (depends on 8)

The system of claim 8, wherein determining the potential new labels includes identifying candidate potential new labels using multiple peak identification in a given segment.

### Claim 15

A non-transitory computer readable storage medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions for:
collecting data via one or more time-series sensors to form an unlabeled dataset corresponding to raw sensor data;
receiving one or more event type labels for a subset of the unlabeled dataset thereby forming a labeled dataset;
generating a new convolved dataset by convolving the labeled dataset with the unlabeled dataset corresponding to the raw sensor data;
automatically determining potential new labels for any unlabeled segments remaining in the unlabeled dataset via cross correlation between the labeled dataset and the unlabeled dataset; and
presenting the potential new labels as training data for a machine learning algorithm.

### Claim 16 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the time-series sensors include one or more of the following: accelerometers, gyroscopes, magnetometers, thermometers, pressure sensors, ultrasonic time-of-flight sensors, humidity sensors, and microphones.

### Claim 17 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the dataset includes one or more recorded events of interest.

### Claim 18 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein determining the potential new labels includes determining whether the one or more event type labels is an event label or a background label.

### Claim 19 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein determining the potential new labels includes summing cross correlation results across all sensor data streams in the dataset.

### Claim 20 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein determining the potential new labels includes collapsing all raw data in the dataset into one dimension.
