Waveform Analysis And Detection Using Machine Learning Transformer Models

A computer system comprising:

• memory hardware configured to store unlabeled waveform training data, labeled waveform training data, a target waveform, a transformer model, and computer-executable instructions;
• and
• processor hardware configured to execute the instructions, wherein the instructions include:
• obtaining labeled waveform training data and unlabeled waveform training data;
• supplying the unlabeled waveform training data to the transformer model to pre-train the transformer model by masking a portion of an input to the transformer model;
• supplying the labeled waveform training data to the transformer model without masking a portion of the input to the transformer model to fine-tune the transformer model, each waveform in the labeled waveform training data including at least one label identifying a feature of the waveform;
• and
• supplying a target waveform to the transformer model to classify at least one feature of the target waveform, wherein the at least one classified feature corresponds to the least one label of the labeled waveform training data.

A non-transitory computer-readable medium storing processor-executable instructions, the instructions comprising:

• obtaining labeled waveform training data and unlabeled waveform training data;
• supplying the unlabeled waveform training data to a transformer model to pre-train the transformer model by masking a portion of an input to the transformer model;
• supplying the labeled waveform training data to the transformer model without masking a portion of the input to the transformer model to fine-tune the transformer model, each waveform in the labeled waveform training data including at least one label identifying a feature of the waveform;
• and
• supplying a target waveform to the transformer model to classify at least one feature of the target waveform, wherein the at least one classified feature corresponds to the least one label of the labeled waveform training data.