Labeling system and method for time-series data

A labeling system comprising:

• a first agent unit is configured to annotate a piece of time-series data to generate a first annotated piece of time-series data with at least one first annotated segment;
• a second agent unit is configured to annotate the piece of time-series data to generate a second annotated piece of time-series data with at least one second annotated segment;
• and
• a labeling apparatus is configured to process the first annotated piece of time-series data and the second annotated piece of time-series data, wherein the processing comprises:
• S41:
• determining whether there is an intersection between the first annotated segment and the second annotated segment,
• in response to determining that there is an intersection between the first annotated segment and the second annotated segment, proceeding to S42, and
• in response to determining that there is not an intersection between the first annotated segment and the second annotated segment, ending the processing;
• S42:
• determining whether the first annotated segment and the second annotated segment have different labels from each other,
• in response to determining that the first annotated segment and the second annotated segment have different labels from each other, proceeding to S43, and
• in response to determining that the first annotated segment and the second annotated segment do not have different labels from each other, proceeding to S44;
• S43:
• sending the label of the first annotated segment to the second agent unit and the label of the second annotated segment to the first agent unit;
• S44:
• determining whether a discrepancy-over-union ratio between the first annotated segment and the second annotated segment is below a first threshold,
• in response to determining that a discrepancy-over-union ratio between the first annotated segment and the second annotated segment is below a first threshold, proceeding to S45, and
• in response to determining that a discrepancy-over-union ratio between the first annotated segment and the second annotated segment is not below a first threshold, proceeding to S46;
• S45:
• determining the intersection of the first annotated segment and the second annotated segment as a final annotated segment for the piece of time-series data;
• and
• S46:
• assigning a review tag to a union segment of the piece of time-series data which has a duration from a start of the first annotated segment to an end of the second annotated segment.

A labeling method comprising:

• S1:
• feeding a piece of time-series data to a first agent unit and a second agent unit;
• S2:
• annotating, by the first agent unit, the piece of time-series data to generate a first annotated piece of time-series data with at least one first annotated segment;
• S3:
• annotating, by the second agent unit, the piece of time-series data to generate a second annotated piece of time-series data with at least one second annotated segment;
• and
• S4:
• processing, by a labeling apparatus, the first annotated piece of time-series data and the second annotated piece of time-series data, wherein the processing comprises:
• S41:
• determining whether there is an intersection between the first annotated segment and the second annotated segment,
• in response to determining that there is an intersection between the first annotated segment and the second annotated segment, proceeding to S42, and
• in response to determining that there is not an intersection between the first annotated segment and the second annotated segment, ending the processing;
• S42:
• determining whether the first annotated segment and the second annotated segment have different labels from each other,
• in response to determining that the first annotated segment and the second annotated segment have different labels from each other, proceeding to S43, and
• in response to determining that the first annotated segment and the second annotated segment do not have different labels from each other, proceeding to S44;
• S43:
• sending the label of the first annotated segment to the second agent unit and the label of the second annotated segment to the first agent unit;
• S44:
• determining whether an intersection-over-union ratio between the first annotated segment and the second annotated segment exceeds a second threshold,
• in response to determining that the intersection-over-union ratio between the first annotated segment and the second annotated segment exceeds a second threshold, proceeding to S45, and
• in response to determining that the intersection-over-union ratio between the first annotated segment and the second annotated segment does not exceed a second threshold, proceeding to S46;
• S45:
• determining the intersection of the first annotated segment and the second annotated segment as a final annotated segment for the piece of time-series data;
• and
• S46:
• assigning a review tag to a union segment of the piece of time-series data which has a duration from a start of the first annotated segment to an end of the second annotated segment.