Systems and methods for label versioning for machine learning input data
AssigneeCapital One Services, LLC
InventorsTania Cruz MORALES, Haytham Yaghi, Shannon Yogerst
Life of this patent
Estimating the term…
Abstract
Systems and methods for documenting label versions for machine learning model input datasets are disclosed herein. The system may receive a label modification request for a dataset. The system may determine a dataset identifier and model error indicator. The system may determine a modification timestamp. The system may generate a label record and generate the label record in a label record database.
Claims20
A system for documenting label versions for artificial neural network input datasets from chatbot data, comprising:
- one or more processors;
- and
- a non-transitory, computer-readable medium comprising instructions that when executed by the one or more processors cause operations comprising:
- receiving, at a first time from a first device on a computer network, a label modification request for a dataset, wherein the label modification request comprises (1) a dataset identifier, (2) a model error indicator, (3) a user identifier, and (4) a new label, wherein the dataset identifier comprises a unique pointer to the dataset, wherein the model error indicator comprises an identifier of an artificial neural network and an indication of model performance of the artificial neural network when processing the dataset, wherein the user identifier comprises a name for a requester of label modification, and wherein the new label comprises a dataset name;
- receiving a temporal identifier for the first time and recording the temporal identifier as a modification timestamp, wherein the temporal identifier is standardized across the computer network;
- generating a label record and adding the label record to a label record database, wherein the label record is columnar and comprises the label modification request and the modification timestamp;
- in response to receiving, from a second device with a user interface on the computer network, a label history request including the dataset identifier, locate, in the label record database, a plurality of label records corresponding to the dataset identifier;
- and
- based on retrieving the plurality of label records from the label record database, generate, for display on the user interface, a summary of label records corresponding to the dataset identifier.
A method for documenting label versions for machine learning model input data, the method comprising:
- receiving, at a device on a computer network, a label modification request for a dataset;
- in response to the label modification request, determining a dataset identifier and a model error indicator;
- based on receiving the label modification request for the dataset, determining a modification timestamp;
- generating a label record, wherein the label record comprises the dataset identifier, the model error indicator, and the modification timestamp;
- and
- generating the label record in a label record database, wherein the label record database comprises a plurality of label records.
A non-transitory, computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
- receiving, at a device on a computer network, a label modification request for a dataset;
- in response to the label modification request, determining a dataset identifier and a model error indicator;
- based on receiving the label modification request for the dataset, determining a modification timestamp;
- generating a label record, wherein the label record comprises the dataset identifier, the model error indicator, and the modification timestamp;
- and
- generating the label record in a label record database, wherein the label record database comprises a plurality of label records.
Dependencies are inferred from the claim text.