Back to results
US 12,743,399 B2Granted
Machine learning data set management for distribution to machine learning applications
AssigneeAmazon Technologies, Inc.
InventorsAlex Anto Chirayath, Jeremy Paul Michael Feltracco
Life of this patent
Estimating the term…
Abstract
Centralized data set management techniques are implemented for data sets for machine learning applications. New data sets may be created from a search of managed data set labels. Data objects of the managed data sets that are found in the search are then used to generate a new data set. The new data set is then made available for machine learning applications to use.
Claims20
A system, comprising:
- at least one processor;
- and
- a memory, storing program instructions that when executed by the at least one processor, cause the at least one processor to:
- store, by a machine learning data set management system, a plurality of data sets respectively comprising a plurality of data objects with respective labels and respective metadata describing the one or more data sets;
- receive, via an interface of the machine learning data set management system, a request to search the plurality of data sets according to one or more search criteria;
- provide, via the interface of the machine learning data set management system, one or more data sets of the plurality of data sets identified based, at least in part on:
- respective access rights of the plurality of data sets that allow sharing of the one or more data sets with an identity associated with the request to search the plurality of data sets;
- and
- one or more search criteria;
- receive, via the interface of the machine learning data set management system, a request to create a new data set to be made available for access by one or more machine learning applications, the new data set to be a subset of the one or more data sets, wherein the request specifies one or more labels used to identify one or more data objects from the plurality of data objects in the one or more data sets to create the new data set;
- responsive to the request:
- determine, by the machine learning data set management system, that the one or more data sets allow creation of the new data set based at least in part on the respective access rights and the identity:
- search, by the machine learning data set management system, the respective metadata describing the one or more data sets and the respective labels of the plurality of data objects included in the one or more data sets according to the specified one or more labels, wherein to search, the machine learning data set management system:
- compares the respective labels of the plurality of data objects to identify the one or more data objects that match at least one of the specified one or more labels to include in the new data set;
- create, by the machine learning data set management system, the new data set that includes the identified one or more data objects from the one or more data sets;
- and
- after creation of the new data set, make, by the machine learning data set management system, the new data set available for access by the one or more machine learning applications.
14 more elements
A method, comprising:
- receiving, via an interface of the machine learning data set management system, a request to search the plurality of data sets according to one or more search criteria;
- providing, via the interface of the machine learning data set management system, one or more data sets of the plurality of data sets identified based, at least in part on:
- respective access rights of the plurality of data sets that allow sharing of the one or more data sets with an identity associated with the request to search the plurality of data sets;
- and
- one or more search criteria;
- receiving, via the interface of a machine learning data set management system, a request to create a new data set to be made available for access by one or more machine learning applications, the new data set to be a subset of the one or more data sets, wherein the request specifies one or more labels used to identify one or more data objects from a plurality of data objects stored in the one or more data sets to create the new data set;
- responsive to the request:
- determining, by the machine learning data set management system, that the one or more data sets allow creation of the new data set based at least in part on the respective access rights and the identity;
- searching, by the machine learning data set management system, respective labels of the plurality of data objects included in the one or more data sets according to the specified one or more labels, wherein the searching comprises comparing the respective labels of the plurality of data objects to identify the one or more data objects that match at least one of the specified one or more labels to include in the new data set;
- creating, by the machine learning data set management system, the new data set that includes the identified one or more data objects from the one or more data sets;
- and
- after creating the new data set, making, by the machine learning data set management system, the new data set available for access by the one or more machine learning applications.
9 more elements
One or more non-transitory, computer-readable storage media, storing program instructions that when executed on or across one or more computing devices cause the one or more computing devices to implement:
- receiving, via an interface of the machine learning data set management system, a request to search a plurality of data sets according to one or more search criteria;
- providing, via the interface of the machine learning data set management system, one or more data sets of the plurality of data sets identified based, at least in part on:
- respective access rights of the plurality of data sets that allow sharing of the one or more data sets with an identity associated with the request to search the plurality of data sets;
- and
- one or more search criteria;
- receiving, via the interface of a machine learning data set management system, a request to create a new data set to be made available for access by one or more machine learning applications, the new data set to be a subset of the one or more data sets, wherein the request specifies one or more labels used to identify one or more data objects from the plurality of data objects in the one or more data sets to create the new data set;
- responsive to the request:
- determining, by the machine learning data set management system, that the one or more data sets allow creation of the new data set based at least in part on the respective access rights and the identity:
- searching, by the machine learning data set management system, respective labels of the plurality of data objects included in the one or more data sets according to the specified one or more labels, wherein the searching comprises comparing the respective labels of the plurality of data objects to identify the one or more data objects that match at least one of the specified one or more labels to include in the new data set;
- creating, by the machine learning data set management system, the new data set that includes the identified one or more data objects from the one or more data sets;
- and
- after creating the new data set, making, by the machine learning data set management system, the new data set available for access by the one or more machine learning applications.
9 more elements
Dependencies are inferred from the claim text.