Recognizing unknown data objects
AssigneeAmazon Technologies, Inc.
InventorsMehul A Shah, George Steven McPherson, Prajakta Datta Damle, Gopinath Duddi, Anurag Windlass Gupta
Life of this patent
Estimating the term…
Abstract
Recognizing unknown data objects may be implemented for data objects stored in a data store. Data objects that are identified as unknown may be accessed to retrieve a portion of the data object. Different representations of the data object may be generated for recognizing different data schemas. An analysis of the representations may be performed to identify a data schema for the unknown data object. The data schema may be stored in a metadata store for the unknown data object.
Claims20
A system, comprising:
- at least one processor;
- and
- a memory, that stores program instructions that when executed by the at least one processor, causes the at least one processor to implement a data catalog service, the data catalog service configured to:
- receive, via an interface for a data catalog service, a classifier for a data schema;
- determine, by the data catalog service, a storage location in a data store of an unknown data object based on a comparison of a list of one or more known objects with contents found in the storage location of the data store;
- perform a recognition task by the data catalog service for the unknown data object that is stored in the data store, wherein to perform the recognition task, the data catalog service is configured to:
- apply the classifier to generate a representation of a portion of the unknown data object that identifies the data schema of a plurality of possible data schemas as the data schema configured to obtain access to the entire unknown data object;
- and
- store the identification of the data schema for the unknown data object in the data catalog service.
A method, comprising:
- receiving, via an interface for a data catalog service, a classifier for a data schema;
- determining, by the data catalog service, a storage location in a data store of an unknown data object based on a comparison of a list of one or more known objects with contents found in the storage location of the data store;
- performing a recognition task by the data catalog service for the unknown data object that is stored in the data store, comprising:
- applying the classifier to generate a representation of a portion of the unknown data object that identifies the data schema of a plurality of possible data schemas as the data schema configured to obtain access to the entire unknown data object;
- and
- storing the identification of the data schema for the unknown data object in the data catalog service.
One or more non-transitory, computer-readable storage media, storing program instructions that when executed on or across one or more computing devices cause the one or more computing devices to implement:
- receiving, via an interface for a data catalog service, a classifier for a data schema;
- determining, by the data catalog service, a storage location in a data store of an unknown data object based on a comparison of a list of one or more known objects with contents found in the storage location of the data store;
- performing a recognition task by the data catalog service for the unknown data object that is stored in the data store, comprising:
- the classifier to generate a representation of a portion of the unknown data object that identifies the data schema of a plurality of possible data schemas as the data schema configured to obtain access to the entire unknown data object;
- and
- storing the identification of the data schema for the unknown data object in the data catalog service.
Dependencies are inferred from the claim text.