Packaging Data Science Operations
AssigneeAdobe Systems Incorporated
InventorDavid Tompkins
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to a data science system that packages data science operations. The data science system packages a data science operation with a component descriptor or service descriptor to allow the data science system to easily apply and execute the data science operations using data from a variety sources. As described herein, the data science system also enables a user to provide data science packages to a marketplace as well as retrieve data science packages created by other users from the marketplace. Further, the data science system can customize a data science package obtained from the marketplace to perform data science operations using data belonging to the user or using user-specified parameters.
Claims20
In a digital environment for performing data science operations, a method of packaging data science algorithms for network-based deployment, the method comprising:
- obtaining, by at least one processor, a data science operation comprising a data science algorithm and referenced data from a data source;
- analyzing the data science operation to identify required parameters and optional parameters of the data science algorithm;
- determining, based on the referenced data from the data source, a data type required for the data science algorithm;
- and
- generating a component descriptor for the data science operation comprising the data type, the required parameters, and the optional parameters, wherein the component descriptor allows the data science operation to be applied to and executed with data from another data source.
In a digital environment for performing data science operations, a system of packaging data science algorithms for network-based deployment, the system comprising:
- at least one processor;
- at least one non-transitory computer readable storage medium storing instructions thereon that, when executed by the at least one processor, cause the system to:
- obtain a data science operation comprising referenced data from a data source, a first data science algorithm, and a second data science algorithm;
- analyze the first data science algorithm to identify a first required input;
- analyze the second data science algorithm to identify a second required input;
- analyze the first data science algorithm and the second data science algorithm to determine that an output from the first data science algorithm corresponds to the second required input for the second data science algorithm;
- and
- generate a service descriptor for the data science operation that maps the output from the first data science algorithm to the second required input of the second data science algorithm, wherein the service descriptor allows the data science operation to be applied to and executed with data from another data source.
In a digital environment for performing data science operations, a method of applying packaged data science algorithms, the method comprising:
- retrieving a data science package from a marketplace of data science operations, wherein the data science package comprises a component descriptor, a data science operation having a data science algorithm, and visualization code;
- analyzing, by at least one processor, the component descriptor to identify a data type required for the data science algorithm;
- filtering a plurality of data sources corresponding to a user to identify a data sources that include the data type in the component descriptor;
- receiving a user selection of data from a filtered data source of the plurality of filtered data sources;
- binding the data to the data science algorithm using binding information included in the component descriptor;
- executing, using the data, the data science operation to obtain output results;
- and
- providing, to the user in a graphical user interface, a visualization of the output results.
Dependencies are inferred from the claim text.