Oilfield data product generation and management system

A computing system, comprising:

• one or more processors;
• and
• a memory system comprising one more non-transitory computer-readable media storing instructions that, when executed by at least one of the one or more processors, cause the computing system to perform operations, the operations comprising:
• receiving input data from one or more external data sources via a data product pipeline, wherein the input data comprises seismic data and/or downhole data that is captured by a downhole tool in a wellbore of a well, wherein the downhole data comprises measurement-while-drilling parameters and/or logging-while-drilling parameters, and wherein the data product pipeline comprises an extraction pipeline and a transformation pipeline wherein the extraction pipeline comprises:
• a source connector configured to modify a format of the input data to generate modified input data;
• an extraction component configured to extract a portion of the modified input data to produce extracted data, wherein the extracted data is extracted based upon one or more user-defined parameters;
• and
• a raw connector component configured to receive the extracted data and modify the extracted data based on one or more portability parameters to generate modified extracted data;
• transferring the modified extracted data from the extraction pipeline to a data product raw storage, wherein the data product raw storage is configured to store the modified extracted data in a common data format (CDF) storage;
• storing the input data received directly from the one or more external data sources in the data product raw storage, wherein the data product raw storage is configured to store the input data in the CDF storage;
• transferring the modified extracted data and the input data from the data product raw storage to the transformation pipeline of the data product pipeline, wherein the transformation pipeline is configured to:
• receive one or more data products from a data product artifact storage, wherein the one or more data products correspond to a pre-defined format associated with a data domain to perform data ingestion, data transformation, data storage, data retrieval, and data output functions using one or more application programming interfaces (APIs) associated with the data domain;
• transform the input data and the modified extracted data into transformed data based on the one or more data products;
• and
• transfer the transformed data to the data product artifact storage;
• determining one or more properties associated with the wellbore in a subsurface region of the earth based on the transformed data;
• and
• adjusting one or more operations of equipment associated with the wellbore based on the one or more properties, wherein the one or more operations of the equipment are adjusted to vary a torque on a drill bit drilling the wellbore.

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations, the operations comprising:

• building a data product pipeline using a wellsite operations data foundation (WODF), wherein a data product developer creates and implements changes to the data product pipeline, wherein a WODF developer prepares elements that are to be used by the data product developer, wherein a data product operator maintains a model of the data product pipeline, and wherein a data product quality assurance (QA) controller tests, identifies, and corrects problems with a functionality of the data product pipeline;
• receiving input data from one or more external data sources via the data product pipeline, wherein the input data comprises seismic data and/or downhole data that is captured by a downhole tool in a wellbore of a well, wherein the downhole data comprises measurement-while-drilling parameters and logging-while-drilling parameters, wherein the one or more external data sources comprise an oilfield analytics, planning, and management software, a unified data service, and an open subsurface data universe, and wherein the data product pipeline comprises an extraction pipeline and a transformation pipeline wherein the extraction pipeline comprises:
• a source connector configured to modify a format of the input data to generate modified input data;
• an extraction component configured to extract a portion of the modified input data to produce extracted data, wherein the extracted data is extracted based upon one or more user-defined parameters;
• and
• a raw connector component configured to receive the extracted data and modify the extracted data based on one or more portability parameters to generate modified extracted data;
• transferring the modified extracted data from the extraction pipeline to a data product raw storage, wherein the data product raw storage is configured to store the modified extracted data in a common data format (CDF) storage;
• storing the input data received directly from the one or more external data sources in the data product raw storage, wherein the data product raw storage is configured to store the input data in the CDF storage;
• transferring the modified extracted data and the input data from the data product raw storage to the transformation pipeline of the data product pipeline, wherein the transformation pipeline is configured to:
• receive one or more data products from a data product artifact storage, wherein the one or more data products correspond to a pre-defined format associated with a data domain to perform data ingestion, data transformation, data storage, data retrieval, and data output functions using one or more application programming interfaces (APIs) associated with the data domain;
• transform the input data and the modified extracted data into transformed data based on the one or more data products;
• and
• transfer the transformed data to the data product artifact storage;
• determining one or more properties associated with the wellbore in a subsurface region of the earth based on the transformed data;
• and
• adjusting one or more functional operations of equipment associated with the wellbore based on the one or more properties, wherein the one or more functional operations of the equipment are adjusted to vary a torque on a drill bit drilling the wellbore.