Wellbore log-based machine learning using a foundational model
AssigneeSchlumberger Technology Corporation
InventorsVanessa SIMOES, Hiren Maniar, Aria Abubakar, Tao Zhao
Life of this patent
Estimating the term…
Abstract
Systems and methods of the present disclosure provide systems and methods related to using foundational model(s) for wellbore applications. The foundational model(s) may be constructed using a deep learning model with high capacity to train using data at scale. Additionally, the foundational model(s) may be constructed from such well logs containing unlabeled data and may be constructed using self-supervised approaches. The foundational model is generalized and suitable for performing multiple downstream tasks/applications using the foundational model.
Claims20
A method for optimizing one or more downstream applications, comprising:
- obtaining unlabeled log data from a plurality of wellbores;
- constructing a foundational model from the unlabeled log data, wherein the foundational model comprises a neural network to perform machine learning using self-supervised training, wherein the self-supervised training includes transforming the unlabeled log data;
- fine-tuning the foundational model for the one or more downstream applications, wherein the downstream application is performable using the foundational model;
- and
- implementing the one or more downstream applications based at least in part on the fine-tuned foundational model.
A computing system, comprising:
- one or more processors;
- and
- a memory system comprising one or more non-transitory computer-readable media storing instructions that, when executed by at least one of the one or more processors, cause the computing system to perform operations, the operations comprising:
- obtaining unlabeled log data from a plurality of wellbores, the unlabeled log data includes data from a plurality of different log types comprising at least one of gamma ray (GR) logs, neutron porosity (NPOR) logs, transit time of compressional wave (DTC) logs, transit time of shear wave (DTS) logs, bulk density (RHOB) logs, spontaneous potential (SP) logs, caliper (CALI) logs, shallow resistivity (LLS) logs, deep induction (ILD) logs, orphotoelectric (PEF) logs;
- constructing a foundational model from the unlabeled log data, the foundational model utilizing a neural network to perform machine learning using self-supervised training, wherein the self-supervised training comprises transforming the unlabeled log data, wherein constructing the foundational model also comprises utilizing a high-capacity deep learning model that includes a plurality of convolutional layers;
- fine-tuning the foundational model for the one or more downstream applications performable using the foundational model, wherein the downstream application comprises at least one of an outlier detection operation, a log correction application to correct log data by identifying mislabeling in the additional well log data, a formation property determination of a formation around a well corresponding to the unlabeled log data, determining areas of interest in the formation, marking areas of interest in the formation, and predicting missing log data from the unlabeled log data;
- and
- implementing the one or more downstream applications based at least in part on the foundational model.
A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations, the operations comprising:
- obtaining unlabeled log data including unlabeled log data from at least one of gamma ray (GR) logs, neutron porosity (NPOR) logs, transit time of compressional wave (DTC) logs, transit time of shear wave (DTS) logs, bulk density (RHOB) logs, spontaneous potential (SP) logs, caliper (CALI) logs, shallow resistivity (LLS) logs, deep induction (ILD) logs, and photoelectric (PEF) logs;
- constructing a foundational model from the unlabeled log data, wherein the foundational model comprises a neural network to perform machine learning using self-supervised training;
- fine-tuning the foundational model for the one or more downstream applications, wherein the downstream application is performable using the foundational model;
- and
- implementing the one or more downstream applications based at least in part on the fine-tuned foundational model.
Dependencies are inferred from the claim text.