# US 2024/0177457 A1 · Generating Training Samples via 3D Modeling for Greenhouse Gas Emission Detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0177457 A1
- Document ID: US20240177457A1
- Status: Published application
- Kind: A1
- Application number: 17/994,993
- Filed: 2022-11-28
- Published: 2024-05-30
- Earliest claimed: 2022-11-28
- Assignees: Saudi Arabian Oil Company
- Applicants: Saudi Arabian Oil Company
- Inventors: Yong Ma; Ali Almadan; Weichang Li; Damian Pablo San Roman Alerigi
- Web page: https://patentgrep.com/patent/US20240177457A1

## CPC

- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06F 30/27: using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A computer-implemented method for generating training samples via 3D modeling for machine learning-based greenhouse gas emission detection is described. The method includes generating at least one 3D model corresponding to a real-world facility and at least one 3D model corresponding to gas plume emissions and building a virtual environment comprising a 3D field based on the at least one 3D model corresponding to the real-world facility and the at least one 3D model corresponding to gas plume emissions. The method also includes capturing images or video of the 3D field via simulation of the virtual environment and assigning labels to objects in the images or videos.

## Claims

### Claim 1

A computer-implemented method for generating training data using three dimensional (3D) modeling for machine learning-based greenhouse gas emission detection in oil and gas fields, the method comprising:
generating, using at least one hardware processor, at least one 3D model corresponding to a real-world facility and at least one 3D model corresponding to gas plume emissions:
building, using at least one hardware processor, a virtual environment comprising a 3D field based on the at least one 3D model corresponding to the real-world facility and the at least one 3D model corresponding to gas plume emissions:
capturing, using the at least one hardware processor, images or video of the 3D field via simulation of the virtual environment:
assigning, using the at least one hardware processor, labels to objects in the images or videos; and
training, using the at least one hardware processor, machine learning models using training samples including the labeled images or videos.

### Claim 2 (depends on 1)

The computer implemented method of claim 1, wherein simulation of the virtual environment comprises simulation of the 3D field via drone based image capture at a predetermined angle of image capture.

### Claim 3 (depends on 1)

The computer implemented method of claim 1, wherein simulation of the virtual environment comprises simulation of the 3D field via drone based video capture along as the drone traverses a predetermined path.

### Claim 4 (depends on 1)

The computer implemented method of claim 1, wherein the images or video of the 3D field comprise varying spectral bands.

### Claim 5 (depends on 1)

The computer implemented method of claim 1, wherein the machine learning models are trained to detect spectral variations among objects and greenhouse gases in the captured images or video to predict greenhouse gas emissions.

### Claim 6 (depends on 1)

The computer implemented method of claim 1, wherein the at least one a real-world facility corresponds to a physical oil and gas field.

### Claim 7 (depends on 1)

The computer implemented method of claim 1, wherein the gas plume emissions correspond to average emission values from respective oil and gas facilities.

### Claim 8 (depends on 1)

The computer implemented method of claim 1, further comprising rendering instructions to correct the condition.

### Claim 9

An apparatus comprising a non-transitory, computer readable, storage medium that stores instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:
generating at least one 3D model corresponding to a real-world facility and at least one 3D model corresponding to gas plume emissions:
building a virtual environment comprising a 3D field based on the at least one 3D model corresponding to the real-world facility and the at least one 3D model corresponding to gas plume emissions;
capturing images or video of the 3D field via simulation of the virtual environment:
assigning labels to objects in the images or videos; and
training machine learning models using training samples including the labeled images or videos.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein simulation of the virtual environment comprises simulation of the 3D field via drone based image capture at a predetermined angle of image capture.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein simulation of the virtual environment comprises simulation of the 3D field via drone based video capture along as the drone traverses a predetermined path.

### Claim 12 (depends on 9)

The apparatus of claim 9, wherein the images or video of the 3D field comprise varying spectral bands.

### Claim 13 (depends on 9)

The apparatus of claim 9, wherein the machine learning models are trained to detect spectral variations among objects and greenhouse gases in the captured images or video to predict greenhouse gas emissions.

### Claim 14 (depends on 9)

The apparatus of claim 9, wherein the at least one a real-world facility corresponds to a physical oil and gas field.

### Claim 15 (depends on 9)

The apparatus of claim 9, wherein the gas plume emissions correspond to average emission values from respective oil and gas facilities.

### Claim 16 (depends on 9)

The apparatus of claim 9, further comprising rendering instructions to correct the condition.

### Claim 17

A system, comprising:
one or more memory modules;
one or more hardware processors communicably coupled to the one or more memory modules, the one or more hardware processors configured to execute instructions stored on the one or more memory models to perform operations comprising:
generating at least one 3D model corresponding to a real-world facility and at least one 3D model corresponding to gas plume emissions;
building a virtual environment comprising a 3D field based on the at least one 3D model corresponding to the real-world facility and the at least one 3D model corresponding to gas plume emissions;
capturing images or video of the 3D field via simulation of the virtual environment;
assigning labels to objects in the images or videos; and
training machine learning models using training samples including the labeled images or videos.

### Claim 18 (depends on 17)

The system of claim 17, wherein simulation of the virtual environment comprises simulation of the 3D field via drone based image capture at a predetermined angle of image capture.

### Claim 19 (depends on 17)

The system of claim 17, wherein simulation of the virtual environment comprises simulation of the 3D field via drone based video capture along as the drone traverses a predetermined path.

### Claim 20 (depends on 17)

The system of claim 17, wherein the images or video of the 3D field comprise varying spectral bands.
