# US 2021/0198980 A1 · Method and system for generating virtual reality images of a drilling rig site

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0198980 A1
- Document ID: US20210198980A1
- Status: Published application
- Kind: A1
- Application number: 16/727,985
- Filed: 2019-12-27
- Published: 2021-07-01
- Earliest claimed: 2019-12-27
- Assignees: Schlumberger Technology Corporation
- Applicants: Schlumberger Technology Corporation
- Inventors: James Arthur Zapico; Juan-Carlos Yepez; Paul Andrew Thow
- Web page: https://patentgrep.com/patent/US20210198980A1

## CPC

- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- E21B 44/00: Automatic control systems specially adapted for drilling operations, i.e. self-operating systems which function to carry out or modify a drilling operation without intervention of a human operator, e.g. computer-controlled drilling systems; Systems specially adapted for monitoring a plurality of drilling variables or conditions
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- E21B: EARTH OR ROCK DRILLING; OBTAINING OIL, GAS, WATER, SOLUBLE OR MELTABLE MATERIALS OR A SLURRY OF MINERALS FROM WELLS

## Abstract

A method may include obtaining a request for a virtual reality (VR) image of a first VR area among a plurality of VR areas proximate a drilling rig. The first VR area may be associated with at least one drilling rig device. The method may include obtaining, a captured image from a camera device disposed in the first VR area. The method may include determining a VR user perspective based on motion tracking data of a VR user device. The method may include generating, using the captured image, a VR image from the VR user perspective. The method may be performed by a VR manager.

## Claims

### Claim 1

A method, comprising:
obtaining, by a virtual reality (VR) manager, a request for a VR image of a first VR area among a plurality of VR areas proximate a drilling rig, wherein the first VR area is associated with at least one drilling rig device;
obtaining, by the VR manager, a captured image from a camera device disposed in the first VR area;
determining, by the VR manager, a VR user perspective based on motion tracking data of a VR user device; and
generating, by the VR manager and using the captured image, a VR image from the VR user perspective.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
obtaining, by the VR manager, drilling equipment data regarding the at least one drilling rig device in the first VR area; and
displaying the VR image, wherein the VR image comprises the drilling equipment data.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
obtaining, by the VR manager, a command from the VR user device; and
adjusting, by the VR manager, a plurality of drilling operation parameters of the at least one drilling rig device located within the first VR area in response to the command

### Claim 4 (depends on 3)

The method of claim 3,
wherein adjusting the plurality of drilling operation parameters comprises:
actuating a programmable logic controller (PLC); and
adjusting, by the PLC, the drilling operation parameters of the drilling rig device.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
obtaining, by the VR manager, a request from the VR user device for a second VR area different from the first VR area; and
generating, by the VR manager, a VR image for the second VR area.

### Claim 6 (depends on 2)

The method of claim 2, further comprising:
obtaining, by the VR manager, updated drilling equipment data regarding the at least one drilling rig device.

### Claim 7 (depends on 1)

The method of claim 1,
wherein the at least one drilling rig device is a mud pump, draw works, or a drill string.

### Claim 8 (depends on 1)

The method of claim 1,
wherein the VR manager provides a plurality of VR images illustrating a simulation of a location or a size of the at least one drilling rig device in the first VR area using a simulator coupled to a control system,
wherein the plurality of VR images are provided in at least one green area of a control cabin, and
wherein the location or the size of the at least one drilling device is adjusted in response to the at least one simulation.

### Claim 9 (depends on 1)

The method of claim 1,
wherein the VR manager is located at a remote location from the drilling rig,
wherein the VR manager generates a VR control cabin for the drilling rig, and
wherein the VR control cabin is substantially similar to a control cabin physically located at the drilling rig.

### Claim 10

A system, comprising:
a drilling rig device and a camera device disposed in a first virtual reality (VR) area proximate a drilling rig;
a VR user device disposed outside the first VR area;
a VR manager comprising a processor and coupled to the VR user device and the camera device over a drilling management network,
wherein the VR manager obtains a captured image from the camera device, and
wherein the VR manager generates a first VR image using a portion of the captured image and a VR user perspective based on motion tracking data of the VR user device.

### Claim 11 (depends on 10)

The system of claim 10, further comprising:
wherein the VR manager obtains drilling equipment data regarding the drilling rig device, and
wherein the VR image is generated with the drilling equipment data.

### Claim 12 (depends on 10)

The system of claim 10,
wherein the VR manager obtains a plurality of commands from a VR user device, and
wherein the drilling rig device adjusts drilling operation parameters in the VR area in response to the plurality of commands.

### Claim 13 (depends on 12)

The system of claim 12,
wherein adjusting the drilling operation parameters comprises:
actuating a plurality of robotic elements coupled to the camera device; and
interacting with the drilling rig device, by the plurality of robotic elements, to adjust the drilling operation parameters.

### Claim 14 (depends on 10)

The system of claim 10,
wherein the VR manager obtains a request for an image of a different VR area, and
wherein the VR manager generates the second VR image for the different VR area.

### Claim 15 (depends on 10)

The system of claim 10, wherein the drilling rig device is a mud pump, draw works, or a drill string.

### Claim 16 (depends on 10)

The system of claim 10,
wherein the camera device is a 360 degree camera.

### Claim 17 (depends on 10)

The system of claim 10, further comprising:
a control system; and
a simulator coupled to the control system and the VR Manager,
wherein the simulator generates a simulation of the first VR area and the second VR area, and
wherein the VR manager generates a plurality of VR images for a user providing a visual experience of the simulation.

### Claim 18

A non-transitory computer readable medium storing instructions executable by a computer processor, the instructions comprising functionality for:
obtaining, by a virtual reality (VR) manager, a request for a VR image of a first VR area among a plurality of VR areas proximate a drilling rig, wherein the first VR area is associated with a drilling rig device;
obtaining, by the VR manager, a captured image from a camera device disposed in the first VR area;
determining, by the VR manager, a VR user perspective based on motion tracking data of a VR user device; and
generating, by the VR manager and using the captured image, a VR image from the VR user perspective.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, the instructions further comprising functionality for:
obtaining, by the VR manager, drilling equipment data regarding the drilling rig device in the first VR area; and
displaying the VR image, wherein the VR image comprises the drilling equipment data.

### Claim 20 (depends on 18)

The non-transitory computer readable medium of claim 18, the instruction further comprising functionality for:
obtaining, by the VR manager, a command from the VR user device; and
adjusting, by the VR manager, a plurality of drilling operation parameters of the drilling rig device located within the first VR area in response to the command
