# US 2014/0157129 A1 · Methods and systems for gesture-based petrotechnical application control

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0157129 A1
- Document ID: US20140157129A1
- Status: Published application
- Kind: A1
- Application number: 14/131,924
- Filed: 2012-06-25
- Published: 2014-06-05
- Earliest claimed: 2011-09-16
- Assignees: Landmark Graphics Corporation
- Inventors: Afshad E. Dinshaw; Manas M. Kawale; Amit Kumar; Siddharth Palaniappan
- Web page: https://patentgrep.com/patent/US20140157129A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Gesture-based petrotechnical application control. At least some embodiments involve controlling the view of a petrotechnical application by capturing images of a user; creating a skeletal map based on the user in the images; recognizing a gesture based on the skeletal map; and implementing a command based on the recognized gesture.

## Claims

### Claim 1

A method comprising:
controlling a view of a petrotechnical application by:
capturing images comprising a first user;
creating a first skeletal map based on the first user in the images;
recognizing a gesture based on the first skeletal map to create a first recognized gesture; and
implementing a command based on the first recognized gesture.

### Claim 2 (depends on 1)

The method of claim 1:
wherein recognizing further comprises recognizing a change of head position of the first user to be the first recognized gesture; and
wherein implementing further comprises changing the view of the petrotechnical application.

### Claim 3 (depends on 1)

The method of claim 1:
wherein recognizing further comprises recognizing a change of distance of the first user from a camera to be the first recognized gesture; and
wherein implementing further comprises changing the zoom level of the petrotechnical application.

### Claim 4 (depends on 1)

The method of claim 1 wherein recognizing the gesture further comprises:
training the system to recognize a first gesture, where the first gesture is previously unrecognized; and then
recognizing the first gesture as the first recognized gesture.

### Claim 5 (depends on 1)

The method of claim 1 wherein creating a first skeletal map further comprises:
creating a first skeletal map of a hand of the first user; and then
recognizing a gesture involving the first skeletal map of the hand of the first user.

### Claim 6 (depends on 1)

The method of claim 1 further comprising:
creating a second skeletal map based on a second user in the images;
recognizing a gesture based on the second skeletal map to create a second recognized gesture;
wherein implementing further comprises adding or modifying an object in a three-dimensional representation in the view; and
implementing a command based on the second recognized gesture and thereby modifying the object in the three-dimensional representation in the view.

### Claim 7 (depends on 1)

The method of claim 1:
wherein recognizing further comprises recognizing a clapping of two hands together; and
wherein implementing further comprises changing control of the petrotechnical application to a different hand.

### Claim 8 (depends on 7)

The method of claim 7 wherein the method further comprises verifying the clapping of two hands together based on an audible sound received by at least one microphone.

### Claim 9 (depends on 1)

The method of claim 1 wherein the method further comprises:
recognizing an audible sound received by at least one microphone related to the first recognized gesture;
implementing the command based on the audible sound.

### Claim 10 (depends on 1)

The method of claim 1 wherein recognizing further comprises determining a distance moved by calculating movement between or one more video cameras.

### Claim 11

A computer system comprising:
a processor;
a memory coupled to the processor;
a display device coupled to the processor;
the memory storing a program that, when executed by the processor, causes the processor to:
capture images comprising a first user by way of a camera operatively coupled to the processor;
create a first skeletal map based on the first user in the images;
recognize a gesture based on the first skeletal map to create a first recognized gesture;
implement a command based on the first recognized gesture; and thereby
change a three-dimensional representation of an earth formation shown on the display device.

### Claim 12 (depends on 11)

The computer system of claim 11:
wherein when the processor recognizes, the program further causes the processor to recognize a change of head position of the first user to be the first recognized gesture; and
wherein when the processor implements, the program further causes the processor to change the view of the three-dimensional earth formation shown on the display device.

### Claim 13 (depends on 11)

The computer system of claim 11 further comprising:
a camera system coupled to the processor;
wherein when the processor recognizes, the program further causes the processor to recognize a change of distance of the first user from the camera to be the first recognized gesture; and
wherein when the processor implements, the program further causes the processor to change the zoom level of the three-dimensional earth formation shown on the display device.

### Claim 14 (depends on 13)

The computer system of claim 13 further comprising at least one selected from the group of: stereoscopic cameras; black and white camera; color camera; and infrared sensor.

### Claim 15 (depends on 11)

The computer system of claim 11 wherein when the processor recognizes the gesture, the program further causes the processor to:
train the system to recognize a first gesture, where the first gesture is previously unrecognized; and then
recognize the first gesture as the first recognized gesture.

### Claim 16 (depends on 11)

The computer system of claim 11 wherein when the processor creates a first skeletal map, the program further causes the processor to:
create a first skeletal map of a hand of the first user; and then
recognize a gesture involving the first skeletal map of the hand of the first user.

### Claim 17 (depends on 11)

The computer system of claim 11 wherein the program causes the processor to:
create a second skeletal map based on a second user in the images;
recognize a gesture based on the second skeletal map to create a second recognized gesture;
wherein when the processor implements, the program further causes the processor to implement adding or modifying an object in the three-dimensional representation shown on the display device; and
implement a command based on the second recognized gesture and thereby modifying the object in the three-dimensional earth formation shown on the display device.

### Claim 18 (depends on 11)

The computer system of claim 11 further comprising:
a microphone coupled to the processor;
wherein when the processor recognizes, the program further causes the processor to recognize a clapping of two hands together based on sound received by the microphone; and
wherein implementing further comprises changing control of the view of the three-dimensional earth formation shown on the display device.

### Claim 19 (depends on 18)

The computer system of claim 18 wherein the program further causes the processor to verify the clapping of two hands together based on an audible sound.

### Claim 20 (depends on 11)

The computer system of claim 11 wherein the program further causes the processor to:
recognize an audible sound related to the first recognized gesture; and
implement the command based on the audible sound.

### Claim 21

A non-transitory computer-readable medium storing instructions that, when executed by a processor, causes the processor to:
control a view of a petrotechnical application by causing the processor to:
capture images comprising a first user;
create a first skeletal map based on the first user in the images;
recognize a gesture based on the first skeletal map to create a first recognized gesture;
implement a command based on the first recognized gesture.

### Claim 22 (depends on 21)

The non-transitory computer-readable medium of claim 21:
wherein when processor recognizes, the instructions further cause the processor to recognize a change of head position of the first user to be the first recognized gesture; and
wherein when the processor implements, the instructions further cause the processor to change the view of the petrotechnical application.

### Claim 23 (depends on 21)

The non-transitory computer-readable medium of claim 21:
wherein when processor recognizes, the instructions further cause the processor to recognize a change of distance of the first user from the camera to be the first recognized gesture
wherein when the processor implements, the instructions further cause the processor to change the zoom level of the petrotechnical application.

### Claim 24 (depends on 21)

The non-transitory computer-readable medium of claim 21 wherein the instructions further cause the processor to:
train the system to recognize a first gesture, where the first gesture is previously unrecognized; and then
recognize the first gesture as the first recognized gesture.

### Claim 25 (depends on 21)

The non-transitory computer-readable medium of claim 21:
wherein when the processor creates, the instructions further cause the processor to create the first skeletal map of a hand of the first user; and then
wherein when the processor recognizes, the instructions further cause the processor to recognize a gesture involving the first skeletal map of the hand of the first user.

### Claim 26 (depends on 21)

The non-transitory computer-readable medium of claim 21 wherein the instructions further cause the processor to:
create a second skeletal map based on a second user in the images;
recognize a gesture based on the second skeletal map to create a second recognized gesture;
wherein when the processor implements, the program further causes the processor to implement adding or modifying an object in a three-dimensional representation; and
implement a command based on the second recognized gesture and thereby modifying the object in the three-dimensional representation.

### Claim 27 (depends on 21)

The non-transitory computer-readable medium of claim 21:
wherein when processor recognizes, the instructions further cause the processor to recognize a clapping of two hands together; and
wherein when the processor implements, the instructions further cause the processor to change control of the petrotechnical application to a different hand.

### Claim 28 (depends on 21)

The non-transitory computer-readable medium of claim 21 wherein the instructions further cause the processor to verify the clapping of two hands together based on an audible sound.

### Claim 29 (depends on 21)

The non-transitory computer-readable medium of claim 21 wherein the instructions further cause the processor to:
recognize an audible sound related to the first recognized gesture;
implement the command based on the audible sound.

### Claim 30 (depends on 21)

The non-transitory computer-readable medium of claim 21 wherein the instructions further cause the processor to capture infrared frequencies.