# US 2012/0253584 A1 · Imaging-based interface sensor and control device for mining machines

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0253584 A1
- Document ID: US20120253584A1
- Status: Published application
- Kind: A1
- Application number: 13/078,660
- Filed: 2011-04-01
- Published: 2012-10-04
- Earliest claimed: 2011-04-01
- Assignees: Joy MM Delaware, Inc.
- Inventors: David Kevin Herdle
- Web page: https://patentgrep.com/patent/US20120253584A1

## CPC

- G06T 7/13: Edge detection
- E21C 27/10: by both slitting and breaking-down
- E21C 27/24: by milling means acting on the full working face {, i.e. the rotary axis of the tool carrier being substantially parallel to the working face (similar machines for tunneling E21D9/1026)}
- E21C 35/282: {Autonomous machines; Autonomous operations}
- E21C 25/06: Machines slitting solely by one or more cutting rods or cutting drums which rotate, move through the seam, and may or may not reciprocate
- E21C 27/02: solely by slitting (rods, drums, for same E21C25/10; saws, discs, wheels E21C25/18; chains, chain guides, for same E21C25/28)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- E21C: MINING OR QUARRYING

## Abstract

Systems, methods, and computer-readable medium containing instructions for controlling mining machines. One system includes an image sensor for capturing an image of a cutting face of a mine and interface sensing and control system for obtaining the image, identifying an anomaly in the image, calculating a distance between the anomaly and a reference, and using the distance to automatically instruct a mining machine control system to keep a cutter head of the mining machine within a seam.

## Claims

### Claim 1

A system for controlling a mining machine, the system comprising:
an image sensor for capturing an image of a cutting face of a mine;
an interface sensing and control system for obtaining the image, identifying an anomaly in the image, calculating a distance between the anomaly and a reference, and using the distance to automatically instruct a mining machine control system to keep a cutter head of the mining machine within a seam.

### Claim 2 (depends on 1)

The system of claim 1, wherein the interface sensing and control system identifies the anomaly in the image by identifying a band in the image.

### Claim 3 (depends on 2)

The system of claim 2, wherein the band includes a clay band.

### Claim 4 (depends on 2)

The system of claim 2, wherein the band includes a rock band.

### Claim 5 (depends on 1)

The system of claim 1, wherein the interface sensing and control system identifies the anomaly using edge-detection technology.

### Claim 6 (depends on 1)

The system of claim 1, wherein the interface sensing and control system identifies the anomaly by comparing the image to a plurality of images of known anomalies.

### Claim 7 (depends on 1)

The system of claim 1, wherein the reference includes at least one of a roof of the mine and a floor of the mine.

### Claim 8 (depends on 1)

The system of claim 1, wherein the reference includes a marker placed in the mine.

### Claim 9 (depends on 1)

The system of claim 1, wherein the interface sensing and control system calculates the distance using a known distance between the image sensor and the cutting face and a known size of pixels in the image.

### Claim 10 (depends on 1)

The system of claim 1, wherein the interface sensing and control system uses the distance to instruct a mining machine control system to keep a cutter head of the mining machine within a seam by comparing the distance between the anomaly and the reference and a distance between the cutter head and the reference.

### Claim 11 (depends on 1)

The system of claim 1, wherein the interface sensing and control system provides the image to an operator.

### Claim 12 (depends on 1)

The system of claim 1, wherein the interface sensing and control system provides the distance to an operator.

### Claim 13 (depends on 1)

The system of claim 1, wherein the image sensor includes a video camera.

### Claim 14 (depends on 1)

The system of claim 1, wherein the image sensor includes a still camera.

### Claim 15 (depends on 1)

The system of claim 1, wherein the image sensor includes a thermal camera.

### Claim 16

A computer-implemented method for controlling a mining machine, the method comprising:
obtaining an image of a cutting face of a mine with an image sensor;
identifying an anomaly in the image;
calculating a distance between the anomaly and a reference; and
using the distance to automatically keep a cutter head of the mining machine within a seam.

### Claim 17 (depends on 16)

The method of claim 16, wherein identifying an anomaly in the image includes identifying a band in the image.

### Claim 18 (depends on 17)

The method of claim 17, wherein identifying the band includes identifying a clay band in the image.

### Claim 19 (depends on 17)

The method of claim 17, wherein identifying the band includes identifying a rock band in the image.

### Claim 20 (depends on 16)

The method of claim 16, wherein identifying the anomaly includes identifying the anomaly in the image using edge-detection technology.

### Claim 21 (depends on 16)

The method of claim 16, wherein identifying the anomaly includes comparing the image to a plurality of images of known anomalies.

### Claim 22 (depends on 16)

The method of claim 16, wherein calculating the distance includes calculating a distance between the anomaly and at least one of a roof of the mine and a floor of the mine.

### Claim 23 (depends on 16)

The method of claim 16, wherein calculating the distance includes calculating a distance between the anomaly and a marker placed in the mine.

### Claim 24 (depends on 16)

The method of claim 16, wherein calculating the distance includes using a known distance between the image sensor and the cutting face and a known size of pixels in the image.

### Claim 25 (depends on 16)

The method of claim 16, wherein using the distance to keep a cutter head of the mining machine within a seam includes comparing the distance between the anomaly and the reference and a distance between the cutter head and the reference.

### Claim 26 (depends on 16)

The method of claim 16, further comprising providing the image to an operator.

### Claim 27 (depends on 16)

The method of claim 16, further comprising providing data about the anomaly to an operator.

### Claim 28

Non-transitory computer-readable medium encoded with a plurality of processor-executable instructions for controlling a mining machine having a cutter head, the instructions comprising:
obtaining an image of a cutting face of a mine with an image sensor;
identifying an anomaly in the image;
calculating a distance between the anomaly and a reference; and
using the distance to automatically keep a cutter head of the mining machine within a seam.

### Claim 29 (depends on 28)

The computer-readable medium of claim 28, wherein the instructions for identifying the anomaly include instructions for identifying the anomaly in the image using edge-detection technology.

### Claim 30 (depends on 28)

The computer-readable medium of claim 28, wherein the instructions for identifying the anomaly include instructions for comparing the image to a plurality of images of known anomalies.

### Claim 31 (depends on 28)

The computer-readable medium of claim 28, wherein the instructions for calculating the distance includes instructions for calculating a distance between the anomaly and at least one of a roof of the mine and a floor of the mine.

### Claim 32 (depends on 28)

The computer-readable medium of claim 28, wherein the instructions for calculating the distance includes instructions for calculating a distance between the anomaly and a marker placed in the mine.

### Claim 33 (depends on 28)

The computer-readable medium of claim 28, wherein the instructions for calculating the distance includes instructions for calculating the distance using a known distance between the image sensor and the cutting face and a known size of pixels in the image.

### Claim 34 (depends on 28)

The computer-readable medium of claim 28, wherein the instructions for calculating the distance includes instructions for identifying a data field in the image showing the image illuminated by a striping light source and using the data field to calculate the distance between the anomaly and the reference.

### Claim 35 (depends on 28)

The computer-readable medium of claim 28, wherein the instructions for using the distance to keep a cutter head of the mining machine within a seam include instructions for comparing the distance between the anomaly and the reference and a distance between the cutter head and the reference.
