# US 2012/0253583 A1 · Imaging-based proximity detection systems for mining machines

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0253583 A1
- Document ID: US20120253583A1
- Status: Published application
- Kind: A1
- Application number: 13/078,650
- Filed: 2011-04-01
- Published: 2012-10-04
- Earliest claimed: 2011-04-01
- Inventors: David Kevin Herdle
- Web page: https://patentgrep.com/patent/US20120253583A1

## CPC

- E21C 35/282: {Autonomous machines; Autonomous operations}
- E21C: MINING OR QUARRYING

## Abstract

Systems, methods, and computer-readable medium for controlling a mining machine. One system includes an image sensor for capturing an image of an area adjacent to the mining machine and a proximity sensing and control system. The proximity sensing and control system obtains the image; identifies an object in the image, the object including at least one of a person and piece of equipment; calculates a distance between the identified object and at least one of the image sensor and the mining machine using at least one image processing algorithm; and automatically controls the mining machine based on the distance.

## Claims

### Claim 1

A system for controlling a mining machine comprising:
an image sensor for capturing an image of an area adjacent to the mining machine; and
a proximity sensing and control system for obtaining the image, identifying an object in the image, the object including at least one of a person and piece of equipment, calculating a distance between the identified object and at least one of the image sensor and the mining machine using at least one image processing algorithm, and automatically controlling the mining machine based on the distance.

### Claim 2 (depends on 1)

The system of claim 1, wherein the image sensor is mounted on the mining machine.

### Claim 3 (depends on 1)

The system of claim 1, wherein the image sensor is mounted on a shuttle car positioned adjacent to the mining machine.

### Claim 4 (depends on 1)

The system of claim 1, wherein the image sensor includes a still camera.

### Claim 5 (depends on 1)

The system of claim 1, wherein the image sensor includes a video camera.

### Claim 6 (depends on 1)

The system of claim 1, wherein the image sensor includes a thermal image sensor.

### Claim 7 (depends on 1)

The system of claim 1, wherein the image sensor includes a laser measurement device.

### Claim 8 (depends on 1)

The system of claim 1, wherein the proximity sensing and control system compares the distance to an allowable distance threshold and automatically stops operation of the mining machine if the distance is less than the allowable distance threshold.

### Claim 9 (depends on 1)

The system of claim 1, wherein the proximity sensing and control system identifies an object in the image by comparing heat data included in the image to a predetermined threshold temperature.

### Claim 10 (depends on 1)

The system of claim 1, wherein the proximity sensing and control system identifies an object in the image by identifying at least one shape included in the image and comparing the identified shape data to a plurality of known shapes.

### Claim 11 (depends on 1)

The system of claim 1, wherein the proximity sensing and control system calculates the distance using at least one image processing algorithm by identifying a shape included in the image, counting a number of pixels representing the identified shape and comparing the number of pixels with a known pixel number for the shape located at a known distance from the image sensor.

### Claim 12 (depends on 1)

The system of claim 1, wherein the object includes reflective marker having a known shape and size.

### Claim 13 (depends on 1)

The system of claim 1, wherein the proximity sensing and control system calculates the distance by identifying a data field in the image showing the image illuminated by a striping light source and using the data field to calculate the distance between the object and the image sensor.

### Claim 14 (depends on 1)

The system of claim 1, wherein the proximity sensing and control system provides data to an operator based on the identified object and the calculated distance.

### Claim 15

A computer-implemented method for controlling a mining machine, the method comprising:
obtaining an image of an area adjacent to the mining machine;
identifying an object in the image, the object including at least one of a person and piece of equipment;
calculating a distance between the identified object and at least one of the image sensor and the mining machine using at least one image processing algorithm; and
automatically controlling the mining machine based on the distance.

### Claim 16 (depends on 15)

The method of claim 15, wherein obtaining the image includes obtaining the image from an image sensor mounted on the mining machine.

### Claim 17 (depends on 15)

The method of claim 15, wherein obtaining the image includes obtaining the image from an image sensor mounted on a shuttle car positioned adjacent to the mining machine.

### Claim 18 (depends on 15)

The method of claim 15, further comprising comparing the distance to an allowable distance threshold.

### Claim 19 (depends on 18)

The method of claim 18, wherein automatically controlling the mining machine includes automatically stopping operation of the mining machine if the distance is less than the allowable distance threshold.

### Claim 20 (depends on 15)

The method of claim 15, wherein identifying an object includes comparing heat data included in the image to a predetermined threshold temperature.

### Claim 21 (depends on 15)

The method of claim 15, wherein identifying an object includes identifying at least one shape included in the image and comparing the identified shape data to a plurality of known shapes.

### Claim 21 (depends on 15)

The method of claim 15, wherein calculating a distance using at least one image processing algorithm includes identifying a shape included in the image, counting a number of pixels representing the identified shape and comparing the number of pixels with a known pixel number for the shape located at a known distance from the image sensor.

### Claim 22 (depends on 15)

The method of claim 15, wherein the calculating a distance includes identifying a data field in the image showing the image illuminated by a striping light source and using the data field to calculate the distance between the object and an image sensor capturing the image.

### Claim 23 (depends on 15)

The method of claim 15, further comprising providing data to an operator based on the identified object and the calculated distance.

### Claim 24

Non-transitory computer-readable medium encoded with a plurality of processor-executable instructions for controlling a mining machine, the instructions comprising:
obtaining an image of an area adjacent to the mining machine;
identifying an object in the image, the object including at least one of a person and piece of equipment;
calculating a distance between the identified object and at least one of the image sensor and the mining machine using at least one image processing algorithm; and
automatically controlling the mining machine based on the distance.

### Claim 25 (depends on 24)

The computer-readable medium of claim 24, further comprising instructions for comparing the distance to an allowable distance threshold.

### Claim 26 (depends on 25)

The computer-readable medium of claim 25, wherein the instructions for automatically controlling the mining machine include instructions for automatically stopping operation of the mining machine if the distance is less than the allowable distance threshold.

### Claim 27 (depends on 24)

The computer-readable medium of claim 24, wherein the instructions for identifying an object include instructions for comparing heat data included in the image to a predetermined threshold temperature.

### Claim 28 (depends on 24)

The computer-readable medium of claim 24, wherein the instructions for identifying an object include instructions for identifying at least one shape included in the image and comparing the identified shape data to a plurality of known shapes.

### Claim 29 (depends on 24)

The computer-readable medium of claim 24, wherein the instructions for calculating a distance using at least one image processing algorithm include instructions for identifying a shape included in the image, counting a number of pixels representing the identified shape and comparing the number of pixels with a known pixel number for the shape located at a known distance from the image sensor.

### Claim 30 (depends on 24)

The computer-readable medium of claim 24, wherein the instructions for calculating a distance include instructions for identifying a data field in the image showing the image illuminated by a striping light source and using the data field to calculate the distance between the object and an image sensor capturing the image.

### Claim 31 (depends on 24)

The computer-readable medium of claim 24, further comprising instructions for providing data to an operator based on the identified object and the calculated distance.
