Back to results
US 9,957,692 B2Granted
System and method for heavy equipment navigation and working edge positioning using an image acquisition device that provides distance information
AssigneeHexagon Technology Center GmbH
InventorKristian Morin
Life of this patent
Estimating the term…
Abstract
A system and method for automatically controlling working edges on a heavy equipment vehicle is provided. A GNSS/INS system determines a location of the vehicle. A vision system calculates a location of the working edge in a vision system coordinate system by obtaining images of a target connected to the working edge using a camera with a fixed field view that obtains distance information for each pixel in the fixed field of view. The location is then transformed to the navigation system coordinate system. The transformed location information is used by a working edge control system to control the placement of the working edge.
Claims14
A heavy equipment vehicle comprising:
- a working edge for performing an operation, wherein one or more three-dimensional targets having a predefined shape are operatively connected to the working edge;
- a navigation system configured to provide a location of the vehicle in a navigation system coordinate system;
- a time-of-flight camera, operatively connected to the vehicle, the time-of-flight camera having a fixed field of view and configured to obtain one or more images of the one or more three-dimensional targets during the operation and to determine a distance value for each of a plurality of pixels in the image;
- a vision system configured to determine location information, in a vision system coordinate system, of the working edge;
- and
- a processor configured to translate the location information from the vision
- system coordinate system to the navigation system coordinate system,
- wherein the vision system is configured to determine a location of one or more three-dimensional targets using the captured one or more images, the distance values from the plurality of pixels in the one or more images, and the predefined shape of the three-dimensional targets, and to determine the location information of the working edge based on the determined location of the one or more targets.
5 more elements
A method for controlling a working edge on a vehicle, the method comprising:
- determining a location of the vehicle in a navigation system coordinate system;
- obtaining one or more images of one or more three-dimensional targets comprising a predefined shape and being operatively connected to the working edge using a time-of-flight camera that is operatively connected to the vehicle, while the working edge performs an operation, the time-of-flight camera having a fixed field of view, wherein the time-of-flight camera obtains distance information for each pixel in the fixed field of view;
- determining a location of one or more three-dimensional targets using the captured one or more images, the distance values from the plurality of pixels in the one or more images, and the predefined shape of the three-dimensional targets, determining location information, in a vision system coordinate system, of the working edge based on the determined location of the one or more targets;
- and
- transforming the location information from the vision system coordinate system to the navigation system coordinate system.
2 more elements
A system comprising:
- a vehicle having a working edge for performing an operation, wherein one or more three-dimensional targets having a predefined shape are operatively connected to the working edge, the vehicle comprising a navigation system, a time of flight camera, a vision system and a processor, wherein the vehicle is in motion and wherein the working edge is in motion;
- wherein the navigation system comprises a global position sub-system and an inertial navigation sub-system, the navigation system configured to provide a location of the vehicle in a navigation system coordinate system;
- wherein time of flight camera is operatively interconnected to the vehicle, has a fixed field of view, and is configured to obtain during the operation, one or more images of the one or more three-dimensional targets, using a fixed field of view and wherein the time of flight camera is configured to obtain a distance value for each pixel in each of the one or more images;
- wherein the vision system is configured to determine a location of the one or more three-dimensional targets using the captured one or more images, the distance values from the plurality of pixels in the one or more images, and the predefined shape of the three-dimensional targets, and to determine location information, in a vision system coordinate system, of the working edge based on the determined location of the one or more targets;
- and
- wherein the processor is configured to translate the location information from the vision system coordinate system to the navigation system coordinate system using a predefined transformation between the vision system coordinate system and the navigation system coordinate system and a predefined spatial relationship between the target and a predefined point on the working edge.
3 more elements
Dependencies are inferred from the claim text.