Back to results
US 10,503,249 B2Granted
Method and apparatus for construction machine visualization
AssigneeTopcon Positioning Systems, Inc.
InventorsDaniele Pagliani, Nicola Finardi, Richard Jackson, Ivan Di Federico
Life of this patent
Estimating the term…
Abstract
A system for displaying information to an operator of a machine comprises a head tracking system and a projection system. One system for displaying information uses a projection system and a see-through display to present two-dimensional images to an operator. One system uses a projection system and a see-through display to present three-dimensional images to an operator. One system uses a pair of smart glasses to display information to a user based a direction a user is looking.
Claims15
A method comprising:
- determining a head position of a user with respect to a windshield of a construction machine;
- determining a direction of a gaze of the user based on the head position of the user with respect to the windshield;
- generating a representation of a construction site based on data received at a first time from sensors located on a construction machine;
- determining a difference between the representation of the construction site and a desired site plan;
- determining an operation to be performed based on the difference, the operation comprising movement of an implement of the construction machine based on a current position of the implement and a desired position of the implement;
- determining an image to be displayed to the user based on the head position of the user with respect to the windshield, the direction of the gaze of the user, the representation of the construction site, the desired site plan, and the operation to be performed, the image comprising an excavation area overlay, a volume overlay, and a completion overlay;
- displaying the image to the user;
- determining that the construction site has changed;
- updating the representation of the construction site in response to the determining that the construction site has changed, the updating based on data received at a second time from the sensors located on the construction machine to generate an updated representation;
- determining an updated image to be displayed to the user based on the direction of the user's gaze, the updated representation of the construction site, the desired site plan, and an additional operation to be performed based on a difference between the updated representation and the desired site plan;
- and
- displaying the updated image to the user.
9 more elements
An apparatus comprising:
- a processor;
- and
- a memory to store computer program instructions, the computer program instructions when executed on the processor, cause the processor to perform operations comprising:
- determining a head position of a user with respect to a windshield of a construction machine;
- determining a direction of a gaze of the user based on the head position of the user with respect to the windshield;
- generating a representation of a construction site based on data received at a first time from sensors located on a construction machine;
- determining a difference between the representation of the construction site and a desired site plan;
- determining an operation to be performed based on the difference, the operation comprising movement of an implement of the construction machine based on a current position of the implement and a desired position of the implement;
- determining an image to be displayed to the user based on the head position of the user with respect to the windshield, the direction of the gaze of the user, the representation of the construction site, the desired site plan, and the operation to be performed, the image comprising an excavation area overlay, a volume overlay, and a completion overlay;
- displaying the image to the user;
- determining that the construction site has changed;
- updating the representation of the construction site in response to the determining that the construction site has changed, the updating based on data received at a second time from the sensors located on the construction machine to generate an updated representation;
- determining an updated image to be displayed to the user based on the direction of the user's gaze, the updated representation of the construction site, the desired site plan, and an additional operation to be performed based on a difference between the updated representation and the desired site plan;
- and
- displaying the updated image to the user.
12 more elements
A non-transitory computer readable medium storing computer program instructions, which, when executed on a processor, cause the processor to perform operations comprising:
- determining a head position of a user with respect to a windshield of a construction machine;
- determining a direction of a gaze of the user based on the head position of the user with respect to the windshield;
- generating a representation of a construction site based on data received at a first time from sensors located on a construction machine;
- determining a difference between the representation of the construction site and a desired site plan;
- determining an operation to be performed based on the difference, the operation comprising movement of an implement of the construction machine based on a current position of the implement and a desired position of the implement;
- determining an image to be displayed to the user based on the head position of the user with respect to the windshield, the direction of the gaze of the user, the representation of the construction site, the desired site plan, and the operation to be performed, the image comprising an excavation area overlay, a volume overlay, and a completion overlay;
- displaying the image to the user;
- determining that the construction site has changed;
- updating the representation of the construction site in response to the determining that the construction site has changed, the updating based on data received at a second time from the sensors located on the construction machine to generate an updated representation;
- determining an updated image to be displayed to the user based on the direction of the user's gaze, the updated representation of the construction site, the desired site plan, and an additional operation to be performed based on a difference between the updated representation and the desired site plan;
- and
- displaying the updated image to the user.
9 more elements
Dependencies are inferred from the claim text.