Back to results
US 2026/0279214 A1Published application
Virtual assistant and voice integration for power machines
OwnerPhilip Hoffert, Chad Swenson +4inventors
InventorsPhilip Hoffert, Chad Swenson, Scott Johnson, Jeff Dahl, Justin Jee, Joel Johnson
Life of this patent
Estimating the term…
Abstract
A virtual assistant and voice-commands may be implemented to control power machines. Additionally, on-site training or assessment functionality may be implemented with respect to power machines such that an operator’s capabilities in operating power machines may be determined.
Claims20
A power machine comprising:
- a power machine frame;
- a plurality of actuators supported by the power machine frame, wherein the plurality of actuators includes a first actuator and a second actuator;
- a lift arm structure that includes:
- a lift arm coupled to the power machine frame and configured to be moved relative to the power machine frame by the first actuator;
- and
- a work element supported by the lift arm and configured to be moved relative to the lift arm by the second actuator;
- and
- a control system that includes one or more electronic processors in communication with the plurality of actuators, the one or more electronic processors configured to:
- receive, using a microphone of the power machine, an audio input signal from an operator of the power machine, wherein the audio input signal is a query relating to an operation with the power machine;
- transform the audio input signal into a prompt;
- retrieve, from a local copy of predetermined machine information specific to the power machine, data related to the prompt, wherein the data includes machine information related to the operation with the power machine;
- provide the prompt and the retrieved data to a large language model (LLM), wherein the LLM is to generate a response to the query that provides training information for control of the power machine to perform the operation, the response generated based on the prompt and the retrieved data;
- and
- operate at least one of a display device of the power machine or a speaker of the power machine to provide the response to the operator of the power machine.
11 more elements
A power machine comprising:
- a power machine frame;
- a plurality of actuators supported by the power machine frame, wherein the plurality of actuators includes a first actuator and a second actuator;
- a lift arm structure that includes:
- a lift arm coupled to the power machine frame and configured to be moved relative to the power machine frame by the first actuator;
- and
- a work element supported by the lift arm and configured to be moved relative to the lift arm by the second actuator;
- and
- a control system that includes one or more electronic processors in communication with the plurality of actuators, the one or more electronic processors configured to:
- receive, using a microphone of the power machine, an audio input signal from an operator of the power machine, the audio input signal representing a query relating to operation of the power machine;
- transform the audio input signal into a prompt;
- retrieve data related to the prompt, wherein the data includes machine information related to the operation of the power machine;
- provide the prompt and the retrieved data to a large language model (LLM), so that the LLM generates a response to the query that provides information related to control of the power machine to perform the operation, the response generated based on the prompt and the retrieved data;
- and
- control the power machine to output the response to the operator of the power machine, wherein the response is responsive to the query relating to the operation of the power machine.
11 more elements
A power machine comprising:
- a power machine frame;
- a plurality of actuators supported by the power machine frame, wherein the plurality of actuators includes a lift actuator and a tilt actuator;
- a lift arm structure that includes:
- a lift arm coupled to the power machine frame and configured to be moved relative to the power machine frame by the lift actuator;
- and
- a work element supported by the lift arm and configured to be moved relative to the lift arm by the tilt actuator;
- and
- a control system that includes one or more electronic processors in communication with the plurality of actuators, the one or more electronic processors configured to:
- receive, using a microphone of the power machine, an audio input signal from an operator of the power machine, the audio input signal representing a query relating to operation of the power machine;
- transform the audio input signal into a prompt;
- retrieve data related to the prompt, wherein the data includes machine information related to the operation of the power machine;
- provide the prompt and the retrieved data to a large language model (LLM) to generate a response to the query based on the prompt and the retrieved data;
- and
- control the power machine to output the response to the operator of the power machine, wherein the response is responsive to the query relating to the operation of the power machine.
11 more elements
Dependencies are inferred from the claim text.