Back to results
US 12,306,614 B2Granted
Smart tool with integrated neural network image analysis
AssigneeK2Ai, LLC
InventorKevin Richard Kerwin
Life of this patent
Estimating the term…
Abstract
A smart tool includes a body having a working output. A first controller is disposed within the body and connected to a plurality of sensors. The plurality of sensors includes at least one camera having a field of view at least partially capturing the working output. A neural network is trained to analyze an image feed from the at least one camera and trained perform at least one of classifying at least one of a working tool and an extension connected to the working output, classifying a component and/or a portion of a component interfaced with the working output, and determining a positioning of the smart tool. The neural network is stored in one of the first controller and a processing unit remote from the smart tool.
Claims18
A smart tool system comprising:
- a tool having a body including a working output;
- a first controller disposed within the body and connected to a plurality of sensors, the plurality of sensors including at least one camera fixedly connected to the body and having a field of view that at least partially captures the working output and at least partially captures an assembly to be worked by the working output;
- and
- a neural network trained to analyze an image feed from the at least one camera and determine a tool output component currently affixed to the tool and trained to identify features of the assembly from multiple camera angles;
- processing circuitry configured to:
- determine a current step to be performed using the tool;
- utilize the neural network to determine, based on one or more images from the at least one camera, a feature of the assembly corresponding to the current step based on characteristics inherent to the feature and not a marking incorporated on the assembly;
- utilize the neural network to determine, based on one or more images from the at least one camera, a current tool output component, the current tool output component comprising at least one of an attachment or extension for a working output of the tool;
- perform a first comparison of the feature of the assembly to an expected feature of the assembly for the step;
- perform a second comparison of the current tool output component to a required tool output component that is required for the tool to perform the current step;
- and
- based on the first comparison indicating that the feature of the assembly is different from the expected feature, prevent operation of the tool;
- and
- based on the second comparison indicating that the current tool output component is different from the required tool output component, prevent operation of the tool.
11 more elements
A method for operating a tool comprising:
- determining a current step to be performed using a tool in relation to a connection point or fastener of an assembly;
- determining a tool output component that is required for the tool to perform the current step, the tool output component comprising at least one of an attachment or extension for a working output of the tool;
- generating, using at least one camera fixedly connected to a body of the tool, at least one video feed that depicts a tool output component currently affixed to the tool, wherein the at least one camera has a field of view that at least partially captures the working output and at least partially captures the assembly, which is to be worked by the working output;
- utilize a neural network to determine, based on one or more images from the at least one video feed of the at least one camera, a feature of the assembly corresponding to the current step based on characteristics inherent to the feature and not a marking incorporated on the assembly, wherein the neural network is trained to identify features of the assembly from multiple camera angles;
- utilizing the neural network to determine, based on one or more images from the at least one video feed of the at least one camera, a current tool output component, the current tool output component comprising at least one of an attachment or extension for a working output of the tool;
- performing a first comparison of the feature of the assembly to an expected feature of the assembly for the step;
- performing a second comparison of the current tool output component to a required tool output component that is required for the tool to perform the current step;
- and
- based on the first comparison indicating that the feature of the assembly is different from the expected feature, preventing operation of the tool;
- and
- based on the second comparison indicating that the current tool output component is different from the required tool output component, preventing operation of the tool.
8 more elements
Dependencies are inferred from the claim text.