# US 10,372,127 B2 · Drone and drone-based system and methods for helping users assemble an object > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,372,127 B2 - Document ID: US10372127B2 - Status: Granted - Kind: B2 - Application number: 15/212,752 - Filed: 2016-07-18 - Published: 2018-01-18 - Granted: 2019-08-06 - Earliest claimed: 2016-07-18 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Thomas E. Chefalas; Andrzej Kochut; Clifford A. Pickover; Komminist Weldemariam - Web page: https://patentgrep.com/patent/US10372127B2 ## CPC - B64C 39/024: {of the remote controlled vehicle type, i.e. RPV} - B64D 47/02: Arrangements or adaptations of signal or lighting devices - G05D 1/00: Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots (drive control systems specially adapted for autonomous road vehicles B60W60/00) - G06Q 10/1093: Calendar-based scheduling for persons or groups - B64U 2101/26: for manufacturing, inspections or repairs - B64U 2101/30: for imaging, photography or videography - B64U 2101/60: for transporting passengers; for transporting goods other than weapons - B64U 2201/10: autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS] - B64U 2201/20: Remote controls - B64C: AEROPLANES; HELICOPTERS - B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT - G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR ## Abstract A drone-based system determines a user cohort for one or more users to assemble an object. The drone-based system assesses a task for the one or more users to assemble the object. Based on the determined user cohort and the assessed task, a drone of the drone-based system provides help to the one or more users as the one or more users assemble the object. The drone-based system may comprise a drone and one or more memories and computer readable code and one or more processors. The one or more processors, in response to execution of the computer readable code, cause the drone-based system to perform operations. The drone-based system may be only the drone or the drone and one or more servers. ## Claims ### Claim 1 A drone comprising: at least one user interface; at least one imaging device; one or more memories bearing computer-readable code; and one or more processors, wherein the one or more processors, in response to execution of the computer-readable code, are configured to cause the drone to perform at least the following: determine a user cohort for one or more users to assemble an object, wherein a user is a person, wherein the user cohort is based on one of a provided user profile, learning by the drone from observation, and learning from received user inputs; assess a task for the one or more users to assemble the object; and provide help, based on the determined user cohort and the assessed task, to the one or more users as the one or more users assemble the object, wherein the help is at least one of the following: one or more suggestions to the one or more users to aid the one or more users in assembling the object; a tool for the one or more users; scheduled or rescheduled time for one or more users to assemble an object based on calendar information; information conveyed from interactive assembly instructions to a user about how to use the tool or perform assembly using the tool; one or more steps to reduce the confusion of the user or to improve timeliness of the assembly by the user. ### Claim 2 (depends on 1) The drone of claim 1, wherein the one or more suggestions comprise at least one of the following: information that the one or more users are missing a step in assembly of the object; information that the one or more users are using an incorrect tool for the task; information that the one or more users do not have a tool to be used for the task; and information that the one or more users do not have a tool to be used for the task but may use a substitute tool. ### Claim 3 (depends on 1) The drone of claim 1, further comprising a tool grabber, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: select a tool based on the task and the user cohort; and provide the selected tool to the one or more users. ### Claim 4 (depends on 3) The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: identify, via the at least one imaging device, the selected tool prior to providing the tool; and retrieve the tool prior to providing the tool. ### Claim 5 (depends on 3) The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: identify the selected tool, prior to providing the tool, by one or both of the following: a barcode on one or more tools via the at least one imaging device; and information on a radio frequency identification tag attached to one or more tools; and retrieve the selected tool using the drone prior to providing the selected tool. ### Claim 6 (depends on 3) The drone of claim 3, wherein, when the selected tool is not available, the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: find an alternate tool that is suitable for use as the selected tool; choose the alternate tool as the selected tool; and provide the alternate tool to the one or more users. ### Claim 7 (depends on 3) The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: detect a need for a cluster of tools and designate the selected tool be the cluster of tools; and provide the cluster of tools to the one or more users. ### Claim 8 (depends on 3) The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: learn tool choices by observing and compiling uses by various individuals over time. ### Claim 9 (depends on 3) The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: communicate with one or more smart toolboxes in order to locate the selected tool. ### Claim 10 (depends on 3) The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: orchestrate usage of tools among a group of users by arranging, prioritizing, and delivering tools based on tasks to assemble the object and based on context of the task. ### Claim 11 (depends on 1) The drone of claim 1, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: access one or more electronic calendars for at least the one or more users; obtain calendar information from the one or more electronic calendars; and schedule or reschedule time for one or more users to assemble an object based on the obtained calendar information. ### Claim 12 (depends on 11) The drone of claim 11, wherein the task comprises multiple tasks and/or the object comprises multiple objects, each object with at least one task such that there are multiple tasks in total, and the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: estimate a time at which a selected one of the multiple tasks will be performed; prioritize distribution among the tasks and assembly of the multiple objects of at least one selected tool; and provide the at least one selected tool to the one or more users assembling the current object at the estimated time. ### Claim 13 (depends on 1) The drone of claim 1, wherein the user cohort comprises one or both of experience level of the one or more users and setting in which assembly of the object is being performed. ### Claim 14 (depends on 1) The drone of claim 1, wherein the assessing of the task is aided by information from an instruction manual comprising assembly instructions for the object. ### Claim 15 (depends on 1) The drone of claim 1, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: communicate with one or more remote helpers, in response to a determination the one or more remote helpers are needed. ### Claim 16 (depends on 1) The drone of claim 1, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: detect a need for a tool that the user does not have; and send a signal to trigger a purchase or a loan of such a tool. ### Claim 17 (depends on 1) The drone of claim 1, wherein the drone further comprises one or more lights, and wherein the help comprises using the light to perform one or more of the following: illuminate a tool as means of suggesting its use; illuminate a region of the object to help the one or more users during the assembly; and illuminate a portion of the object or one or more parts to be used in assembling the object. ### Claim 18 (depends on 1) The drone of claim 1, wherein the help comprises projecting a display of one or more steps of an instruction manual or speaking such one or more steps. ### Claim 19 (depends on 1) The drone of claim 1, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: communication between the drone and a user. ### Claim 20 (depends on 1) The drone of claim 1, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: process interactive assembly instructions for a particular user or cohort or both; and convey information from the interactive assembly instructions to the particular user about how to use the tool or perform assembly using the tool. ### Claim 21 (depends on 1) The drone of claim 1, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following: monitor by the drone user behavior to determine whether a user appears confused or is not performing assembly in a timely manner, and when the user appears confused or is not performing assembly in a timely manner, take one or more steps to reduce the confusion of the user or improve timeliness of the assembly by the user. ### Claim 22 (depends on 1) The drone of claim 1 comprised within a drone system. ### Claim 23 (depends on 22) The drone system of claim 22, comprising a network in communication with the drone and at least one other drone.