Sensing system, work system, augmented-reality-image displaying method, augmented-reality-image storing method, and program
AssigneeFanuc Corporation
InventorMasafumi Ooba
Life of this patent
Estimating the term…
Abstract
A sensing system with a detecting device that is used to detect a position of a target and a controller, where, for display on a display device or projection by a projection apparatus, the controller creates an augmented-reality image that shows: at least one of a setting related to detection of the target using the detecting device, a setting of a moving apparatus, and a setting of a robot that performs work on the target, a position of the target being recognized by the controller, a result of the detection of the target, a work plan of the moving apparatus, a work plan of the robot, a determination result of the controller and a parameter related to the target.
Claims14
A sensing system comprising:
- a detecting device that is used to detect at least a position of a target that is being moved by a moving means for moving the target;
- and
- a controller,
- wherein the controller creates, for display on a display device or projection by a projection apparatus, an augmented-reality image that shows at least one type of the following information:
- at least one of a setting related to detection of the target performed by using the detecting device, a setting of the moving means, a setting of a work machine that performs work on the target, which are settings being recognized by the controller;
- a position of the target being recognized by the controller based one basis of the settings;
- a result of the detection of the target performed by using the detecting device;
- a work plan of the moving means;
- a work plan of the work machine;
- a determination result of the controller related to execution of the work performed by the work machine;
- and a parameter related to the target being recognized by the controller.
A sensing system comprising:
- a detecting device that is used to detect at least a position of a target that is being moved by a predetermined moving means;
- a controller that controls a work machine that performs work on the target by using a detection result of the detecting device;
- and
- a computer,
- wherein the controller or another controller is configured to conduct an augmented-reality-image creating process which successively creates, when the work machine is performing the work, augmented-reality images that show at least one type of the following information:
- the position of the target being recognized by the controller on a basis of the detection result of the detecting device;
- a work plan of the moving means;
- a work plan of the work machine a determination result of the controller related to execution of the work performed by the work machine;
- and a parameter related to the target being recognized by the controller, and
- wherein the sensing system further comprises a storage unit that stores the augmented-reality images created by the augmented-reality-image creating process together with corresponding real-space images.
An augmented-reality-image displaying method that is employed in a system in which a controller controls a work machine or a predetermined apparatus based on a detection result of a target that is being moved by a moving means for moving the target, the augmented-reality-image displaying method comprising:
- creating by the controller an augmented-reality image that shows at least one type of the following information:
- at least one of a setting related to detection of the target, a setting of the moving means, a setting of a work machine, which are settings being recognized by the controller;
- a position of the target being recognized by the controller based on the settings;
- a result of the detection of the target performed by using the detecting device;
- a work plan of the moving means;
- a work plan of the work machine;
- a determination result of the controller related to execution of the work performed by the work machine;
- and a parameter related to the target being recognized by the controller, and the method further comprising:
- displaying the created augmented-reality image on a display device or projecting the augmented-reality image using a projection apparatus.
An augmented-reality-image storing method that is employed in a system in which a controller controls a work machine based on a detection result of a target that is being moved by a moving means for moving the target, the augmented-reality-image storing method comprising:
- successively creating, when the work machine is performing the work, augmented-reality images that show at least one type of the following information:
- a position of the target being recognized by the controller based on the detection result;
- a work plan of the moving means;
- a work plan of the work machine;
- a determination result of the controller related to execution of the work performed by the work machine;
- and a parameter related to the target being recognized by the controller, and the method further comprising:
- storing the augmented-reality images created in the augmented-reality-image creating step together with corresponding real-space images.
A non-transitory computer readable storage medium that stores a program that is employed in a system in which a controller controls a work machine or a predetermined apparatus based on a detection result of a target that is being moved by a moving means for moving the target, the storage medium storing a program which causes a computer to execute:
- creating an augmented-reality image that shows at least one type of the following information:
- at least one of a setting related to the detection of the target, a setting of the moving means, a setting of a work machine, which are settings being recognized by the controller;
- a position of the target being recognized by the controller based on the settings;
- a result of the detection of the target performed by using the detecting device;
- a work plan of the moving means;
- a work plan of the work machine;
- a determination result of the controller related to execution of the work performed by the work machine;
- and a parameter related to the target being recognized by the controller;
- and
- displaying the created augmented-reality image on a display device or projecting the augmented-reality image using a projection apparatus.
A non-transitory computer readable storage medium that stores a program that is employed in a system in which a controller controls a work machine on the basis of a result of detection of a target that is being moved by a moving means for moving the target, the storage medium storing a program which causes a computer to execute:
- successively creating, when the work machine is performing the work, augmented-reality images that show at least one type of the following information:
- a position of the target being recognized by the controller based on the detection result;
- a work plan of the moving means;
- a work plan of the work machine;
- a determination result of the controller related to execution of the work performed by the work machine;
- and a parameter related to the target being recognized by the controller;
- and
- storing the augmented-reality images created in the augmented-reality-image creating step together with corresponding real-space images.
Dependencies are inferred from the claim text.