Device for operating an automated machine for handling, assembling or machining workpieces

A device for operating an automated machine for handling, assembling or machining workpieces, the device comprising:

• a display apparatus having a screen for displaying a graphic user interface for controlling and/or monitoring machine functions of the machine;
• an operating apparatus for inputting command-triggering operating actions for controlling machine functions of the machine and/or of functions of the graphic user interface by an operator of the machine, comprising a first input apparatus for inputting manual operating actions and a second input apparatus for inputting contact-free operating actions, wherein the second apparatus for inputting contact-free operating actions comprises:
• a sensor system for detecting contact-free actions of the operator,
• a detecting apparatus for detecting a command-triggering operating action of the operator by means of the contact-free actions of the operator detected by the sensor system, and
• a controller for implementing command-triggering operating actions input manually or in a contact-free manner into associated control commands for controlling machine functions of the machine and/or of functions of the graphic user interface by the operator;
• wherein the sensor system has a camera system including at least two cameras disposed spaced apart from one another for optically detecting mimic and gestural actions of the operator and an image processing unit adapted to perform a three-dimensional image recognition based on sensor signals of the camera system;
• wherein the sensor system is adapted to optically capture the eyes of the operator, the image processing unit being adapted to recognize a viewing direction of the operator based on optically captured pupils of the eyes of the operator;
• and
• wherein the image processing unit is adapted to detect a change of the size of the eye or pupil in the eyes of the operator, the controller being adapted to trigger an emergency stop on the machine if an abrupt eye or pupil enlargement of an operator is detected and a viewing direction of the operator is recognized as facing the machining space of the machine.

A device for operating an automated machine for handling, assembling or machining workpieces, the device comprising:

• a display apparatus having a screen for displaying a graphic user interface for controlling and/or monitoring machine functions of the machine;
• an operating apparatus for inputting command-triggering operating actions for controlling machine functions of the machine and/or of functions of the graphic user interface by an operator of the machine, comprising a first input apparatus for inputting manual operating actions and a second input apparatus for inputting contact-free operating actions, wherein the second apparatus for inputting contact-free operating actions comprises:
• a sensor system for detecting contact-free actions of the operator,
• a detecting apparatus for detecting a command-triggering operating action of the operator by means of the contact-free actions of the operator detected by the sensor system, and
• a controller for implementing command-triggering operating actions input manually or in a contact-free manner into associated control commands for controlling machine functions of the machine and/or of functions of the graphic user interface by the operator;
• wherein the sensor system has a camera system including at least one camera for optically detecting mimic and gestural actions of the operator, the detecting apparatus comprising an image processing unit adapted to perform an image recognition based on sensor signals of the camera system;
• wherein the camera system is adapted to optically capture the eyes of the operator the image processing unit is adapted to recognize an eyelid movement of the operator based on the optically captured eyes of the operator;
• and
• wherein the detecting apparatus is adapted to detect an eyelid movement pattern on the basis of detected eyelid movements, an eyelid movement pattern comprising a number of eyelid movements and time intervals between eyelid movements, the controller being adapted to allocate a detected predetermined eyelid movement pattern with a predetermined number of eyelid movements in a predetermined time interval to a confirmation control command for confirming a contact-free operating action.

A device for operating an automated machine for handling, assembling or machining workpieces, the device comprising:

• a display apparatus having a screen for displaying a graphic user interface for controlling and/or monitoring machine functions of the machine;
• an operating apparatus for inputting command-triggering operating actions for controlling machine functions of the machine and/or of functions of the graphic user interface by an operator of the machine, comprising a first input apparatus for inputting manual operating actions and a second input apparatus for inputting contact-free operating actions, wherein the second apparatus for inputting contact-free operating actions comprises:
• a sensor system for detecting contact-free actions of the operator,
• a detecting apparatus for detecting a command-triggering operating action of the operator by means of the contact-free actions of the operator detected by the sensor system, and
• a controller for implementing command-triggering operating actions input manually or in a contact-free manner into associated control commands for controlling machine functions of the machine and/or of functions of the graphic user interface by the operator;
• wherein the sensor system has a microphone system for picking up acoustic actions of the operator;
• and
• wherein the detecting apparatus is adapted to detect a shout or scream of the operator and the loudness thereof captured by the microphone system, the controller being adapted to trigger an emergency stop on the machine if a shout or scream of the operator with a loudness greater than a predetermined loudness limit value is detected by the detecting apparatus.