Touchless user interface control method based on a handheld device

The handheld device (100) of any one of the preceding claims, wherein the handheld device (100) has a weight less than 2 kg, preferably less than 1.5 kg, preferably less than 1 kg, preferably less than 0.7 kg, preferably less than 0.5 kg, preferably less than 0.3 kg, preferably less than 0.2 kg, preferably less than 0.1 kg.

The handheld device (100) of any one of the preceding claims, wherein the handheld device (100) is foldable, preferably through a folding mechanism (110).

The handheld device (100) of any one of the preceding claims, wherein the handheld device (100) includes at least one base part (101) which is configured to be placed on a surface, such as a desk, a table, a stand, a holding structure and/or the like.

The handheld device (100) of any one of the preceding claims, wherein the handheld device (100) comprises at least two physical framing means (102) which at least partially indicate the spatial input area (130) by at least partially framing the spatial input area (130).

The handheld device (100) of any one of the preceding claims, wherein the handheld device (100) comprises at least two depth sensing devices (120), each configured for at least partially observing the spatial input area (130) and capturing user input, wherein a combination of the captured data of the at least two depth sensing devices (120) is performed in order to recognize the user input and to generate control command(s) based on the user input, optionally wherein the depth sensing devices (120) are depth cameras.

The handheld device (100) of any one of the preceding claims, wherein one or more of the following types of control commands may be generated based on user input:

• hovering pointer commands causing modifying the displayed scene (210) by displaying a hovering pointer (220) which overlays the scene (210) in a respective position, preferably wherein a captured user input is determined to be a hovering pointer command if the user person (300) points with at least a portion of the user person's hand within the spatial input area (130);
• gesture input commands, such as click input commands, causing modifying the displayed scene (210) in that said scene (210) changes according to the gesture, preferably wherein a captured user input is determined to be a gesture input command if the user person (300) performs a gesture movement with the user person's hand within the spatial input area (130).

The handheld device (100) of any one of the preceding claims, wherein the handheld device (100) comprises a visual control aid (140), preferably formed by an electronic display, wherein the visual control aid (140) provides the user person (300) with an indication of captured user input.

A computer-implemented touchless user interface control method, the method comprising:

• providing, using a handheld device (100) according to one of the preceding claims, a spatial input area (130) serving as a spatial user interface enabling a user person (300) to provide touchless user input to a scene (210) displayed by an essentially stationary display means (200);
• observing, using the at least one depth sensing device (120) of the handheld device (100), the spatial input area (130) and capturing the touchless user input provided by the user person (300) using an input object (310);
• generating at least one control command based on the captured touchless user input to modify the displayed scene (210) in accordance with the at least one control command.