# US 12,602,113 B2 · Computer a software module arrangement, a circuitry arrangement, a user equipment and a method for an improved and extended user interface > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,602,113 B2 - Document ID: US12602113B2 - Status: Granted - Kind: B2 - Application number: 18/275,959 - Filed: 2021-03-03 - Published: 2024-03-28 - Granted: 2026-04-14 - Earliest claimed: 2021-03-03 - Assignees: Telefonaktiebolaget LM Ericsson (publ) - Applicants: Telefonaktiebolaget LM Ericsson (publ) - Inventors: Andreas Kristensson; Alexander Hunt; Fredrik Dahlgren - Web page: https://patentgrep.com/patent/US12602113B2 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]} - G06F 1/1684: {Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675} - G06F 3/0412: {Digitisers structurally integrated in a display} - G06F 3/042: by opto-electronic means - G06F 3/044: by capacitive means - G06F 3/0487: using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser - G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A user equipment comprising a display, at least one side sensor and a controller, wherein the side sensor configured to receive touchless user input at a side of the display, thereby providing a touchless input area, and wherein the controller is configured to: detect that an object is in the touchless input area; indicate at least one option; detect a movement of the object and act accordingly, wherein when the movement is detected to be towards the user equipment, the controller is configured to act by performing an action associated with the option being displayed at a location corresponding to the object; when the movement is detected to be along the user equipment, the controller is configured to act accordingly by determining a new option corresponding to a new location of the object; when the movement is detected to be away from the user equipment, the controller is configured to cancel at least one option. ## Claims ### Claim 1 A user equipment comprising a display, at least one side sensor and a controller, wherein the side sensor configured to receive touchless user input at a side of the display, thereby providing a touchless input area, and wherein the controller is configured to: detect that an object is in the touchless input area; indicate at least one option; detect a movement of the object; and act by: when the movement is detected to be towards the user equipment, the controller is configured to act by performing an action associated with the option being displayed at a location corresponding to the object; when the movement is detected to be along the user equipment, the controller is configured to act accordingly by determining a new option corresponding to a new location of the object; and when the movement is detected to be away from the user equipment to a distance interval from the display and the option is associated with displaying further options, the controller is configured to stop displaying the further options. ### Claim 2 (depends on 1) The user equipment according to claim 1, wherein when the option is associated with a command the controller is further configured to perform the associated action by executing such command. ### Claim 3 (depends on 2) The user equipment according to claim 2, wherein the controller is further configured to receive further input regarding the command and then executing based on the further input. ### Claim 4 (depends on 1) The user equipment according to claim 1, wherein when the option is associated with further options, the controller is further configured to perform the associated action by displaying the further options. ### Claim 5 (depends on 1) The user equipment according to claim 1, wherein when the option is associated with an application to be initiated, the controller is further configured to perform the associated action by initiating the application. ### Claim 6 (depends on 1) The user equipment according to claim 1, wherein when the option is associated with a data object, the controller is further configured to perform the associated action by selecting the data object. ### Claim 7 (depends on 6) The user equipment according to claim 6, wherein the data object is associated with command, and the controller is further configured to perform the associated action by executing the command associated with the data object. ### Claim 8 (depends on 1) The user equipment according to claim 1, wherein the controller is further configured to detect that an object is in the touchless input area by determining that the object is at a distance falling below a threshold distance. ### Claim 9 (depends on 8) The user equipment according to claim 8, wherein the threshold distance is the range of the side sensor. ### Claim 10 (depends on 1) The user equipment according to claim 1, wherein the controller is further configured to determine that the detected object is a finger of a user. ### Claim 11 (depends on 1) The user equipment according to claim 1, wherein the controller is further configured to indicate that the at least one option is available for selection by indicating the extent of a menu structure. ### Claim 12 (depends on 1) The user equipment according to claim 1, wherein the controller is further configured to indicate that the at least one option is available for selection by displaying at least one option. ### Claim 13 (depends on 1) The user equipment according to claim 1, wherein the controller is further configured to determine an option as being a selectable option if the option is displayed at a location corresponding to where the distance to the object falls below the threshold distance. ### Claim 14 (depends on 1) The user equipment according to claim 1, wherein the controller is further configured to indicate the selectable option. ### Claim 15 (depends on 1) The user equipment according to claim 1, wherein the controller is further configured to detect that a movement is towards the user equipment when the distance to the object falls below a threshold value. ### Claim 16 (depends on 4) The user equipment according to claim 4, wherein the further options are further options in a menu structure. ### Claim 17 (depends on 4) The user equipment according to claim 4, wherein the controller is further configured to configured to display the further options in addition to the options. ### Claim 18 (depends on 4) The user equipment according to claim 4, wherein the controller is further configured to display the further options instead of the options. ### Claim 19 (depends on 1) The user equipment according to claim 1, wherein the user equipment is a smartphone, smart watch or a tablet computer. ### Claim 20 A method for use in a user equipment comprising a display and at least one side sensor configured to receive touchless user input at a side of the display, thereby providing a touchless input area, and wherein the method comprises: detecting that an object is in the touchless input area; indicating at least one option; detecting a movement of the object and acting by: when the movement is detected to be towards the user equipment, act accordingly by performing an action associated with the option being displayed at a location corresponding to the object; when the movement is detected to be along the user equipment, act accordingly by determining a new option corresponding to a new location of the object; when the movement is detected to be away from the user equipment to a distance interval from the display, cancelling at least one option. ### Claim 21 A non-transitory computer-readable medium carrying computer instructions that when loaded into and executed by a controller of a user equipment enables the user equipment to implement a method for use in the user equipment, wherein the user equipment comprises a display and at least one side sensor configured to receive touchless user input at a side of the display, thereby providing a touchless input area, and wherein the method comprises: detecting that an object is in the touchless input area; indicating at least one option; detecting a movement of the object; and acting by: when the movement is detected to be towards the user equipment, act accordingly by performing an action associated with the option being displayed at a location corresponding to the object; when the movement is detected to be along the user equipment, act accordingly by determining a new option corresponding to a new location of the object; when the movement is detected to be away from the user equipment to a distance interval from the display and the option is associated with displaying further options, stopping the displaying of the further options. ### Claim 22 An arrangement adapted to be used in a user equipment comprising a display, at least one side sensor configured to receive touchless user input at a side of the display, thereby providing a touchless input area, and said arrangement comprising: circuitry for detecting that an object is in the touchless input area; circuitry for indicating at least one option; circuitry for detecting a movement of the object; and circuitry for acting by: when the movement is detected to be towards the user equipment, act accordingly by performing an action associated with the option being displayed at a location corresponding to the object; when the movement is detected to be along the user equipment, act accordingly by determining a new option corresponding to a new location of the object; when the movement is detected to be away from the user equipment to a distance interval from the display and the option is associated with displaying further options, stopping the displaying of the further options.