# US 10,120,560 B2 · User interface and method for assisting a user when operating an operating unit > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,120,560 B2 - Document ID: US10120560B2 - Status: Granted - Kind: B2 - Application number: 15/025,522 - Filed: 2013-09-27 - Published: 2016-07-21 - Granted: 2018-11-06 - Earliest claimed: 2013-09-27 - Assignees: Volkswagen Aktiengesellschaft - Applicants: Volkswagen Aktiengesellschaft - Inventors: Holger Wild; Mark Peter Czelnik; Gordon Seitz - Web page: https://patentgrep.com/patent/US10120560B2 ## CPC - G06F 3/0416: {Control or interface arrangements specially adapted for digitisers} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup - G06F 2203/04108: Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Systems, apparatuses and methods for assisting a user in the operation of a touch-sensitive operator control unit, where a presence of input means, such as a user's finger, is detected in a predefined first area in front of the operator control unit, and, in response to it, acknowledging of the detected presence by a predefined first audio output. The first area may be bounded in a direction parallel to a surface of the operator control unit corresponding to a button displayed on the operator control unit. The crossover of the input means from the first area into a predefined second area in front of the operator's control unit may also be detected and acknowledged by a predefined second audio output. Also, a predefined pattern of movement of the input means in the first area may be detected and acknowledged via audio or visual indicia. ## Claims ### Claim 1 A processor-based method of operating a touch-sensitive operator control unit configured to execute functions for a vehicle, comprising: displaying a graphical symbol on the operator control unit; detecting, via a sensor system, the presence of input means in a predefined first area in front of the operator control unit in an area of the displayed graphical symbol, wherein the predefined first area comprises an area parallel to a surface of the operator control unit; acknowledging, via a processing apparatus, the detected presence of the input means by generating a predefined first audio output; detecting, via the sensor system, a crossover of the input means from the first area to a predefined second area in front of the operator's control unit, the second area being associated with executing a function for the vehicle; acknowledging, via the processing apparatus, the detected crossover by a generating predefined second audio output; detecting, via the sensor system, a predefined pattern of movement of the input means in the predefined second area; acknowledging, via the processing apparatus, the predefined pattern of movement by a third audio output associated with the predefined pattern of movement; and executing the function for the vehicle based on the detected predefined pattern of movement. ### Claim 2 (depends on 1) The method of claim 1, wherein the predefined first area comprises a distance from the operator control unit that is greater than 0 mm. ### Claim 3 (depends on 1) The method of claim 1, wherein the predefined first area comprises a distance from the operator control unit that is greater than 1 mm. ### Claim 4 (depends on 1) The method of claim 1, wherein the predefined first area comprises a distance from the operator control unit that is greater than 2 mm. ### Claim 5 (depends on 1) The method of claim 1, wherein generating a predefined first audio output comprises a signal that corresponds to the displayed graphical symbol on the operator's control unit. ### Claim 6 (depends on 1) The method of claim 1, wherein the generated audio output comprises at least one of: a click sound at a first frequency, a click sound at a second frequency lower than the first frequency, a peep sound, the sound of thunder, the sound of rainfall, the sound of wind, a sequence of DTMF tones (touch tones), a dial tone, and speech outputs. ### Claim 7 (depends on 1) The method of claim 1, wherein the acknowledging of the detected presence of the input means comprises displaying another graphical symbol on the operator control unit. ### Claim 8 A Human Machine Interface installed in a motor vehicle, comprising: a touch-sensitive operator control unit configured to display a graphical symbol on the operator control unit; a detection device configured to detect the presence of input means; and a processing device, operatively coupled to the detection device and the operator control unit, wherein the processing device is configured to: detect the presence of the input means in a predefined first area in front of the operator control unit in an area of the displayed graphical symbol, wherein the predefined first area comprises an area parallel to a surface of the operator control unit; acknowledge the detected presence of the input means by generating a predefined first audio output; detect a crossover of the input means from the first area to a predefined second area in front of the operator's control unit, the second area being associated with executing a function for the vehicle; acknowledge the detected crossover by a generating predefined second audio output; detect a predefined pattern of movement of the input means in the predefined second area; acknowledge the predefined pattern of movement by a third audio output associated with the predefined pattern of movement; and execute function for the vehicle based on the detected predefined pattern of movement. ### Claim 9 (depends on 8) The Human Machine Interface of claim 8, wherein the operator's control unit is located centrally in the dashboard of the motor vehicle. ### Claim 10 (depends on 8) The Human Machine Interface of claim 8, wherein the detection device comprises a camera system and/or a capacitive sensor. ### Claim 11 (depends on 8) The Human Machine Interface of claim 8, wherein the predefined first area comprises a distance from the operator control unit that is greater than 0 mm. ### Claim 12 (depends on 8) The Human Machine Interface of claim 8, wherein the predefined first area comprises a distance from the operator control unit that is greater than 1 mm. ### Claim 13 (depends on 8) The Human Machine Interface of claim 8, wherein the predefined first area comprises a distance from the operator control unit that is greater than 2 mm. ### Claim 14 (depends on 8) The Human Machine Interface of claim 8, wherein the processing device is configured to generate a predefined first audio output by generating a signal that corresponds to the displayed graphical symbol on the operator's control unit. ### Claim 15 (depends on 8) The Human Machine Interface of claim 8, wherein the generated audio output comprises at least one of: a click sound at a first frequency, a click sound at a second frequency lower than the first frequency, a peep sound, the sound of thunder, the sound of rainfall, the sound of wind, a sequence of DTMF tones (touch tones), a dial tone, and speech outputs. ### Claim 16 (depends on 8) The Human Machine Interface of claim 8, wherein the processing device is configured to acknowledge the detected presence of the input means by generating and displaying another graphical symbol on the operator control unit.