# US 11,442,581 B2 · Method for displaying at least one additional item of display content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,442,581 B2 - Document ID: US11442581B2 - Status: Granted - Kind: B2 - Application number: 17/266,354 - Filed: 2019-07-17 - Published: 2021-10-07 - Granted: 2022-09-13 - Earliest claimed: 2018-08-30 - Assignees: Audi AG - Applicants: Audi AG - Inventors: Benjamin Berndt; Timo Schaschek - Web page: https://patentgrep.com/patent/US11442581B2 ## CPC - G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)} - B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor - B60K 35/22: Display screens - B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions - B60K 35/50: Instruments characterised by their means of attachment to or integration in the vehicle (B60K35/231 takes precedence) - B60K 35/81: for controlling displays - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - B60K 2360/11: Instrument graphical user interfaces or menu aspects - B60K 2360/111: for controlling multiple devices - B60K 2360/113: Scrolling through menu items - B60K 2360/115: Selection of menu items - B60K 2360/141: Activation of instrument input devices by approaching fingers or pens - B60K 2360/146: Instrument input by gesture - B60K 2360/1464: 3D-gesture - B60K 2360/21: using cameras - G06F 2203/04804: Transparency, e.g. transparent or translucent windows - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES ## Abstract A method for displaying at least one additional item of display content on a display panel which is arranged in an interior of a vehicle, in which at least one sensor is used, using which a spatial corridor in the interior of the vehicle is optically monitored. The spatial corridor is delimited by two virtual boundary surfaces. At least one spatial virtual reference surface is defined in the spatial corridor between the virtual boundary surfaces, to which the at least one additional item of display content is assigned. The at least one sensor is used to detect whether a hand of a user is located in the corridor. ## Claims ### Claim 1 A method for displaying at least one additional item of display content on a display panel which is arranged in an interior of a vehicle, comprising: optically monitoring a spatial corridor in the interior of the vehicle using at least one sensor to determine whether a hand of a user is located in the spatial corridor, wherein the spatial corridor is delimited by a first virtual boundary surface and a second virtual boundary surface, the second virtual boundary surface closer to a surface of the display panel than the first virtual boundary surface, wherein at least one spatial reference surface is defined in the spatial corridor between the first and second virtual boundary surfaces, each of the at least one additional item of display content assigned to a corresponding one of the at least one spatial reference surface, and wherein an opacity or intensity of the at least one additional item of display content as displayed on the display panel is increased as the hand of the user crosses the first virtual boundary surface and decreased as the hand of the user crosses the second virtual boundary surface. ### Claim 2 (depends on 1) The method according to claim 1, wherein a selected one of the at least one additional item of display content is displayed on the display panel based on which of the at least one spatial reference surface is in closest proximity to or intersected by the hand of the user. ### Claim 3 (depends on 1) The method according to claim 1, wherein a selected one of the at least one additional item of display content is displayed on the display panel based on movement of the hand of the user relative to the at least one spatial reference surface. ### Claim 4 (depends on 1) The method according to claim 1, wherein the opacity or intensity of the at least one additional item of display content as displayed on the display panel is decreased when the hand of the user is outside of the spatial corridor. ### Claim 5 (depends on 1) The method according to claim 1, wherein a basic display content is displayed on the display panel and overlaid by the at least one additional item of display content depending on a position of the hand relative to the at least one spatial reference surface. ### Claim 6 (depends on 1) The method according to claim 1, wherein a movement and/or gesture of at least one finger of the hand at a position is registered by the at least one sensor to trigger or select a function symbolized by the at least one additional item of display content displayed on the display panel. ### Claim 7 (depends on 1) The method according to claim 1, wherein the second virtual boundary surface is positioned at a nonzero, predetermined distance from the surface of the display. ### Claim 8 (depends on 1) The method according to claim 1, wherein the opacity or intensity of the at least one additional item of display content is reduced to zero as the hand of the user crosses the second virtual boundary surface. ### Claim 9 (depends on 1) The method according to claim 1, wherein the at least one additional item of display content is a plurality of additional display content, and wherein the at least one spatial reference surface is a plurality of spatial reference surfaces. ### Claim 10 (depends on 1) The method according to claim 1, wherein the at least one sensor distinguishes between a position of the hand of the user and at least one of a position of an arm of the user and at a position of at least one finger of the user. ### Claim 11 (depends on 1) The method according to claim 1, wherein the surface of the display, the first and second virtual boundary surfaces, and the at least one spatial reference surface are parallel-planar to one another and not coincident with one another. ### Claim 12 A system for displaying at least one additional item of display content on a display panel which is arranged in an interior of a vehicle, comprising: at least one sensor and at least one processor, wherein the at least one sensor is configured to optically monitor a spatial corridor in the interior of the vehicle to determine whether a hand of a user is located in the spatial corridor, wherein the spatial corridor is delimited by a first virtual boundary surface and a second virtual boundary surface, the second virtual boundary surface closer to a surface of the display panel than the first virtual boundary surface, wherein at least one spatial reference surface is defined in the spatial corridor between the first and second virtual boundary surfaces, each of the at least one additional item of display content assigned to a corresponding one of the at least one spatial reference surface, and wherein the at least one processor is configured to increase an opacity or intensity of the at least one additional item of display content as displayed on the display panel as the hand of the user crosses the first virtual boundary surface and to decrease the opacity or intensity of the at least one additional item of display content as displayed on the display panel as the hand of the user crosses the second virtual boundary surface. ### Claim 13 (depends on 12) The system according to claim 12, wherein the at least one sensor is a camera. ### Claim 14 (depends on 12) The system according to claim 12, wherein the at least one sensor is a plurality of sensors which each observe the spatial corridor from different perspectives. ### Claim 15 (depends on 12) The system according to claim 12, wherein the second virtual boundary surface is positioned at a nonzero, predetermined distance from the surface of the display. ### Claim 16 (depends on 12) The system according to claim 12, wherein the opacity or intensity of the at least one additional item of display content is reduced to zero as the hand of the user crosses the second virtual boundary surface. ### Claim 17 (depends on 12) The system according to claim 12, wherein the at least one additional item of display content is a plurality of additional display content, and wherein the at least one spatial reference surface is a plurality of spatial reference surfaces. ### Claim 18 (depends on 12) The system according to claim 12, wherein the at least one processor distinguishes between a position of the hand of the user and at least one of a position of an arm of the user and at a position of at least one finger of the user. ### Claim 19 (depends on 12) The system according to claim 12, wherein the surface of the display, the first and second virtual boundary surfaces, and the at least one spatial reference surface are parallel-planar to one another and not coincident with one another.