# US 2021/0278909 A1 · Method for operating a display and operating device, display and operating device, and motor vehicle > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0278909 A1 - Document ID: US20210278909A1 - Status: Published application - Kind: A1 - Application number: 17/251,653 - Filed: 2019-05-27 - Published: 2021-09-09 - Earliest claimed: 2018-06-13 - Assignees: Audi AG - Applicants: Audi AG - Inventors: Jacques HELOT - Web page: https://patentgrep.com/patent/US20210278909A1 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor - B60K 35/22: Display screens - B60K 35/25: using haptic output - G03H 1/0005: {Adaptation of holography to specific applications (holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)} - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - B60K 35/211: {producing three-dimensional [3D] effects, e.g. stereoscopic images} - B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver - B60K 2360/122: Instrument input devices with reconfigurable control functions, e.g. reconfigurable menus - B60K 2360/1464: 3D-gesture - B60K 2360/166: Navigation - B60K 2360/29: Holographic features - G03H 2001/0061: {in haptic applications when the observer interacts with the holobject} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES - G03H: HOLOGRAPHIC PROCESSES OR APPARATUS (holograms, e.g. point holograms, used as ordinary optical elements G02B5/32; producing stereoscopic or other three-dimensional effects G02B30/00; diffraction-grating systems G02B27/44; systems using moiré fringes G02B27/60; optical logic elements G02F3/00; stereo-photography G03B35/00; photosensitive materials or processes for photographic purposes G03C; {stereo-photographic or similar processes G03C9/00}; apparatus for processing exposed photographic materials G03D; analogue computers performing mathematical operations with the aid of optical elements G06E3/00; authentication by radiation, of concealed information carried by holograms or diffraction gratings G06K19/16; holographic storage G11B7/0065, G11C13/04; {stereoscopic or other three dimensional effects in television systems H04N13/00}) ## Abstract A control device of a display and operating device specifies a graphical configuration of a display element to be displayed by the display device. Based on the specified graphical configuration, at least one light wave parameter for a respective light wave of a group of light waves is ascertained. A totality of the light wave parameters describes an interference pattern which describes an at least partial superposition of the light waves for generating an image representation of the display element. An interference pattern signal which describes the totality of the ascertained light wave parameters is generated and the generated interference pattern signal is transferred to an interference output device of the display and operating device. Based on the transferred interference pattern signal, the interference output device generates a light wave interference, and an output of a real image of the display element is displayed. ## Claims ### Claim at position 1 -9. (canceled) ### Claim 10 A method for operating a display and operating device, the method comprising: specifying a graphical configuration of a display element to be displayed by the display and operating device; based on the specified graphical configuration, ascertaining at least one light wave parameter for a respective light wave of a group of light waves, each of the light wave parameters describing a frequency, an amplitude, or a wavelength of the respective light wave, and a totality of the light wave parameters describing an interference pattern which describes an at least partial superposition of the light waves for generating an image representation of the display element; generating an interference pattern signal which describes the totality of the ascertained light wave parameters; transferring, from a control device of the display and operating device, the generated interference pattern signal to an interference output device; based on the transferred interference pattern signal, the interference output device generating and outputting the group of light waves and setting the respective at least one light wave parameter for each of the light waves among the group of light waves so as to generate a light wave interference and output a real image of the display element; receiving an operating signal from an operating device, the operating signal describing an operating action by a user with respect to the real image of the display element; based on the received operating signal, establishing a change in a relative position and/or a position of the real image of the display element, as described by the operating action; and based on the established change in the relative position and/or the position, adapting at least one light wave parameter for at least one light wave to change the interference pattern. ### Claim 11 (depends on 10) The method according to claim 10, wherein the display element is displayable at a position at which, during use of the display and operating device, a body part of the user is intersect-able with a display plane of the display element. ### Claim 12 (depends on 10) The method according to claim 10, further comprising: generating, by a contact trigger device of the display and operating device, a field perceivable in a haptic and tactile fashion in and/or on an operating region which is a region reachable by a body part of the user for performing the operating action with respect to the real image of the display element. ### Claim 13 (depends on 12) The method according to claim 12, wherein generating the field perceivable in the haptic and tactile fashion is performed by generating a vibration at a contact point of the body part and the display element and/or by graphically highlighting a portion of the display element at the contact point of the body part and the display element. ### Claim 14 (depends on 10) The method according to claim 10, wherein the generated interference pattern signal describes a configuration of an operating element as the display element and/or of a three-dimensional display element as the display element. ### Claim 15 (depends on 10) The method according to claim 10, wherein the operating device includes a gesture recognition device, and the operating action by the user is an operating gesture recognized by the gesture recognition device. ### Claim 16 (depends on 15) The method according to claim 15, wherein the operating gesture includes a rotary movement of a body part of the user, and adapting the at least one light wave parameter for the at least one light wave to change the interference pattern causes the real image of the display element to be rotated in accordance with the rotary movement of the body part of the user. ### Claim 17 A control device for a display and operating device, the control device comprising: a memory to store instructions; and a processor to execute the instructions stored in the memory to: specify a graphical configuration of a display element to be displayed by the display and operating device, based on the specified graphical configuration, ascertain at least one light wave parameter for a respective light wave of a group of light waves, each of the light wave parameters describing a frequency, an amplitude, or a wavelength of the respective light wave, and a totality of the light wave parameters describing an interference pattern which describes an at least partial superposition of the light waves for generating an image representation of the display element, generate an interference pattern signal which describes the totality of the ascertained light wave parameters, transfer the generated interference pattern signal to an interference output device to cause a real image of the display element to be output, receive an operating signal from an operating device, the operating signal describing an operating action by a user with respect to the real image of the display element, based on the received operating signal, establish a change in a relative position and/or a position of the real image of the display element, as described by the operating action, and based on the established change in the relative position and/or the position, adapt at least one light wave parameter for at least one light wave to change the interference pattern. ### Claim 18 A display and operating device, comprising: an interference output device configured to, based on an interference pattern signal, generate and output a group of light waves and set a respective at least one light wave parameter for each of the light waves among the group of light waves, so as to generate a light wave interference and output a real image of a display element; and a control device configured to: specify a graphical configuration of the display element to be displayed, based on the specified graphical configuration, ascertain at least one light wave parameter for a respective light wave of the group of light waves, each of the light wave parameters describing a frequency, an amplitude, or a wavelength of the respective light wave, and a totality of the light wave parameters describing an interference pattern which describes an at least partial superposition of the light waves for generating an image representation of the display element, generate the interference pattern signal which describes the totality of the ascertained light wave parameters, transfer the generated interference pattern signal to the interference output device, receive an operating signal from an operating device, the operating signal describing an operating action by a user with respect to the real image of the display element, based on the received operating signal, establish a change in a relative position and/or a position of the real image of the display element, as described by the operating action, and based on the established change in the relative position and/or the position, adapt at least one light wave parameter for at least one light wave to change the interference pattern. ### Claim 19 (depends on 18) The display and operating device according to claim 18, further comprising a contact trigger device configured to generate a field perceivable in a haptic and a tactile fashion in an operating region which is a region reachable by a body part of the user for performing the operating action with respect to the real image of the display element, the contact trigger device including at least one airflow generating element. ### Claim 20 (depends on 18) The display and operating device according to claim 18, further comprising the operating device, wherein the operating device includes a gesture recognition device configured to capture and recognize the operating action in an operating region which is a region reachable by a body part of the user for performing the operating action with respect to the real image of the display element. ### Claim 21 (depends on 17) A motor vehicle, comprising: a chassis; and the control device of claim 17. ### Claim 22 (depends on 21) The motor vehicle according to claim 21, further comprising: a vehicle system including at least one of a climate system, navigation system, or entertainment system, wherein the operating action by the user with respect to the real image of the display element is to select or change a function or setting of the vehicle system. ### Claim 23 (depends on 18) A motor vehicle, comprising: a chassis; and the display and operating device of claim 18. ### Claim 24 (depends on 23) The motor vehicle according to claim 23, further comprising: a vehicle system including at least one of a climate system, navigation system, or entertainment system, wherein the operating action by the user with respect to the real image of the display element is to select or change a function or setting of the vehicle system. ### Claim 25 (depends on 24) The motor vehicle according to claim 24, wherein the display and operating device further comprises a contact trigger device configured to generate a field perceivable in a haptic and a tactile fashion in an operating region which is a region reachable by a body part of the user for performing the operating action with respect to the real image of the display element. ### Claim 26 (depends on 24) The motor vehicle according to claim 24, wherein the display and operating device further comprises the operating device, and the operating device includes a gesture recognition device configured to capture and recognize the operating action in an operating region which is a region reachable by a body part of the user for performing the operating action with respect to the real image of the display element.