# US 10,372,270 B2 · Ultrasonic haptic control system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,372,270 B2 - Document ID: US10372270B2 - Status: Granted - Kind: B2 - Application number: 15/661,287 - Filed: 2017-07-27 - Published: 2018-02-22 - Granted: 2019-08-06 - Earliest claimed: 2016-08-17 - Assignees: Ford Global Technologies, LLC - Applicants: Ford Global Technologies, LLC - Inventors: Marcus Hoggarth; Jasper Dekker; Edward Rose - Web page: https://patentgrep.com/patent/US10372270B2 ## CPC - G06F 3/043: using propagating acoustic waves - B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor - B60K 35/211: {producing three-dimensional [3D] effects, e.g. stereoscopic images} - B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10) - B60K 35/80: Arrangements for controlling instruments - B60K 37/00: Dashboards (as road-vehicle superstructure sub-units B62D25/14) - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - B60K 35/25: using haptic output - B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions - B60K 35/50: Instruments characterised by their means of attachment to or integration in the vehicle (B60K35/231 takes precedence) - B60K 2360/141: Activation of instrument input devices by approaching fingers or pens - B60K 2360/146: Instrument input by gesture - B60K 2360/1464: 3D-gesture - B60K 2360/1868: according to driving situations - B60K 2360/782: on the steering wheel - G06T 2207/10016: Video; Image sequence - G06T 2207/30196: Human being; Person - G06T 2207/30268: Vehicle interior - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An ultrasonic haptic control system for a motor vehicle is provided. The system includes a steering wheel assembly comprising a ring-shaped member configured to be held by an occupant of the vehicle, and rotated about a central axis in order to steer the vehicle; and a plurality of ultrasound emitters associated with the steering wheel. The ultrasound emitters are configured to focus ultrasound waves within a central region about which the ring-shaped member circumferentially extends and/or radially outside of and adjacent to the ring-shaped member. The focused ultrasound waves are configured to form one or more haptic control surfaces. A method of operating a haptic control system is also provided. ## Claims ### Claim 1 An ultrasonic haptic control system for a motor vehicle, comprising: a steering wheel assembly comprising a ring-shaped member rotatable about a central axis to steer the vehicle; and a plurality of ultrasound emitters associated with the steering wheel and configured to focus ultrasound waves within a central region about which the ring-shaped member circumferentially extends and/or radially outside of and adjacent to the ring-shaped member to form one or more haptic control surfaces, wherein the plurality of ultrasound emitters emit ultrasound waves having a tangential component. ### Claim 2 (depends on 1) The ultrasonic haptic control system of claim 1, wherein one or more of the ultrasound emitters are provided in an array of ultrasound emitters on a trim portion of the vehicle, the array of ultrasound emitters being configured to project ultrasound towards the steering wheel. ### Claim 3 (depends on 1) The ultrasonic haptic control system of claim 1, wherein one or more of the ultrasound emitters are provided on the ring-shaped member. ### Claim 4 (depends on 1) The ultrasonic haptic control system of claim 1, wherein the steering wheel comprises a further ring-shaped member offset from the ring-shaped member along the central axis, wherein one or more of the ultrasound emitters are provided on the further ring-shaped member. ### Claim 5 (depends on 1) The ultrasonic haptic control system of claim 1, wherein the system further comprises a camera configured to capture an image of a hand or fingers of the occupant. ### Claim 6 (depends on 1) The ultrasonic haptic control system of claim 1, wherein the system is configured to determine a position of the occupant's hand or fingers relative to locations at which the haptic control surfaces are formed. ### Claim 7 (depends on 6) The ultrasonic haptic control system of claim 6, wherein the system is configured to provide the haptic control surfaces when the occupant's hand or fingers are within a threshold distance of the locations at which the haptic control surfaces are formed; and wherein the system is configured not to provide the haptic control surfaces when the occupant's hand or fingers are not within the threshold distance of the locations. ### Claim 8 (depends on 6) The ultrasonic haptic control system of claim 6, wherein the system is configured to control the operation of the ultrasound emitters to control the position and/or haptic qualities of the haptic control surfaces according to the position of the occupant's hand or fingers, and wherein the system is configured to determine a control input based on the position of the occupant's hand or fingers. ### Claim 9 (depends on 1) The ultrasonic haptic control system of claim 1, wherein the steering wheel is movable within the vehicle, such that the ring-shaped member central axis is movable between first and second positions, wherein the haptic control system is configured such that the haptic control surfaces remain stationary relative to the ring-shaped member central axis as the ring-shaped member moves. ### Claim 10 (depends on 1) The ultrasonic haptic control system of claim 1, wherein the haptic control system is configured such that one or more of the haptic control surfaces do not rotate as the ring-shaped member rotates about the central axis. ### Claim 11 (depends on 1) The ultrasonic haptic control system of claim 1, wherein the haptic control system is configured such that one or more of the haptic control surfaces rotate together with the ring-shaped member as the ring-shaped member rotates about the central axis. ### Claim 12 (depends on 1) The ultrasonic haptic control system of claim 1, wherein the ultrasound emitters are configured to move together within the ring-shaped member such that the haptic control surfaces remain stationary relative to the ring-shaped member central axis, as the ring-shaped member moves. ### Claim 13 (depends on 1) The ultrasonic haptic control system of claim 1, wherein the steering wheel is movable between a first position and a second position; wherein the ultrasound emitters are configured to produce the haptic control surfaces when the steering wheel is positioned at or close to the first position; and wherein the haptic control system comprises a plurality of further ultrasound emitters configured to produce the haptic control surfaces when the steering wheel is positioned at or close to the second position. ### Claim 14 (depends on 6) The ultrasonic haptic control system according to claim 6, wherein the system further comprises a holographic projector configured to produce a holographic image within or adjacent to the ring-shaped member; wherein the holographic image provides one or more visual representations of controls of the vehicle corresponding to one or more of the haptic control surfaces; and wherein the holographic projector is configured such that one or more of the visual representations are visible when the occupant's hand or fingers are within a threshold distance of the corresponding haptic control surface and are substantially invisible when the occupant's hand or fingers are not within the threshold distance of the corresponding haptic control surface. ### Claim 15 (depends on 14) The ultrasonic haptic control system of claim 14, wherein the haptic control surfaces are provided with corresponding visual representations according to a controls setting, and wherein the holographic projector is configured such that the visual representations remain stationary relative to the haptic control surfaces as the ring-shaped member moves. ### Claim 16 (depends on 14) The ultrasonic haptic control system of claim 14, wherein the steering wheel is movable between a first position and a second position; wherein the holographic projector is configured to produce the visual representations when the steering wheel is positioned at or close to the first position; and wherein the haptic control system comprises a further holographic projector configured to produce the visual representations when the steering wheel is positioned at or close to the second position. ### Claim 17 (depends on 14) The ultrasonic haptic control system of claim 14, wherein the system further comprises a controller configured to control the operation of the ultrasound emitters to provide the haptic control surfaces, and wherein the controller is further configured to control the operation of the holographic projector. ### Claim 18 A method of operating a haptic control system for a motor vehicle, comprising: providing a steering wheel comprising a ring-shaped member configured to be held by an occupant of the vehicle; providing a plurality of ultrasound emitters associated with the steering wheel; and focusing ultrasound waves from the ultrasound emitters to produce one or more haptic control surfaces within or adjacent to the ring-shaped member, wherein the plurality of ultrasound emitters emit ultrasound waves having a tangential component. ### Claim 19 (depends on 18) The method of claim 18 further comprising: capturing an image of a hand or fingers of the occupant; determining a position of the occupant's hand or fingers relative to the haptic control surfaces; controlling the position and/or haptic qualities of the haptic control surfaces according to the position of the occupant's hand or fingers; and determining a control input based on the position of the occupant's hand or fingers. ### Claim 20 (depends on 18) The method of any of claim 18, wherein the system further comprises a holographic projector, and wherein the method further comprises: projecting a holographic image within or adjacent to the ring-shaped member, the holographic image configured to represent one or more controls of the vehicle; and adjusting the holographic image to represent a further control corresponding to a haptic control surface when the occupant's hand or fingers are within a threshold distance of the haptic control surface.