# US 2014/0152551 A1 · Vehicle gesture recognition system and method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0152551 A1 - Document ID: US20140152551A1 - Status: Published application - Kind: A1 - Application number: 14/091,281 - Filed: 2013-11-26 - Published: 2014-06-05 - Earliest claimed: 2012-11-30 - Assignees: Harman Becker Automotive Systems GmbH - Applicants: Harman Becker Automotive Systems GmbH - Inventors: Florian Mueller; Peter Wagner - Web page: https://patentgrep.com/patent/US20140152551A1 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor - G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions - G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness} - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - B60K 35/21: using visual output, e.g. blinking lights or matrix displays - B60K 2360/146: Instrument input by gesture - B60K 2360/1464: 3D-gesture - B60K 2360/21: using cameras - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Embodiments of vehicle gesture recognition systems and methods are disclosed. An example vehicle gesture recognition system comprises a data interface configured for receiving 2d image data from a 2d sensor and/or from a portable device camera via a portable device interface. Additionally or alternatively, the data interface is configured for receiving gesture data indicating a gesture. A vehicle processing unit is configured for controlling user interfacing with a user interface based on the gestures recognized from the 2d image data and/or as indicated by the gesture data. ## Claims ### Claim 1 A vehicle gesture recognition system, comprising: a data interface configured for receiving two-dimensional, 2d, image data of at least one field of view within the vehicle; and a vehicle processing unit configured for recognizing a gesture from the received 2d image data, and controlling user interfacing with a user interface based on the recognized gesture. ### Claim 2 (depends on 1) The vehicle gesture recognition system of claim 1, further comprising: a portable device interface configured for establishing a data connection between a portable device and the data interface, wherein the data interface is configured to receive at least parts of the 2d image data via the data connection from a 2d sensor of the portable device. ### Claim 3 (depends on 2) The vehicle gesture recognition system of claim 2, wherein the portable device interface is configured to releasably mount the portable device in a predetermined position. ### Claim 4 (depends on 1) The vehicle gesture recognition system of claim 1, further comprising at least one 2d sensor configured for providing at least parts of the 2d image data to the data interface. ### Claim 5 (depends on 4) The vehicle gesture recognition system of claim 4, wherein the at least one 2d sensor is selected from the group comprising: an infrared sensor, a 2d optical camera, a capacitive sensor, a magnetic field sensor, an ultrasonic sensor, and a touch pad. ### Claim 6 (depends on 4) The vehicle gesture recognition system of claim 4, wherein the vehicle processing unit is a vehicle head unit, the vehicle head unit comprising a housing, wherein at least one outer surface of the housing is a cover shielding an interior of the vehicle head unit from a passenger compartment of the vehicle and comprising interface elements, and wherein the at least one 2d sensor is located on the at least one outer surface. ### Claim 7 (depends on 6) The vehicle gesture recognition system of claim 6, wherein the field of view of the at least one 2d sensor is orientated substantially perpendicular to the at least one outer surface. ### Claim 8 (depends on 2) The vehicle gesture recognition system of claim 2, wherein the portable device interface is configured to releasably mount the portable device such that the field of view of the at least one 2d sensor and the field of view of the portable device 2d sensor are at least partially overlapping. ### Claim 9 (depends on 8) The vehicle gesture recognition system of claim 8, wherein the portable device interface is configured to releasably mount the portable device such that the field of view of the at least one 2d sensor and the field of view of the portable device 2d sensor enclose an angle of approximately 90°. ### Claim 10 (depends on 3) The vehicle gesture recognition system of claim 3, wherein the vehicle processing unit is configured to recognize the gesture taking into account the predetermined position of the portable device and/or a predetermined position of the at least one 2d sensor. ### Claim 11 (depends on 3) The vehicle gesture recognition system of claim 3, wherein the vehicle processing unit is further configured for determining the predetermined position of the portable device based on the parts of the 2d image data received from the portable device 2d sensor and further based on parts of the 2d image data received from the at least one 2d sensor. ### Claim 12 A vehicle gesture recognition system, comprising: a data interface configured for receiving gesture data, the gesture data indicating a gesture; a portable device interface being configured for establishing a data connection between a portable device and the data interface, wherein the data interface is further configured for receiving the gesture data via the data connection from a portable device application executed on the portable device; and a vehicle processing unit configured for controlling user interfacing with a user interface based on the gesture indicated by the gesture data. ### Claim 13 (depends on 12) The vehicle gesture recognition system of claim 12, wherein the gesture data comprises indicators indicating at least one particular gesture from a predefined set of gestures. ### Claim 14 A method of gesture recognition in a vehicle, comprising: receiving 2d image data of at least one field of view within the vehicle; in a vehicle processing unit recognizing a gesture from the received 2d image data; and in the vehicle processing unit controlling user interfacing with a user interface based on the recognized gesture. ### Claim 15 A method of gesture recognition in a vehicle, comprising: establishing a data connection between a portable device and a portable device interface; receiving gesture data indicating a gesture via the data connection from a portable device application executed on the portable device; and in a vehicle processing unit controlling user interfacing with a user interface based on the gesture indicated by the gesture data.