# US 11,907,432 B2 · User-vehicle interface including gesture control support > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,907,432 B2 - Document ID: US11907432B2 - Status: Granted - Kind: B2 - Application number: 17/637,983 - Filed: 2020-08-20 - Published: 2022-09-01 - Granted: 2024-02-20 - Earliest claimed: 2019-09-06 - Assignees: BAE SYSTEMS plc - Applicants: BAE Systems plc - Inventors: Glenn David Allan - Web page: https://patentgrep.com/patent/US11907432B2 ## CPC - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor - B60K 35/22: Display screens - B60K 35/658: {the instruments being ergonomically adjustable to the user} - B60K 35/81: for controlling displays - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - B60K 2360/11: Instrument graphical user interfaces or menu aspects - B60K 2360/113: Scrolling through menu items - B60K 2360/1464: 3D-gesture - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES ## Abstract There is provided a user-vehicle interface, comprising a gesture control system that is arranged to: sense a direction of a gesture of a user of the vehicle; and process the sensed gesture to control a location of an indicator on a display in accordance with that sensed direction, such that a location of the indicator is arranged to move in accordance with changes in the sensed direction, the indicator being used to show a current position for user interaction with content on the display, and being in a plane in which that content resides. ## Claims ### Claim 1 A user-vehicle interface, comprising: a gesture control system comprising a processor in operative communication with a non-transitory storage medium comprising instructions configured to cause the processor to: sense a direction of a gesture of a user of the vehicle; process the sensed gesture to control a location of an indicator on a display in accordance with that sensed direction, such that a location of the indicator is arranged to move in accordance with changes in the sensed direction, the indicator being used to show a current position for user interaction with content on the display, and being in a plane in which that content resides; and process the sensed gesture to control, on the display, a representation of the sensed direction comprising a linear representation, toward the location of the indicator showing the current position for user interaction with the content, either as part of the displayed indicator, or in addition to the displayed indicator, wherein movement of the indicator is step-wise, and wherein the representation of the sensed direction is configured to appear to the user to originate from a hand or a pointing digit of the hand of the user, outside of the plane in which the content resides. ### Claim 2 (depends on 1) The user-vehicle interface of claim 1, wherein the control is arranged such that the representation of the sensed direction is configured to appear to the user to originate from the general perspective of the user. ### Claim 3 (depends on 1) The user-vehicle interface of claim 1, wherein the control is arranged such that the representation of the sensed direction appears to the user to originate from a general location of a hand or a pointing digit of the hand of the user. ### Claim 4 (depends on 1) The user-vehicle interface of claim 1, wherein the representation of the sensed direction comprises a linear representation. ### Claim 5 (depends on 1) The user-vehicle interface of claim 1, wherein the gesture control system is arranged to sense a direction of the gesture of the user, in the form of a direction of a hand gesture, or in the form of a direction of a point of a digit of the user's hand. ### Claim 6 (depends on 1) The user-vehicle interface of claim 1, wherein the control is such that a location of the indicator is arranged to move in accordance with changes in the sensed direction. ### Claim 7 (depends on 1) The user-vehicle interface of claim 1, wherein the control is such that a location of the indicator is arranged to move in accordance with changes in the sensed direction, according to a scaling factor, such that: the scaling factor is substantially 1:1, such that a degree of movement of the indicator substantially equates to a degree of changes in the sensed direction; or the scaling factor is X:1, where X is greater than 1, such that a degree of movement of the indicator is greater than a degree of changes in the sensed direction; or the scaling factor is 1:X, where X is greater than 1, such that a degree of movement of the indicator is smaller than a degree of changes in the sensed direction. ### Claim 8 (depends on 1) The user-vehicle interface of claim 1, wherein the control is such that a location of the indicator is arranged to be in alignment with the sensed direction. ### Claim 9 (depends on 1) The user-vehicle interface of claim 1, wherein the control is such that a location of the indicator is arranged to be offset from the sensed direction. ### Claim 10 (depends on 1) The user-vehicle interface of claim 1, further comprising an engagement input device for a user to use in order to engage with content coinciding with a location of the indicator. ### Claim 11 (depends on 1) The user-vehicle interface of claim 1, further comprising the display, the display being arranged to be visible to the user of the vehicle, and to display content to the user. ### Claim 12 (depends on 11) The user-vehicle interface of claim 11, wherein the display is: a user, head-mounted, display; and/or a display that is fixed to or relative to the vehicle. ### Claim 13 (depends on 1) The user-vehicle interface of claim 1, wherein the control is arranged such that the representation of the sensed direction appears to the user to originate from a general location of a body part used in the gesture. ### Claim 14 A user-vehicle interfacing method, comprising: sensing a direction of a gesture of a user of the vehicle; and controlling a location of an indicator on a display in accordance with that sensed direction, such that a location of the indicator is arranged to move in accordance with changes in the sensed direction, the indicator being used to show a current position for user interaction with content on the display, and being in a plane in which that content resides; and controlling, on the display, a representation of the sensed direction comprising a linear representation, toward the location of the indicator showing the current position for user interaction with the content, either as part of the displayed indicator, or in addition to the displayed indicator, wherein movement of the indicator is step-wise, and wherein the representation of the sensed direction is configured to appear to the user to originate from a hand or a pointing digit of the hand of the user, outside of the plane in which the content resides. ### Claim 15 (depends on 1) A vehicle, which: comprises the user-vehicle interface of claim 1; and is configured to implement a user-vehicle interfacing method, the method comprising: sensing a direction of a gesture of a user of the vehicle; controlling a location of an indicator on a display in accordance with that sensed direction, such that a location of the indicator is arranged to move in accordance with changes in the sensed direction, the indicator being used to show a current position for user interaction with content on the display, and being in a plane in which that content resides; and controlling, on the display, a representation of the sensed direction comprising a linear representation, toward the location of the indicator showing the current position for user interaction with the content, either as part of the displayed indicator, or in addition to the displayed indicator, wherein movement of the indicator is step-wise, wherein the representation of the sensed direction is configured to appear to the user to originate from a hand or a pointing digit of the hand of the user, outside of the plane in which the content resides. ### Claim 16 A user-vehicle interface, comprising: a gesture control system comprising a processor in operative communication with a non-transitory storage medium comprising instructions configured to cause the processor to: sense a direction of a gesture of a user of the vehicle; process the sensed gesture to control a location of an indicator on a display in accordance with that sensed direction, such that a location of the indicator is arranged to move in accordance with changes in the sensed direction, the indicator being used to show a current position for user interaction with content on the display, and being in a plane in which that content resides; and process the sensed gesture to control, on the display, a representation of the sensed direction comprising a linear representation, toward the location of the indicator showing the current position for user interaction with the content, either as part of the displayed indicator, or in addition to the displayed indicator, wherein movement of the indicator is step-wise, and wherein the location of the indicator is limited to a portion of the display, and wherein the representation of the sensed direction is configured to appear to the user to originate from a hand or a pointing digit of the hand of the user, outside of the plane in which the content resides. ### Claim 17 (depends on 16) The user-vehicle interface of claim 16, wherein movement of the indicator is in discrete steps and to snap from one display region to another display region. ### Claim 18 (depends on 17) The user-vehicle interface of claim 17, wherein the indicator is configured to snap from content to content. ### Claim 19 (depends on 17) The user-vehicle interface of claim 17, wherein the indicator is configured to move in discrete steps during periods of sharp movements and/or bouncing and to otherwise move continuously and proportionally in accordance with changes in the sensed direction.