# US 10,871,848 B2 · Method and apparatus for variable impedence touch sensor array gesture recognition > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,871,848 B2 - Document ID: US10871848B2 - Status: Granted - Kind: B2 - Application number: 16/384,331 - Filed: 2019-04-15 - Published: 2020-03-19 - Granted: 2020-12-22 - Earliest claimed: 2018-09-13 - Assignees: Sensel, Inc. - Applicants: Sensel, Inc. - Inventors: John Aaron Zarraga; Alexander Meagher Grau; Bethany Noel Haniger; Bradley James Bozarth; Brogan Carl Miller; Ilya Daniel Rosenberg; James Frank Thomas; Mark Joshua Rosenberg; Peter Hans Nyboer; Reuben Eric Martinez; Scott Gregory Isaacson; Stephanie Jeanne Oberg; Timothy James Miller; Tomer Moscovich; Yibo Yu - Web page: https://patentgrep.com/patent/US10871848B2 ## CPC - G06F 3/04146: {using pressure sensitive conductive elements delivering a boolean signal and located between crossing sensing lines, e.g. located between X and Y sensing line layers} - G06F 3/0412: {Digitisers structurally integrated in a display} - G06F 3/0416: {Control or interface arrangements specially adapted for digitisers} - G06F 3/0446: {using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 2203/04104: Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract The present invention relates to touch sensor detector systems and methods incorporating an interpolated variable impedance touch sensor array and specifically to such systems and methods for gesture recognition and associating a UI element with the recognized gesture. In one embodiment, the present invention provides a variable impedance array (VIA) system for receiving a gesture that includes: a plurality of physical VIA columns connected by interlinked impedance columns; a plurality of physical VIA rows connected by interlinked impedance rows; and a processor configured to interpolate a location and/or pressure of the gesture in the physical columns and rows from an electrical signal from a plurality of column drive sources (connected to the plurality of physical VIA columns through the interlinked impedance columns) sensed at a plurality of row sense sinks (connected to the plurality of physical VIA rows through the interlinked impedance rows). ## Claims ### Claim 1 A gesture-recognition interpolated variable impedance array (VIA) system for receiving a gesture formed on or about a sensor panel comprising: a plurality of physical VIA columns connected by interlinked impedance columns; a plurality of physical VIA rows connected by interlinked impedance rows; a plurality of column drive sources connected to the interlinked impedance columns and to the plurality of physical VIA columns through the interlinked impedance columns; a plurality of row sense sinks connected to the interlinked impedance rows and to the plurality of physical VIA rows through the interlinked impedance rows; and a processor configured to: interpolate a location of the gesture in the physical VIA columns and physical VIA rows from an electrical signal from the plurality of column drive sources sensed at the plurality of row sense sinks, detect two or more touches of the gesture at a first time at the sensor panel, determine that the two or more touches at the first time are arranged in a pattern corresponding to a predetermined see-saw gesture, determine a relative pressure between the two or more touches from the electrical signal from the plurality of column drive sources sensed at the plurality of row sense sinks, associate the gesture with a user interface (UI) element, the UI element accepting an adjustment input based on the relative pressure between the two or more touches, and provide a confirming input to the UI element based on the relative pressure between the two or more touches. ### Claim 2 (depends on 1) The system of claim 1 wherein the processor is further configured to determine the relative pressure between the two or more touches from the electrical signal from the plurality of column drive sources sensed at the plurality of row sense sinks. ### Claim 3 (depends on 1) The system of claim 1 wherein the processor is further configured to determine at least one of: a touch pattern of the gesture based on one or more touch points in contact with the sensor panel, a pressure response pattern at the one or more touch points over time from the electrical signal from the plurality of column drive sources sensed at the plurality of row sense sinks, and a gesture pattern corresponding to the touch pattern and the pressure response pattern. ### Claim 4 (depends on 1) The system of claim 1 wherein the processor is further configured to determine a pressure response for the gesture from the electrical signal from the plurality of column drive sources sensed at the plurality of row sense sinks. ### Claim 5 (depends on 4) The system of claim 4 wherein the processor is further configured to provide adjustment information to a coupled device based on a gesture location and the pressure response. ### Claim 6 (depends on 1) The system of claim 1 wherein the processor is further configured to determine a relative orientation of a plurality of fingers used in the gesture from the electrical signal from the plurality of column drive sources sensed at the plurality of row sense sinks and the relative pressure applied by the plurality of fingers from the electrical signal from the plurality of column drive sources sensed at the plurality of row sense sinks. ### Claim 7 (depends on 1) The system of claim 1 wherein the processor is further configured to determine a continuous pressure change at one or more touch points of the gesture on the sensor panel from the electrical signal from the plurality of column drive sources sensed at the plurality of row sense sinks and to cause a user interface (UI) element to provide visual feedback based on continuous pressure at the one or more touch points. ### Claim 8 (depends on 1) The system of claim 1 wherein the processor is further configured to determine a pattern of touches of one or more points in contact with the sensor panel in the gesture instantaneously or over time and to determine a pressure at the one or more points in contact with the sensor panel instantaneously or over time. ### Claim 9 (depends on 1) The system of claim 1 wherein the processor is further configured to determine a pressure pattern over time from the electrical signal from the plurality of column drive sources sensed at the plurality of row sense sinks. ### Claim 10 A system for determining a gesture formed on or about a sensor panel comprising: a variable impedance array (VIA); an array column driver; an array row sensor; and a processor, wherein the VIA comprises interlinked impedance columns coupled to the array column driver and interlinked impedance rows coupled to the array row sensor, wherein the array column driver is configured to select the interlinked impedance columns based on a column switching register and electrically drive the interlinked impedance columns using a column driving source, wherein the VIA conveys current from the driven interlinked impedance columns to the interlinked impedance columns which are sensed by the array row sensor[M wherein the array row sensor selects the interlinked impedance rows and electrically senses a state of the interlinked impedance rows based on a row switching register, and wherein the processor is configured to: interpolate a location of the gesture from the state of the interlinked impedance rows sensed by array row sensor, detect two or more touches of the gesture at a first time at the sensor panel, determine that the two or more touches at the first time are arranged in a pattern corresponding to a predetermined see-saw gesture, determine a relative pressure between the two or more touches from an electrical signal from a plurality of column driver sources sensed at the plurality of row sense sinks, associate the gesture with a user interface (UI) element, the UI element accepting an adjustment input based on the relative pressure between the two or more touches, and provide a confirming input to the UI element based on the relative pressure between the two or more touches. ### Claim 11 (depends on 10) The system of claim 10 wherein the processor is further configured to determine the relative pressure between the two or more touches from the electrical signal from the state of the interlinked impedance rows sensed by array row sensor. ### Claim 12 (depends on 10) The system of claim 10 wherein the processor is further configured to determine at least one of: a touch pattern of the gesture of one or more points in contact with the sensor panel, a pressure response pattern at the one or more touch points over time from the state of the interlinked impedance rows sensed by array row sensor, and a gesture pattern corresponding to the touch pattern and the pressure response pattern. ### Claim 13 (depends on 10) The system of claim 10 wherein the processor is further configured to determine a pressure response for the gesture from the state of the interlinked impedance rows sensed by array row sensor. ### Claim 14 (depends on 13) The system of claim 13 wherein the processor is further configured to provide adjustment information to a coupled device based on a gesture location and the pressure response. ### Claim 15 (depends on 10) The system of claim 10 wherein the processor is further configured to determine a relative orientation of a plurality of fingers used in the gesture from the state of the interlinked impedance rows sensed by array row sensor and the relative pressure applied by the plurality of fingers from the state of the interlinked impedance rows sensed by array row sensor. ### Claim 16 (depends on 10) The system of claim 10 wherein the processor is further configured to: determine a continuous pressure change at one or more points of the gesture on the sensor panel from the state of the interlinked impedance rows sensed by array row sensor and cause a user interface (UI) element to provide visual feedback based on the continuous pressure at the one or more points. ### Claim 17 (depends on 10) The system of claim 10 wherein the processor is further configured to determine a pattern of touches of one or more points in contact with the sensor panel in the gesture instantaneously or over time and to determine a pressure at the one or more points in contact with the sensor panel instantaneously or over time. ### Claim 18 A gesture-recognition interpolated variable impedance array comprising: a sensor panel; and a processor configured to: receive a gesture formed on or about the sensor panel, wherein the sensor panel comprises a grid of sensing elements that are configured to: power on simultaneously, and simultaneously generate multiple currents along multiple current paths in response to sensing a touch wherein an amount of current generated by a sensing element of the grid is directly proportional to a force applied by the touch, detect two or more touches of the gesture at a first time at the sensor panel, determine that the two or more touches at the first time are arranged in a pattern corresponding to a predetermined see-saw gesture, determine a relative pressure between the two or more touches from an electrical signal from a plurality of column drive sources sensed at the plurality of row sense sinks, associate the gesture with a user interface (UI) element, the UI element accepting an adjustment input based on the relative pressure between the two or more touches, and provide a confirming input to the UI element based on the relative pressure between the two or more touches.