# US 11,029,661 B2 · Remote user interface actuation using a piezoelectric grid > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,029,661 B2 - Document ID: US11029661B2 - Status: Granted - Kind: B2 - Application number: 16/291,558 - Filed: 2019-03-04 - Published: 2019-06-27 - Granted: 2021-06-08 - Earliest claimed: 2016-11-21 - Assignees: Avaya Inc. - Applicants: Avaya Inc. - Inventors: Shahid Mahmood - Web page: https://patentgrep.com/patent/US11029661B2 ## CPC - G05B 19/0428: {Safety, monitoring (G05B19/0423 takes precedence)} - G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 11/00: Error detection; Error correction; Monitoring (error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00) - G06F 11/2221: {to test input/output devices or peripheral units} - G06F 11/3688: {for test execution, e.g. scheduling of test suites} - G05B 2219/23258: GUI graphical user interface, icon, function bloc editor, labview - G05B 2219/24048: Remote test, monitoring, diagnostic - G06F 2203/04105: Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position - G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Embodiments disclosed herein provide systems, methods, and computer-readable media to remotely actuate a user interface of a computing device. In a particular embodiment, a method includes receiving actuation information for a targeted portion of the user interface and determining control signals for a piezoelectric grid. The control signals direct application of electricity to the piezoelectric grid to deform the piezoelectric grid for actuation of the targeted portion of the user interface. The method further includes transferring the control signals to the piezoelectric grid. ## Claims ### Claim 1 A method of remotely actuating a user interface of a computing device, the method comprising: receiving actuation information for a targeted portion of the user interface; determining control signals for a piezoelectric grid that direct application of electricity to the piezoelectric grid to deform the piezoelectric grid for actuation of the targeted portion of the user interface; and transferring the control signals to the piezoelectric grid. ### Claim 2 (depends on 1) The method of claim 1, wherein the control signals provide an electrical charge to an area of the piezoelectric grid mapped to the targeted portion of the user interface. ### Claim 3 (depends on 2) The method of claim 2, wherein the control signals provide the electrical charge to the area of the piezoelectric grid mapped to the targeted portion of the user interface by providing an electrical field of sufficient strength to effectuate actuation of the targeted portion of the user interface. ### Claim 4 (depends on 1) The method of claim 1, further comprising: generating a control mapping of one or more areas of the piezoelectric grid to respective one or more portions, including the targeted portion, of the user interface. ### Claim 5 (depends on 4) The method of claim 4, wherein determining the control signals comprises: determining which of the one or more areas of the piezoelectric grid corresponds to the targeted portion of the user interface. ### Claim 6 (depends on 4) The method of claim 4, wherein the one or more portions of the user interface comprise one or more buttons of the user interface. ### Claim 7 (depends on 4) The method of claim 4, wherein the one or more portions of the user interface comprise one or more device actuators of the user interface. ### Claim 8 (depends on 4) The method of claim 4, wherein the one or more portions of the user interface comprise one or more locations on a touch screen. ### Claim 9 (depends on 1) The method of claim 1, wherein the actuation information is further for a second targeted portion of the user interface and wherein the control signals further direct application of electricity to the piezoelectric grid to deform the piezoelectric grid for actuation of the second targeted portion of the user interface. ### Claim 10 A system to facilitate remote actuation of a user interface of a computing device, the system comprising: one or more computer-readable storage media; a processing system operatively coupled with the one or more computer-readable storage media; and program instructions stored on the one or more computer-readable storage media that, when read and executed by the processing system, direct the processing system to: receive actuation information for a targeted portion of the user interface; determine control signals for a piezoelectric grid that direct application of electricity to the piezoelectric grid to deform the piezoelectric grid for actuation of the targeted portion of the user interface; and transfer the control signals to the piezoelectric grid. ### Claim 11 (depends on 10) The system of claim 10, wherein the control signals provide an electrical charge to an area of the piezoelectric grid mapped to the targeted portion of the user interface. ### Claim 12 (depends on 11) The system of claim 11, wherein the control signals provide the electrical charge to the area of the piezoelectric grid mapped to the targeted portion of the user interface by providing an electrical field of sufficient strength to effectuate actuation of the targeted portion of the user interface. ### Claim 13 (depends on 10) The system of claim 10, wherein the program instructions further direct the processing system to: generate a control mapping of one or more areas of the piezoelectric grid to respective one or more portions, including the targeted portion, of the user interface. ### Claim 14 (depends on 13) The system of claim 13, wherein to determine the control signals, the program instructions direct the processing system to: determine which of the one or more areas of the piezoelectric grid corresponds to the targeted portion of the user interface. ### Claim 15 (depends on 13) The system of claim 13, wherein the one or more portions of the user interface comprise one or more buttons of the user interface. ### Claim 16 (depends on 13) The system of claim 13, wherein the one or more portions of the user interface comprise one or more device actuators of the user interface. ### Claim 17 (depends on 13) The system of claim 13, wherein the one or more portions of the user interface comprise one or more locations on a touch screen. ### Claim 18 (depends on 10) The system of claim 10, wherein the actuation information is further for a second targeted portion of the user interface and wherein the control signals further direct application of electricity to the piezoelectric grid to deform the piezoelectric grid for actuation of the second targeted portion of the user interface. ### Claim 19 An apparatus for remote actuation of a user interface of a computing device, the apparatus comprising: a piezoelectric grid comprising a mesh of piezoelectric material that deforms upon application of electricity; and wherein the piezoelectric grid, when the mesh is installed onto a surface of the user interface, receives control signals to actuate a targeted portion of the user interface. ### Claim 20 (depends on 19) The apparatus of claim 19, wherein the control signals comprise an electrical charge to an area of the mesh mapped to the targeted portion of the user interface.