# US 8,049,730 B2 · Devices and methods of controlling manipulation of virtual objects on a multi-contact tactile screen > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,049,730 B2 - Document ID: US8049730B2 - Status: Granted - Kind: B2 - Application number: 10/590,306 - Filed: 2005-02-23 - Published: 2007-08-23 - Granted: 2011-11-01 - Earliest claimed: 2004-02-23 - Assignees: Stantum - Inventors: Pascal Joguet; Guillaume Largillier - Web page: https://patentgrep.com/patent/US8049730B2 ## CPC - G06F 3/045: using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact - G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means - G06F 3/047: using sets of wires, e.g. crossed wires - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus - G10H 1/055: by switches with variable impedance elements - G10H 1/34: Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments - G06F 2203/04104: Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger - G10H 2220/096: using a touch screen - G10H 2220/241: on touchscreens, i.e. keys, frets, strings, tablature or staff displayed on a touchscreen display for note input purposes - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE ## Abstract A process for controlling computerized equipment with a device including a multi-contact bidimensional sensor that acquires tactile information and a calculator that generates command signals as a function of the tactile information, including graphical objects on a screen placed under a transparent multi-contact tactile sensor, each graphical object associated with at least one specific processing rule such that the sensor delivers during each acquisition phase a plurality of tactile information, and each piece of the tactile information forms an object of a specific processing determined by its localization relative to a position of one of the graphical objects. ## Claims ### Claim 1 A method for controlling a computerized device by a multi-contact touch screen, the method comprising: displaying first and second graphical objects on the multi-contact touch screen at first and second object positions, respectively; associating first and second specific processing rules to the first and second graphical objects, respectively; detecting first and second touch points on the multi-contact touch screen and defining first and second touch positions for the first and second touch points, respectively; applying the first specific processing rule of the first graphical object as a function of a relative position between the first touch position and the first object position; applying the second specific processing rule of the second graphical object as a function of a relative position between the second touch position and the second object position; modifying at least one of the first graphical object or the first object position based on a result of said applying the first specific processing rule; and modifying at least one of the second graphical object or the second object position based on a result of said applying the second specific processing rule. ### Claim 2 (depends on 1) The method according to claim 1, wherein said step of detecting further comprises: sequentially scanning rows and columns of the multi-contact touch screen. ### Claim 3 (depends on 1) The method according to claim 1, wherein the calculating step further includes: generating first and second contact zones from the first and the second touch points; first calculating a bounding zone for the first and second contact zones; and second calculating a cursor position for first and second contact zones. ### Claim 4 (depends on 3) The method according to claim 3, wherein said step of second calculating further calculates the cursor position based on a barycenter of the bounding zone. ### Claim 5 (depends on 1) The method according to claim 1, wherein said step of detecting further comprises: measuring an electrical characteristic of row-column intersections by sequentially scanning rows and columns of the multi-contact touch screen. ### Claim 6 (depends on 5) The method according to claim 5, wherein said electrical characteristic is a voltage. ### Claim 7 (depends on 1) The method according to claim 1, wherein the first specific processing rule is different from the second specific processing rule, and the first specific processing rule is not applied to the second graphical object. ### Claim 8 (depends on 1) The method according to claim 1, wherein the first specific processing rule defines an interaction law between a cursor and the first graphical object. ### Claim 9 (depends on 8) The method according to claim 8, wherein the interaction law includes a physical law. ### Claim 10 (depends on 9) The method according to claim 9, wherein the physical law is a spring-loaded system. ### Claim 11 (depends on 9) The method according to claim 9, wherein the physical law is a vibration of a string. ### Claim 12 (depends on 9) The method according to claim 9, wherein the physical law is a law of gravity associated to the first graphical object. ### Claim 13 (depends on 9) The method according to claim 9, wherein the physical law is an electromagnetic law. ### Claim 14 (depends on 9) The method according to claim 9, wherein the physical law is a principle of inertia. ### Claim 15 (depends on 9) The method according to claim 9, wherein the physical law manages a collision between the first and second graphical object. ### Claim 16 (depends on 9) The method according to claim 9, wherein the interaction law includes interaction between the first graphical object and another graphical object, the first graphical object located inside the another graphical object. ### Claim 17 (depends on 16) The method according to claim 16, wherein the interaction between the first graphical object inside the another graphical object is based on a coefficient of friction. ### Claim 18 (depends on 16) The method according to claim 16, wherein the interaction between the first graphical object inside the another graphical object is based on a rebound. ### Claim 19 (depends on 16) The method according to claim 16, wherein the interaction between the first graphical object inside the another graphical object is based on an attraction. ### Claim 20 (depends on 1) The method according to claim 1, wherein the first specific processing rule includes a pressure measurement. ### Claim 21 (depends on 1) The method according to claim 1, wherein the first specific processing rule takes into account a speed of a movement of the first touch position relative to the multi-contact touch screen. ### Claim 22 (depends on 1) The method according to claim 1, wherein the first specific processing rule takes into account an acceleration of a movement of the first touch position relative to the multi-contact touch screen. ### Claim 23 (depends on 1) The method according to claim 1, wherein the first specific processing rule takes into account a trajectory of a movement of the first touch position. ### Claim 24 (depends on 23) The method according to claim 23, wherein the first specific processing rule performs a shape recognition of the trajectory of the movement of the first touch position. ### Claim 25 A device to control a computerized apparatus comprising: memory to store first and second graphical objects and first and second specific processing rules that are associated to the first and the second graphical objects, respectively; a multi-contact touch screen to detect first and second touch points on the multi-contact touch screen and defining a first and a second touch position for the first and the second touch points, respectively; a graphic display unit to display the first and second graphical objects at a first and a second object position, respectively; and a processor configured to apply the first specific processing rule associated to the first graphical object as a function of a relative position between the first touch position and the first object position, configured to apply the second specific processing rule associated to the second graphical object as a function of a relative position between the second touch position and the second object position, configured to modify at least one of the first graphical object or the first object position based on a result of said processing said first specific processing rule, and configured to modify at least one of the second graphical object or the second object position based on a result of said processing said second specific processing rule. ### Claim 26 (depends on 25) The device according to claim 25, wherein the multi-contact touch screen comprises: a transparent matrix sensor. ### Claim 27 (depends on 26) The device according to claim 26, wherein the transparent matrix sensor includes an array of a plurality of conductive rows and columns. ### Claim 28 (depends on 27) The device according to claim 27, wherein the conductive rows and columns are made of Indium Tin Oxyde (ITO). ### Claim 29 (depends on 27) The device according to claim 27, wherein the conductive rows are insulated from the conductive columns by an insulation layer. ### Claim 30 (depends on 25) The device according to claim 25, further comprising: a controller configured to sequentially scan rows and columns of the matrix sensor to measure an electrical characteristic of row-column intersections to detect the first and the second touch points. ### Claim 31 (depends on 30) The device according to claim 30, wherein the electrical characteristic of row-column intersections is a voltage. ### Claim 32 (depends on 25) The device according to claim 25, wherein the processor is further configured to generate first and second contact zones from the first and second touch points, respectively, configured to calculate a bounding zone for the first and second contact zone, and configured to calculate a cursor position for the contact zone. ### Claim 33 (depends on 32) The device according to claim 32, wherein said processor is further configured to calculate the cursor position based on a barycenter of the bounding zone. ### Claim 34 (depends on 25) The device according to claim 25, wherein the first specific processing rule is different from the second specific processing rule, and the first specific processing rule is not applied to the second graphical object. ### Claim 35 (depends on 25) The device according to claim 25, further comprising: a switch configured to switch between a graphical user interface that includes the first and the second graphical objects, to another graphical user interface. ### Claim 36 (depends on 35) The device according to claim 35, wherein the switch is a button. ### Claim 37 (depends on 35) The device according to claim 35, wherein the switch is a control pedal board. ### Claim 38 A method for controlling a computerized device by a multi-contact touch screen, the method comprising: displaying first and second graphical objects on the multi-contact touch screen at first and second object positions, respectively; associating first and second specific processing rules to the first and second graphical objects, respectively; detecting a touch zone including first and second touch points on the multi-contact touch screen and defining a zone position for the touch zone based on a location of both the first and second touch points; detecting a third touch point on the multi-contact touch screen and defining a touch position for the third touch point; applying the first specific processing rule of the first graphical object as a function of a relative position between the zone position and the first object position; applying the second specific processing rule of the second graphical object as a function of a relative position between the touch position and the second object position; modifying at least one of the first graphical object or the first object position based on a result of said applying the first specific processing rule; and modifying at least one of the second graphical object or the second object position based on a result of said applying the second specific processing rule.