# US 2009/0244033 A1 · Contact tracking and identification module for touch sensing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0244033 A1
- Document ID: US20090244033A1
- Status: Published application
- Kind: A1
- Application number: 12/479,678
- Filed: 2009-06-05
- Published: 2009-10-01
- Earliest claimed: 1998-01-26
- Assignees: Apple Inc.
- Inventors: Wayne WESTERMAN; John G. Elias
- Web page: https://patentgrep.com/patent/US20090244033A1

## CPC

- G06F 3/0446: {using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes}
- G06F 3/0235: {using chord techniques (G06F3/0234 takes precedence)}
- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 3/0412: {Digitisers structurally integrated in a display}
- G06F 3/04166: {Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving (Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184)}
- G06F 3/04186: {Touch location disambiguation}
- G06F 3/0447: {Position sensing using the local deformation of sensor cells}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/0485: Scrolling or panning
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 18/24137: {Distances to cluster centroïds}
- G06V 30/19173: {Classification techniques}
- G06V 30/1983: {Syntactic or structural pattern recognition, e.g. symbolic string recognition}
- G06V 40/107: {Static hand or arm}
- H03K 17/9622: {using a plurality of detectors, e.g. keyboard}
- G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
- G06F 2203/04104: Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
- G06F 2203/04106: Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
- G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
- H03K 2217/960725: Charge-transfer
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H03K: PULSE TECHNIQUE (measuring pulse characteristics G01R; modulating sinusoidal oscillations with pulses H03C; transmission of digital information H04L; discriminator circuits detecting phase difference between two signals by counting or integrating cycles of oscillation H03D3/04; automatic control, starting, synchronisation or stabilisation of generators of electronic oscillations or pulses where the type of generator is irrelevant or unspecified H03L; coding, decoding or code conversion, in general H03M)

## Abstract

Apparatus and methods are disclosed for simultaneously tracking multiple finger and palm contacts as hands approach, touch, and slide across a proximity-sensing, multi-touch surface. Identification and classification of intuitive hand configurations and motions enables unprecedented integration of typing, resting, pointing, scrolling, 3D manipulation, and handwriting into a versatile, ergonomic computer input device.

## Claims

### Claim 1

A method of performing operations on a computing system having a touch sensitive surface, the method comprising:
tracking the paths of multiple distinguishable contacts, the contacts corresponding to touch devices as they move on or near the surface at the same time, wherein tracking is based on at least shape and position data corresponding to the contacts;
determining translation motion information corresponding to one or more of the multiple contacts based on the tracked paths of the contacts;
generating a translation gesture control signal based on the translation motion information.

### Claim 2 (depends on 1)

The method as described in claim 1 further comprising tracking the paths of the multiple distinguishable contacts using a sequence of proximity images.

### Claim 3 (depends on 1)

The method as described in claim 1 further comprising tracking the paths of multiple distinguishable contacts by scanning a plurality capacitive sensors associated with the touch sensitive surface.

### Claim 4 (depends on 1)

The method of claim 1 further comprising graphically manipulating, by translating a graphical object on a display.

### Claim 5 (depends on 1)

The method of claim 1 further comprising panning a display in response to the translation gesture control signal.

### Claim 6 (depends on 1)

The method of claim 1 further comprising one of vertically and horizontally panning a display in response to the translation gesture control signal.

### Claim 7 (depends on 1)

The method of claim 1 further comprising determining translation motion information by computing translation velocity as a weighted average of one or more finger velocities.

### Claim 8

An apparatus for providing input to a computing system, the apparatus including a touch sensitive surface, the apparatus comprising:
a tracking module for tracking the paths of multiple distinguishable contacts, the contacts corresponding to touch devices as they move on or near the surface at the same time, wherein tracking is based on at least shape and position data corresponding to the contacts;
a motion component extraction module for extracting translation motion information from one or more of the multiple contacts based on the tracked paths of the contacts;
wherein a translation gesture control signal is provided to the computing system based on the extracted translation motion information.

### Claim 9 (depends on 8)

The apparatus as recited in claim 8 further comprising a sequence of proximity images of the multiple distinguishable contacts wherein the tracking module tracks the distinguishable synchronized contacts based on the sequence of proximity images.

### Claim 10 (depends on 8)

The apparatus as recited in claim 8 further comprising a plurality of capacitive sensors associated with the touch sensitive surface to generate a sequence of proximity images of the distinguishable synchronized contacts.

### Claim 11 (depends on 8)

The apparatus as recited in claim 8 further comprising a display for displaying a graphical object, wherein the translation gesture control signal graphically manipulates, by translating, the graphical object on the display.

### Claim 12 (depends on 8)

The apparatus as recited in claim 8 further comprising a display, wherein the display is panned in response to the translation gesture control signal.

### Claim 13 (depends on 12)

The apparatus as recited in claim 12 wherein the display is panned along one of a horizontal and a vertical axis.

### Claim 14 (depends on 8)

The apparatus as recited in claim 8 wherein the translational motion information comprises a weighted average velocity of one or more finger velocities.

### Claim 15

A computer readable storage medium having instructions stored therein, which when executed by an apparatus including a touch sensitive surface causes the apparatus to perform operations by causing the apparatus to:
track the paths of multiple distinguishable contacts, the contacts corresponding to touch devices as they move on or near the surface at the same time, wherein tracking is based on at least shape and position data corresponding to the contacts;
determine translation motion information of one or more of the multiple contacts based on the tracked paths of the contacts; and
generate a translation gesture command based on the extracted translation motion information.

### Claim 16 (depends on 15)

The computer readable storage medium as recited in claim 15 wherein the instructions cause the apparatus to scan a plurality of capacitive sensors associated with the touch sensitive surface to obtain the shape and the position of the multiple distinguishable contacts in a sequence of proximity images.

### Claim 17 (depends on 15)

The computer readable storage medium as recited in claim 15 wherein the instructions cause the apparatus to track the paths of the multiple distinguishable contacts based on a sequence of proximity images of the contacts.

### Claim 18 (depends on 15)

The computer readable storage medium as recited in claim 15 wherein the instructions cause the apparatus to perform a translation manipulation on a graphical object displayed on a display based on the translation gesture command.

### Claim 19 (depends on 15)

The computer readable storage medium as recited in claim 15 wherein the instructions cause the apparatus to pan a display based on the translation gesture command.

### Claim 20 (depends on 22)

The computer readable storage medium as recited in claim 22 wherein the instructions cause the apparatus to pan a display along one of a horizontal and a vertical axis based on the translation gesture command.

### Claim 21 (depends on 15)

The computer readable storage medium as recited in claim 15 wherein the instructions cause the apparatus to compute a weighted average velocity of one or more finger velocities to determine the translation motion information of the one or more of the multiple contacts.
