# US 2021/0278897 A1 · Managing and Mapping Multi-Sided Touch

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0278897 A1
- Document ID: US20210278897A1
- Status: Published application
- Kind: A1
- Application number: 17/327,615
- Filed: 2021-05-21
- Published: 2021-09-09
- Earliest claimed: 2017-10-14
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Robyn Teresa OLIVER; Robert TARTZ; Douglas BREMS; Suhail JALIL; Jonathan KIES
- Web page: https://patentgrep.com/patent/US20210278897A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 1/3231: Monitoring the presence, absence or movement of users
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/03547: {Touch pads, in which fingers can move on a surface}
- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 3/0412: {Digitisers structurally integrated in a display}
- G06F 3/04166: {Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving (Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184)}
- G06F 3/044: by capacitive means
- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- H03K 17/9622: {using a plurality of detectors, e.g. keyboard}
- G06F 2203/04104: Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
- G06F 2203/04106: Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H03K: PULSE TECHNIQUE (measuring pulse characteristics G01R; modulating sinusoidal oscillations with pulses H03C; transmission of digital information H04L; discriminator circuits detecting phase difference between two signals by counting or integrating cycles of oscillation H03D3/04; automatic control, starting, synchronisation or stabilisation of generators of electronic oscillations or pulses where the type of generator is irrelevant or unspecified H03L; coding, decoding or code conversion, in general H03M)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

Various embodiments include processing devices and methods for managing multisensor inputs on a mobile computing device. Various embodiments may include receiving multiple inputs from multiple touch sensors, identifying types of user interactions with the touch sensors from the multiple inputs, identifying sensor input data in a multisensor input data structure corresponding with the types of user interactions, and determining whether the multiple inputs combine as a multisensor input in an entry in the multisensor input data structure having the sensor input data related to a multisensor input response. Various embodiments may include detecting a trigger for a multisensor input mode, entering the multisensor input mode in response to detecting the trigger, and enabling processing of an input from a touch sensor.

## Claims

### Claim 1

A method of integrating multi-touch inputs across multiple distinct surfaces of a mobile computing device, the method comprising:
receiving, in a processor of the mobile computing device, a first multisensor input from at least one touch sensor on the mobile computing device distinct from a touchscreen of the mobile computing device;
determining, by the processor, an operational context of the mobile computing device using contextual awareness data;
determining, by the processor, a first function associated with the received first multisensor input and the determined operational context; and
executing a first operation configured to cause the mobile computing device to perform the determined first function.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,
executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to perform a first virtual movement of an active element on the touchscreen of the mobile computing device analogous to the first touch movement.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
receiving, by the processor, a second multisensor input representing a second touch movement detected on a second touch sensor of the at least one touch sensor;
determining, by the processor, a second function associated with the received second multisensor input being received during the determined operational context; and
executing a second operation configured to cause the mobile computing device to perform the determined second function, wherein the determined second function comprises performing a second virtual movement of the active element on the touchscreen of the mobile computing device analogous to the second touch movement and different in scale from the first virtual movement.

### Claim 4 (depends on 2)

The method of claim 2, wherein executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement.

### Claim 5 (depends on 2)

The method of claim 2, wherein executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement based on a speed of the first touch movement.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,
executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to alter at least one of a background and a foreground of an image on an active display of the touchscreen.

### Claim 7 (depends on 1)

The method of claim 1, wherein executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to control a background application distinct from an active application functioning as a primary control of an active display of the touchscreen.

### Claim 8 (depends on 1)

The method of claim 1, wherein the at least one touch sensor is disposed on at least one of a front surface of the mobile computing device at which the touchscreen is located, a back surface of the mobile computing device behind the touchscreen, a bottom surface of the mobile computing device between the front and back surfaces, a top surface of the mobile computing device between the front and back surfaces and opposite the bottom surface, or a side surface of the mobile computing device between the front and back surfaces and between the top and bottom surfaces.

### Claim 9 (depends on 1)

The method of claim 1, wherein the contextual awareness data includes at least one element of state information selected from the group consisting of an application active on the mobile computing device and a component of the mobile computing device.

### Claim 10 (depends on 1)

The method of claim 1, wherein determining the first function associated with the received first multisensor input includes determining a select multisensor translation table applicable to the received first multisensor input and the determined operational context, wherein the determined first function is based on a lookup of the received first multisensor input on the select multisensor translation table.

### Claim 11

A mobile computing device, comprising:
a plurality of touch sensors, wherein the plurality of touch sensors includes a touchscreen disposed on a front surface of the mobile computing device and at least one other touch sensor disposed along at least one of the front surface, a back surface of the mobile computing device, behind the touchscreen, and one or more sides of the mobile computing device between the front and back surfaces; and
a processor coupled to the plurality of touch sensors, wherein the processor is configured with processor-executable instructions to cause the processor to execute operations comprising:
receiving a first multisensor input from at least one of the plurality of touch sensors distinct from the touchscreen;
determining an operational context of the mobile computing device using contextual awareness data;
determining a first function associated with the received first multisensor input and the determined operational context; and
executing a first operation configured to cause the mobile computing device to perform the determined first function.

### Claim 12 (depends on 11)

The mobile computing device of claim 11, wherein:
the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one of the plurality of touch sensors,
the processor is configured with processor-executable instructions to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to perform a first virtual movement of an active element on the touchscreen of the mobile computing device analogous to the first touch movement.

### Claim 13 (depends on 12)

The mobile computing device of claim 12, wherein the processor is configured with processor-executable instructions to perform operations further comprising:
receiving a second multisensor input representing a second touch movement detected on a second touch sensor of the at least one of the plurality of touch sensors;
determining a second function associated with the received second multisensor input being received during the determined operational context; and
executing a second operation configured to cause the mobile computing device to perform the determined second function, wherein the determined second function comprises performing a second virtual movement of the active element on the touchscreen of the mobile computing device analogous to the second touch movement and different in scale from the first virtual movement.

### Claim 14 (depends on 12)

The mobile computing device of claim 12, wherein the processor is configured with processor-executable instructions to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement.

### Claim 15 (depends on 12)

The mobile computing device of claim 12, wherein the processor is configured with processor-executable instructions to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement based on a speed of the first touch movement.

### Claim 16 (depends on 11)

The mobile computing device of claim 11, wherein:
the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one of the plurality of touch sensors,
the processor is configured with processor-executable instructions to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to alter at least one of a background and a foreground of an image on an active display of the touchscreen.

### Claim 17 (depends on 11)

The mobile computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to control a background application distinct from an active application functioning as a primary control of an active display of the touchscreen.

### Claim 18 (depends on 11)

The mobile computing device of claim 11, wherein the contextual awareness data includes at least one element of state information selected from the group consisting of an application active on the mobile computing device and a component of the mobile computing device.

### Claim 19 (depends on 11)

The mobile computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform operations such that determining the first function associated with the received first multisensor input includes determining a select multisensor translation table applicable to the received first multisensor input and the determined operational context, wherein the determined first function is based on a lookup of the received first multisensor input on the select multisensor translation table.

### Claim 20

A mobile computing device, comprising:
means for receiving a first multisensor input from at least one touch sensor on the mobile computing device distinct from a touchscreen of the mobile computing device;
means for determining an operational context of the mobile computing device using contextual awareness data;
means for determining a first function associated with the received first multisensor input and the determined operational context; and
means for executing a first operation configured to cause the mobile computing device to perform the determined first function.

### Claim 21 (depends on 20)

The mobile computing device of claim 20, wherein:
the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,
means for executing a first operation configured to cause the mobile computing device to perform the determined first function comprises means for executing the first operation configured to cause the mobile computing device to perform a first virtual movement of an active element on the touchscreen of the mobile computing device analogous to the first touch movement.

### Claim 22 (depends on 21)

The mobile computing device of claim 21, further comprising:
means for receiving a second multisensor input representing a second touch movement detected on a second touch sensor of the at least one touch sensor;
means for determining a second function associated with the received second multisensor input being received during the determined operational context; and
means for executing a second operation configured to cause the mobile computing device to perform the determined second function, wherein the determined second function comprises performing a second virtual movement of the active element on the touchscreen of the mobile computing device analogous to the second touch movement and different in scale from the first virtual movement.

### Claim 23 (depends on 21)

The mobile computing device of claim 21, wherein means for executing a first operation configured to cause the mobile computing device to perform the determined first function comprises means for executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement.

### Claim 24 (depends on 21)

The mobile computing device of claim 21, wherein means for executing a first operation configured to cause the mobile computing device to perform the determined first function comprises means for executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement based on a speed of the first touch movement.

### Claim 25 (depends on 20)

The mobile computing device of claim 20, wherein:
the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,
means for executing a first operation configured to cause the mobile computing device to perform the determined first function comprises means for executing the first operation configured to cause the mobile computing device to alter at least one of a background and a foreground of an image on an active display of the touchscreen.

### Claim 26 (depends on 20)

The mobile computing device of claim 20, wherein means for executing a first operation configured to cause the mobile computing device to perform the determined first function comprises means for executing the first operation configured to cause the mobile computing device to control a background application distinct from an active application functioning as a primary control of an active display of the touchscreen.

### Claim 27 (depends on 20)

The mobile computing device of claim 20, wherein the at least one touch sensor is disposed on at least one of a front surface of the mobile computing device at which the touchscreen is located, a back surface of the mobile computing device behind the touchscreen, a bottom surface of the mobile computing device between the front and back surfaces, a top surface of the mobile computing device between the front and back surfaces and opposite the bottom surface, or a side surface of the mobile computing device between the front and back surfaces and between the top and bottom surfaces.

### Claim 28 (depends on 20)

The mobile computing device of claim 20, wherein the contextual awareness data includes at least one element of state information selected from the group consisting of an application active on the mobile computing device and a component of the mobile computing device.

### Claim 29 (depends on 20)

The mobile computing device of claim 20, wherein means for determining the first function associated with the received first multisensor input includes means for determining a select multisensor translation table applicable to the received first multisensor input and the determined operational context, wherein the determined first function is based on a lookup of the received first multisensor input on the select multisensor translation table.

### Claim 30

A non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor of a mobile computing device to perform operations comprising:
receiving a first multisensor input from at least one touch sensor on the mobile computing device distinct from a touchscreen of the mobile computing device;
determining an operational context of the mobile computing device using contextual awareness data;
determining a first function associated with the received first multisensor input and the determined operational context; and
executing a first operation configured to cause the mobile computing device to perform the determined first function.

### Claim 31 (depends on 30)

The non-transitory processor-readable storage medium of claim 30, wherein:
the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,
the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to perform a first virtual movement of an active element on the touchscreen of the mobile computing device analogous to the first touch movement.

### Claim 32 (depends on 31)

The non-transitory processor-readable storage medium of claim 31, wherein the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations further comprising:
receiving a second multisensor input representing a second touch movement detected on a second touch sensor of the at least one touch sensor;
determining a second function associated with the received second multisensor input being received during the determined operational context; and
executing a second operation configured to cause the mobile computing device to perform the determined second function, wherein the determined second function comprises performing a second virtual movement of the active element on the touchscreen of the mobile computing device analogous to the second touch movement and different in scale from the first virtual movement.

### Claim 33 (depends on 31)

The non-transitory processor-readable storage medium of claim 31, wherein the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement.

### Claim 34 (depends on 31)

The non-transitory processor-readable storage medium of claim 31, wherein the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement based on a speed of the first touch movement.

### Claim 35 (depends on 30)

The non-transitory processor-readable storage medium of claim 30, wherein:
the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,
the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to alter at least one of a background and a foreground of an image on an active display of the touchscreen.

### Claim 36 (depends on 30)

The non-transitory processor-readable storage medium of claim 30, wherein the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to control a background application distinct from an active application functioning as a primary control of an active display of the touchscreen.

### Claim 37 (depends on 30)

The non-transitory processor-readable storage medium of claim 30, wherein the at least one touch sensor is disposed on at least one of a front surface of the mobile computing device at which the touchscreen is located, a back surface of the mobile computing device behind the touchscreen, a bottom surface of the mobile computing device between the front and back surfaces, a top surface of the mobile computing device between the front and back surfaces and opposite the bottom surface, or a side surface of the mobile computing device between the front and back surfaces and between the top and bottom surfaces.

### Claim 38 (depends on 30)

The non-transitory processor-readable storage medium of claim 30, wherein the contextual awareness data includes at least one element of state information selected from the group consisting of an application active on the mobile computing device and a component of the mobile computing device.

### Claim 39 (depends on 30)

The non-transitory processor-readable storage medium of claim 30, wherein the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that determining the first function associated with the received first multisensor input includes determining a select multisensor translation table applicable to the received first multisensor input and the determined operational context, wherein the determined first function is based on a lookup of the received first multisensor input on the select multisensor translation table.
