# US 2013/0154915 A1 · Methods, apparatuses, and computer program products for enabling use of remote devices with pre-defined gestures

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0154915 A1
- Document ID: US20130154915A1
- Status: Published application
- Kind: A1
- Application number: 13/328,777
- Filed: 2011-12-16
- Published: 2013-06-20
- Earliest claimed: 2011-12-16
- Assignees: Nokia Corporation
- Inventors: Mat Laibowitz; Vids Samanta; Joseph A. Paradiso
- Web page: https://patentgrep.com/patent/US20130154915A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- H04N 21/4222: {Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy (remote control device for a television receiver integrated into a mobile phone H04M1/72415)}
- H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device}
- H04N 21/485: End-user interface for client configuration
- G08C 2201/32: Remote control based on movements, attitude of remote control device
- G08C 2201/93: Remote control using other portable devices, e.g. mobile phone, PDA, laptop
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)

## Abstract

Methods, apparatuses, and computer program products are herein provided for enabling use of external devices with pre-defined gestures. A method may include receiving operation information from a remote device, wherein the operation information indicates at least one operation that may be invoked by the remote device. The method may further include associating, by a processor, at least one pre-defined gesture with the at least one operation. The method may further include receiving user input. The method may further include determining that the user input corresponds to the at least one pre-defined gesture. The method may further include causing transmission of indication information to the remote device, wherein the indication information provides an indication to the remote device to perform the at least one operation associated with the pre-defined gesture. Corresponding apparatuses and computer program products are also provided.

## Claims

### Claim 1

A method comprising:
receiving operation information from a remote device, wherein the operation information indicates at least one operation that may be invoked by the remote device;
associating, by a processor, at least one pre-defined gesture with the at least one operation;
receiving user input;
determining that the user input corresponds to the at least one pre-defined gesture; and
causing transmission of indication information to the remote device, wherein the indication information provides an indication to the remote device to perform the at least one operation associated with the pre-defined gesture.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the user input comprises input data indicative of the user input, and wherein determining that the user input corresponds to the at least one pre-defined gesture comprises utilizing an input evaluation directive to determine that the input data indicates user input corresponding to the at least one pre-defined gesture.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the input data comprises information indicating sensor data indicative of the user input.

### Claim 4 (depends on 2)

The method according to claim 2 further comprising:
receiving a second user input;
determining that the second user input indicates the pre-defined gesture; and
causing modification of the input evaluation directive.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the second user input comprises second input data indicative of the second user input, and wherein causing modification to the input evaluation directive comprises modifying the input evaluation directive such that the second input data indicates user input corresponding to the at least one pre-defined gesture.

### Claim 6 (depends on 4)

The method according to claim 4, wherein causing modification of the input evaluation directive occurs prior to receiving operation information from a remote device.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the operation information further comprises at least one guidance directive, wherein the at least one guidance directive indicates a suggested type of pre-defined gesture to associate with the at least one operation.

### Claim 8 (depends on 7)

The method according to claim 7, wherein associating the at least one pre-defined gesture with the at least one operation comprises associating the at least one pre-defined gesture with the at least one operation based at least in part on the guidance directive.

### Claim 9

An apparatus comprising a processor and a memory including computer program code, the memory and the computer program code configured to, with the processor, cause the apparatus to:
receive operation information from a remote device, wherein the operation information indicates at least one operation that may be invoked by the remote device;
associate at least one pre-defined gesture with the at least one operation;
receive user input;
determine that the user input corresponds to the at least one pre-defined gesture; and
cause transmission of indication information to the remote device, wherein the indication information provides an indication to the remote device to perform the at least one operation associated with the pre-defined gesture.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the user input comprises input data indicative of the user input, and wherein the memory and the computer program code are further configured to, with the processor, cause the apparatus to determine that the user input corresponds to the at least one pre-defined gesture by utilizing an input evaluation directive to determine that the input data indicates user input corresponding to the at least one pre-defined gesture.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the input data comprises information indicating sensor data indicative of the user input.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein the memory and the computer program code are further configured to, with the processor, cause the apparatus to:
receive a second user input;
determine that the second user input indicates the pre-defined gesture; and
cause modification of the input evaluation directive.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the second user input comprises second input data indicative of the second user input, and wherein the memory and the computer program code are further configured to, with the processor, cause the apparatus to cause modification to the input evaluation directive by modifying the input evaluation directive such that the second input data indicates user input corresponding to the at least one pre-defined gesture.

### Claim 14 (depends on 12)

The apparatus of claim 12, wherein the memory and the computer program code are further configured to, with the processor, cause the apparatus to cause modification of the input evaluation directive prior to receiving operation information from a remote device.

### Claim 15 (depends on 9)

The apparatus of claim 9, wherein the operation information further comprises at least one guidance directive, wherein the at least one guidance directive indicates a suggested type of pre-defined gesture to associate with the at least one operation.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the memory and the computer program code are further configured to, with the processor, cause the apparatus to associate the at least one pre-defined gesture with the at least one operation by associating the at least one pre-defined gesture with the at least one operation based at least in part on the guidance directive.

### Claim 17

Computer program product comprising a non-transitory computer readable medium having program code portions means stored thereon, the program code portions being a computer readable medium and configured when said program product is run on a computer or network device, to:
receive operation information from a remote device, wherein the operation information indicates at least one operation that may be invoked by the remote device;
associate at least one pre-defined gesture with the at least one operation;
receive user input;
determine that the user input corresponds to the at least one pre-defined gesture; and
cause transmission of indication information to the remote device, wherein the indication information provides an indication to the remote device to perform the at least one operation associated with the pre-defined gesture.

### Claim 18 (depends on 17)

The computer program product of claim 17, wherein the user input comprises input data indicative of the user input, and wherein the program code portions are further configured when said program product is run on a computer or network device, to determine that the user input corresponds to the at least one pre-defined gesture by utilizing an input evaluation directive to determine that the input data indicates user input corresponding to the at least one pre-defined gesture.

### Claim 19 (depends on 18)

The computer program product of claim 18, wherein the input data comprises information indicating sensor data indicative of the user input.

### Claim 20 (depends on 18)

The computer program product of claim 18, wherein the program code portions are further configured when said program product is run on a computer or network device, to:
receive a second user input;
determine that the second user input indicates the pre-defined gesture; and
cause modification of the input evaluation directive.
