# US 2018/0024642 A1 · No-handed smartwatch interaction techniques

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0024642 A1
- Document ID: US20180024642A1
- Status: Published application
- Kind: A1
- Application number: 15/650,816
- Filed: 2017-07-14
- Published: 2018-01-25
- Earliest claimed: 2016-07-20
- Assignees: Autodesk, Inc.
- Applicants: Autodesk, Inc.
- Inventors: Seongkook Heo; George Fitzmaurice; Benjamin Lafreniere; Tovi Grossman
- Web page: https://patentgrep.com/patent/US20180024642A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Via no-handed inputs to a smartwatch, an end-user can initiate various smartwatch operations when either or both hands of the end-user are occupied. The smartwatch includes a suite of sensors for capturing inertial, acoustic, and optical data. The smartwatch also interfaces with a handheld mobile computing device and/or a shoe-mounted pedometry device to capture additional sensor data. A control engine executing on the smartwatch processes captured sensor data and identifies no-handed inputs performed by the end-user. The control engine maps these no-handed inputs to specific commands that can be executed on the smartwatch to initiate smartwatch operations.

## Claims

### Claim 1

A computer-implemented method for interacting with a wearable computing device, the method comprising:
processing a first data stream to determine that a first criterion has been met;
determining that the first criterion corresponds to a first no-handed input not involving either hand of an end-user; and
mapping the first no-handed input to a first command for execution by the wearable computing device.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the wearable computing device comprises a smartwatch that includes a first sensor for capturing the first data stream.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein the first sensor comprises at least one of an inertial measurement unit, an audio input, and an optical input.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the first data stream comprises a set of timestamped values, and wherein determining that the first criterion has been met comprises:
identifying a subset of the timestamped values corresponding to a first set of inflection points; and
determining that the subset of timestamped values occurs within a first time window.

### Claim 5 (depends on 4)

The computer implemented method of claim 4, further comprising determining that the first set of inflection points includes at least a first threshold number of inflection points.

### Claim 6 (depends on 4)

The computer-implemented method of claim 4, further comprising determining that each inflection point in the first set of inflection points corresponds to at least one timestamped value in the subset of timestamped values that exceeds a first threshold value.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising processing the first data stream to identify first context data indicating a functional state of the wearable computing device, and wherein the first context data is used in determining that the first criterion has been met.

### Claim 8 (depends on 7)

The computer-implemented method of claim 7, further comprising, prior to determining that the first criterion has been met, updating default criterion based on the first context data to generate the first criterion.

### Claim 9

A non-transitory computer-readable medium storing program instructions that, when executed by a processor, causes the processor to perform the steps of:
processing a first data stream to determine that a first criterion has been met;
determining that the first criterion corresponds to a first no-handed input not involving either hand of an end-user; and
mapping the first no-handed input to a first command for execution by the wearable computing device.

### Claim 10 (depends on 9)

The non-transitory computer-readable medium of claim 9, wherein the wearable computing device comprises a smartwatch that includes a first sensor for capturing the first data stream.

### Claim 11 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the first sensor comprises at least one of an inertial measurement unit, an audio input, and an optical input.

### Claim 12 (depends on 9)

The non-transitory computer-readable medium of claim 9, wherein the step of determining that the first criterion has been met comprises determining that the wearable computing device has impacted a solid object or a fluid.

### Claim 13 (depends on 9)

The non-transitory computer-readable medium of claim 9, wherein the first criterion indicates when the wearable computer translates across a surface.

### Claim 14 (depends on 9)

The non-transitory computer-readable medium of claim 9, wherein the first criterion indicates when the wearable computer receives a touch input from an object external to the end-user.

### Claim 15 (depends on 9)

The non-transitory computer-readable medium of claim 9, wherein the first data stream comprises first sensor data captured by the wearable computing device and second sensor data captured by a peripheral device coupled to the wearable computing device.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein at least one of the first sensor data and the second sensor data indicates that at least one body part of the end-user is moving.

### Claim 17

A system, comprising:
a memory storing a control engine; and
a processor that, upon executing the control engine, performs the steps of:
processing a first data stream to determine that a first criterion has been met,
determining that the first criterion corresponds to a first no-handed input not involving either hand of an end-user, and
mapping the first no-handed input to a first command for execution by the wearable computing device.

### Claim 18 (depends on 17)

The system of claim 17, further comprising a first sensor that captures the first data stream, wherein the first sensor comprises at least one of an inertial measurement unit, an audio input, and an optical input.

### Claim 19 (depends on 17, 19)

The system of claim 17, further comprising a wearable computing device that includes the memory, the processor, and the first sensor. The system of claim 19, further comprising a peripheral device coupled to the wearable computing device and including a sensor that captures a second stream, wherein the second data stream is used in determining that the first criteria is met.
