# US 2021/0011599 A1 · Method and system for controlling device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0011599 A1
- Document ID: US20210011599A1
- Status: Published application
- Kind: A1
- Application number: 17/038,862
- Filed: 2020-09-30
- Published: 2021-01-14
- Earliest claimed: 2014-12-01
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Yu-sung JOO; Yo-han KIM; Eun-kyo BAEK; Jong-won LEE; Hyun-kwon CHUNG
- Web page: https://patentgrep.com/patent/US20210011599A1

## CPC

- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method of controlling a device includes determining a distance between the device and a hovering inputter; determining 3-dimensional (3D) location information of a hovering input based on the distance; selecting a task among a plurality of tasks corresponding to an operation of an application executed by the device and the 3D location information of the hovering input; determining a class of an execution input according to the hovering input; and performing the selected task according to the determined class of the execution input.

## Claims

### Claim 1

A method of controlling a device, the method comprising:
displaying an icon including a plurality of representative objects indicating a plurality of applications;
obtaining 3-dimensional (3D) location information of a hovering inputter on the icon, the 3D location information being determined based on a distance between the device and the hovering inputter, when the hovering inputter is held within a predetermined distance for a predetermined period of time on the icon, wherein the same plurality of representative objects are displayed while the distance between the device and the hovering inputter is changed; and
determining an application corresponding to the 3D location information of the hovering inputter among the plurality of applications.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining the icon, among a plurality of icons, corresponding to a 2-dimensional (2D) location of the hovering inputter.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
executing the determined application in response to an input of the hovering inputter.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
sensing a gesture through the hovering inputter; and
comparing the sensed gesture with predetermined gestures.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
when the application is executed, selecting another application among a plurality of applications indicated by at least one icon, based on the 3D location information of the hovering inputter.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
receiving information regarding a moving direction of the hovering inputter; and
determining whether the moving direction of the hovering inputter corresponds to a predetermined gesture.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
determining a class of a moving pattern of the hovering inputter; and
determining a task corresponding to the class of the moving pattern.

### Claim 8

A method of controlling a first device, the method comprising:
receiving, from a second device, 3-dimensional (3D) location information of a hovering inputter obtained when the hovering inputter is held within a predetermined distance from the second device for a predetermined period of time on an icon displayed at the second device, the icon including a plurality of representative objects indicating a plurality of applications, the 3D location information being determined based on a distance between the hovering inputter and the second device; and
determining an application corresponding to the 3D location information of the hovering inputter among a plurality of applications, wherein the same plurality of representative objects are displayed within the icon while the distance between the hovering inputter and the second device is changed.

### Claim 9 (depends on 8)

The method of claim 8,
wherein movement information of the hovering inputter is further received by the first device.

### Claim 10 (depends on 9)

The method of claim 9, wherein a task is identified based on a movement of the hovering inputter, and the task is determined based on the received movement information.

### Claim 11 (depends on 8)

The method of claim 8, further comprising:
execute the determined application in response to an input of the hovering inputter.

### Claim 12

A device comprising:
an input interface configured to receive a input of a hovering inputter; and
a processor configured to:
display an icon including a plurality of representative objects indicating a plurality of applications,
obtain 3-dimensional (3D) location information of a hovering inputter on the icon, the 3D location information being determined based on a distance between the device and the hovering inputter, when the hovering inputter is held within a predetermined distance for a predetermined period of time on the icon, wherein the same plurality of representative objects are displayed within the icon while the distance between the device and the hovering inputter is changed,
determine an application corresponding to the 3D location information of the hovering inputter among the plurality of applications.

### Claim 13 (depends on 12)

The device of claim 12,
wherein the processor is further configured to determine the icon, among a plurality of icons, corresponding to a 2-dimensional (2D) location of the hovering inputter, and output the determined icon.

### Claim 14 (depends on 12)

The device of claim 12,
wherein the processor is further configured to execute the determined application in response to an input of the hovering inputter.

### Claim 15 (depends on 12)

The device of claim 12,
wherein the processor is further configured to control the input interface to sense a gesture through the hovering inputter, and
compare the sensed gesture with predetermined gestures.

### Claim 16 (depends on 12)

The device of claim 12, wherein when the application is executed, the processor is further configured to select another application among a plurality of applications indicated by at least one icon output by the device, based on the 3D location information of the hovering input.

### Claim 17 (depends on 12)

The device of claim 12, wherein the processor is further configured to receive information regarding a moving direction of the hovering inputter and determine whether the moving direction of the hovering inputter is corresponding to the predetermined gesture.

### Claim 18 (depends on 12)

The device of claim 12, wherein the processor is further configured to determine a class of a moving pattern of the hovering inputter and determine a task corresponding to the class of the moving pattern.

### Claim 19 (depends on 1)

A non-transitory computer readable recording medium having recorded thereon a computer program that, when executed by a computer, performs the method of claim 1.

### Claim 20 (depends on 8)

A non-transitory computer readable recording medium having recorded thereon a computer program that, when executed by a computer, performs the method of claim 8.
