# US 11,550,411 B2 · Method and device for navigating in a display screen and apparatus comprising such navigation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,550,411 B2
- Document ID: US11550411B2
- Status: Granted
- Kind: B2
- Application number: 16/222,838
- Filed: 2018-12-17
- Published: 2019-04-25
- Granted: 2023-01-10
- Earliest claimed: 2013-02-14
- Assignees: Quickstep Technologies LLC
- Applicants: Quickstep Technologies LLC
- Inventors: Didier Roziere
- Web page: https://patentgrep.com/patent/US11550411B2

## CPC

- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 3/0416: {Control or interface arrangements specially adapted for digitisers}
- G06F 3/042: by opto-electronic means
- G06F 3/044: by capacitive means
- G06F 3/0485: Scrolling or panning
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
- G06F 2203/04108: Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method is provided for navigating in a display screen by way of a control surface including a step of measuring: —a data item, termed position, relating to a position targeted, on the control surface, by a remote control object positioned opposite the control surface, and—a data item, termed vertical distance, relating to the distance between the at least one remote control object and the control surface; and a drive step, carrying out, as a function of the vertical distance measured: —a displacement, and/or—an adjustment of a parameter relating to a displacement; of at least one part of a zone and/or of a symbol displayed on the display screen and chosen as a function of the target position.

## Claims

### Claim 1

A method comprising:
at an electronic device with a touch screen:
displaying a first user interface including a first user interface element and a second user interface element that is different from the first user interface element;
while displaying the first user interface on the touch screen, detecting a first input that includes movement of a hovering object toward the touch screen over a portion of the first user interface;
in response to detecting the first input, changing a size of a plurality of user interface elements based on an amount of movement of the hovering object toward the touch screen during the first input, including:
increasing a size of the first user interface element by a first amount, wherein the first amount is a function of a distance of the hovering object from the touch screen and a distance of the first user interface element from the portion of the first user interface; and
increasing a size of the second user interface element by a second amount different than the first amount, wherein the second amount is a function of the distance of the hovering object from the touch screen and a distance of the second user interface element from the portion of the first user interface;
after detecting the first input, detecting a second input that includes further movement of the hovering object toward the touch screen over the portion of the first user interface; and
in response to detecting the second input, changing the size of the plurality of user interface elements based on an amount of movement of the hovering object toward the touch screen during the second input, including:
increasing the size of the first user interface element by a third amount, wherein the third amount is a function of the distance of the hovering object from the touch screen and the distance of the first user interface element from the portion of the first user interface; and
increasing the size of the second user interface element by a fourth amount, wherein the fourth amount is a function of the distance of the hovering object from the touch screen and a distance of the second user interface element from the portion of the first user interface.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first user interface element and the second user interface element are independently selectable to perform different commands.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first user interface further includes a third user interface element and a fourth user interface element that is different from the third user interface element; and
wherein changing the size of the plurality of user interface elements further includes:
decreasing a size of the third user interface element by a fifth amount; and
decreasing a size of the fourth user interface element by a sixth amount different than the fifth amount,
wherein the fifth amount is a function of a distance of the third user interface element from the portion of the first user interface and the sixth amount is a function of a distance of the fourth user interface element from the portion of the first user interface.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
displaying the first user interface in response to detecting the hovering object within a threshold distance from the touch screen.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
repositioning the plurality of user interface elements in accordance with changing the size of the plurality of user interface elements to keep the first user interface displayed on the touch screen.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
stopping changing the size of the plurality of user interface elements and repositioning the plurality of user interface elements in response to detecting the hovering object within a threshold distance from the touch screen.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
detecting a third input that includes the hovering object over the portion of the first user interface within a first selection threshold distance from the touch screen; and
in response to detecting the third input:
selecting a user interface element corresponding to the portion of the first user interface; and
displaying a second user interface corresponding to the first user interface element.

### Claim 8 (depends on 7)

The method of claim 7, wherein the first user interface element corresponds to a character and the second user interface includes a plurality of words beginning with the character.

### Claim 9 (depends on 7)

The method of claim 7, wherein the first user interface is displayed along a first edge of the touch screen and the second user interface is displayed along a second edge, opposite the first edge, of the touch screen.

### Claim 10 (depends on 7)

The method of claim 7, further comprising:
detecting a fourth input that includes movement of the hovering object over the touch screen from the portion of the first user interface to a portion of the second user interface; and
in response to detecting the fourth input:
maintaining display of the first user interface and the second user interface.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
detecting a fifth input that includes the hovering object over the portion of the second user interface within a second selection threshold distance from the touch screen; and
in response to detecting the fifth input:
selecting a user interface element corresponding to the portion of the second user interface, the selection initiating execution of a command associated with the selected user interface element in the second user interface.

### Claim 12 (depends on 7)

The method of claim 7, wherein the second user interface is displayed concurrently with the first user interface and without overlapping the first user interface.

### Claim 13

An electronic device, comprising:
a touch screen;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying a first user interface including a first user interface element and a second user interface element that is different from the first user interface element;
while displaying the first user interface on the touch screen, detecting a first input that includes movement of a hovering object toward the touch screen over a portion of the first user interface;
in response to detecting the first input, changing a size of a plurality of user interface elements based on an amount of movement of the hovering object toward the touch screen during the first input, including:
increasing a size of the first user interface element by a first amount, wherein the first amount is a function of a distance of the hovering object from the touch screen and a distance of the first user interface element from the portion of the first user interface; and
increasing a size of the second user interface element by a second amount different than the first amount, wherein the second amount is a function of the distance of the hovering object from the touch screen and a distance of the second user interface element from the portion of the first user interface;
after detecting the first input, detecting a second input that includes further movement of the hovering object toward the touch screen over the portion of the first user interface; and
in response to detecting the second input, changing the size of the plurality of user interface elements based on an amount of movement of the hovering object toward the touch screen during the second input, including:
increasing the size of the first user interface element by a third amount, wherein the third amount is a function of the distance of the hovering object from the touch screen and the distance of the first user interface element from the portion of the first user interface; and
increasing the size of the second user interface element by a fourth amount, wherein the fourth amount is a function of the distance of the hovering object from the touch screen and a distance of the second user interface element from the portion of the first user interface.

### Claim 14 (depends on 13)

The electronic device of claim 13, wherein the first user interface element and the second user interface element are independently selectable to perform different commands.

### Claim 15 (depends on 13)

The electronic device of claim 13, wherein the first user interface further includes a third user interface element and a fourth user interface element that is different from the third user interface element; and
wherein changing the size of the plurality of user interface elements further includes:
decreasing a size of the third user interface element by a fifth amount; and
decreasing a size of the fourth user interface element by a sixth amount different than the fifth amount,
wherein the fifth amount is a function of a distance of the third user interface element from the portion of the first user interface and the sixth amount is a function of a distance of the fourth user interface element from the portion of the first user interface.

### Claim 16 (depends on 13)

The electronic device of claim 13, the one or more programs further including instructions for:
displaying the first user interface in response to detecting the hovering object within a threshold distance from the touch screen.

### Claim 17 (depends on 13)

The electronic device of claim 13, the one or more programs further including instructions for:
repositioning the plurality of user interface elements in accordance with changing the size of the plurality of user interface elements to keep the first user interface displayed on the touch screen.

### Claim 18 (depends on 17)

The electronic device of claim 17, the one or more programs further including instructions for:
stopping changing the size of the plurality of user interface elements and repositioning the plurality of user interface elements in response to detecting the hovering object within a threshold distance from the touch screen.

### Claim 19 (depends on 13)

The electronic device of claim 13, the one or more programs further including instructions for:
detecting a third input that includes the hovering object over the portion of the first user interface within a first selection threshold distance from the touch screen; and
in response to detecting the third input:
selecting a user interface element corresponding to the portion of the first user interface; and
displaying a second user interface corresponding to the first user interface element.

### Claim 20 (depends on 19)

The electronic device of claim 19, wherein the first user interface element corresponds to a character and the second user interface includes a plurality of words beginning with the character.

### Claim 21 (depends on 19)

The electronic device of claim 19, wherein the first user interface is displayed along a first edge of the touch screen and the second user interface is displayed along a second edge, opposite the first edge, of the touch screen.

### Claim 22 (depends on 19)

The electronic device of claim 19, the one or more programs further including instructions for:
detecting a fourth input that includes movement of the hovering object over the touch screen from the portion of the first user interface to a portion of the second user interface; and
in response to detecting the fourth input:
maintaining display of the first user interface and the second user interface.

### Claim 23 (depends on 22)

The electronic device of claim 22, the one or more programs further including instructions for:
detecting a fifth input that includes the hovering object over the portion of the second user interface within a second selection threshold distance from the touch screen; and
in response to detecting the fifth input:
selecting a user interface element corresponding to the portion of the second user interface, the selection initiating execution of a command associated with the selected user interface element in the second user interface.

### Claim 24 (depends on 19)

The electronic device of claim 19, wherein the second user interface is displayed concurrently with the first user interface and without overlapping the first user interface.

### Claim 25

A non-transitory computer readable storage medium storing instructions, which when executed by one or more processors of an electronic device with a touch screen, cause the electronic device to:
display a first user interface including a first user interface element and a second user interface element that is different from the first user interface element;
while displaying the first user interface on the touch screen, detect a first input that includes movement of a hovering object toward the touch screen over a portion of the first user interface;
in response to detecting the first input, change a size of a plurality of user interface elements based on an amount of movement of the hovering object toward the touch screen during the first input, including:
increasing a size of the first user interface element by a first amount, wherein the first amount is a function of a distance of the hovering object from the touch screen and a distance of the first user interface element from the portion of the first user interface; and
increasing a size of the second user interface element by a second amount different than the first amount, wherein the second amount is a function of the distance of the hovering object from the touch screen and a distance of the second user interface element from the portion of the first user interface;
after detecting the first input, detect a second input that includes further movement of the hovering object toward the touch screen over the portion of the first user interface; and
in response to detecting the second input, change the size of the plurality of user interface elements based on an amount of movement of the hovering object toward the touch screen during the second input, including:
increasing the size of the first user interface element by a third amount, wherein the third amount is a function of the distance of the hovering object from the touch screen and the distance of the first user interface element from the portion of the first user interface; and
increasing the size of the second user interface element by a fourth amount, wherein the fourth amount is a function of the distance of the hovering object from the touch screen and a distance of the second user interface element from the portion of the first user interface.

### Claim 26 (depends on 25)

The non-transitory computer readable storage medium of claim 25, wherein the first user interface element and the second user interface element are independently selectable to perform different commands.

### Claim 27 (depends on 25)

The non-transitory computer readable storage medium of claim 25, wherein the first user interface further includes a third user interface element and a fourth user interface element that is different from the third user interface element; and
wherein changing the size of the plurality of user interface elements further includes:
decreasing a size of the third user interface element by a fifth amount; and
decreasing a size of the fourth user interface element by a sixth amount different than the fifth amount,
wherein the fifth amount is a function of a distance of the third user interface element from the portion of the first user interface and the sixth amount is a function of a distance of the fourth user interface element from the portion of the first user interface.

### Claim 28 (depends on 25)

The non-transitory computer readable storage medium of claim 25, further storing instructions, which when executed by the one or more processors of the electronic device, cause the electronic device to:
display the first user interface in response to detecting the hovering object within a threshold distance from the touch screen.

### Claim 29 (depends on 25)

The non-transitory computer readable storage medium of claim 25, further storing instructions, which when executed by the one or more processors of the electronic device, cause the electronic device to:
reposition the plurality of user interface elements in accordance with changing the size of the plurality of user interface elements to keep the first user interface displayed on the touch screen.

### Claim 30 (depends on 29)

The non-transitory computer readable storage medium of claim 29, further storing instructions, which when executed by the one or more processors of the electronic device, cause the electronic device to:
stop changing the size of the plurality of user interface elements and repositioning the plurality of user interface elements in response to detecting the hovering object within a threshold distance from the touch screen.

### Claim 31 (depends on 25)

The non-transitory computer readable storage medium of claim 25, further storing instructions, which when executed by the one or more processors of the electronic device, cause the electronic device to:
detect a third input that includes the hovering object over the portion of the first user interface within a first selection threshold distance from the touch screen; and
in response to detecting the third input:
select a user interface element corresponding to the portion of the first user interface; and
display a second user interface corresponding to the first user interface element.

### Claim 32 (depends on 31)

The non-transitory computer readable storage medium of claim 31, wherein the first user interface element corresponds to a character and the second user interface includes a plurality of words beginning with the character.

### Claim 33 (depends on 31)

The non-transitory computer readable storage medium of claim 31, wherein the first user interface is displayed along a first edge of the touch screen and the second user interface is displayed along a second edge, opposite the first edge, of the touch screen.

### Claim 34 (depends on 31)

The non-transitory computer readable storage medium of claim 31, further storing instructions, which when executed by the one or more processors of the electronic device, cause the electronic device to:
detect a fourth input that includes movement of the hovering object over the touch screen from the portion of the first user interface to a portion of the second user interface; and
in response to detecting the fourth input:
maintain display of the first user interface and the second user interface.

### Claim 35 (depends on 34)

The non-transitory computer readable storage medium of claim 34, further storing instructions, which when executed by the one or more processors of the electronic device, cause the electronic device to: detect a fifth input that includes the hovering object over the portion of the second user interface within a second selection threshold distance from the touch screen; and
in response to detecting the fifth input:
select a user interface element corresponding to the portion of the second user interface, the selection initiating execution of a command associated with the selected user interface element in the second user interface.

### Claim 36 (depends on 31)

The non-transitory computer readable storage medium of claim 31, wherein the second user interface is displayed concurrently with the first user interface and without overlapping the first user interface.