# US 2015/0145827 A1 · Operation Display Device That Ensures Operation without Touching Display Unit

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0145827 A1
- Document ID: US20150145827A1
- Status: Published application
- Kind: A1
- Application number: 14/555,504
- Filed: 2014-11-26
- Published: 2015-05-28
- Earliest claimed: 2013-11-26
- Applicants: Kyocera Document Solutions Inc.
- Inventors: Koji Maeda
- Web page: https://patentgrep.com/patent/US20150145827A1

## CPC

- G06F 3/04186: {Touch location disambiguation}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 2203/04108: Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An operation display device includes a display unit, a display control unit, a coordinate measuring unit, an overlap determining unit, and a first operation accepting unit. The coordinate measuring unit measures a coordinate of a first direction, a coordinate of a second direction, and a coordinate of a third direction indicative of a position of an object. The overlap determining unit determines whether the object within the predetermined distance from a first screen overlaps a software key or not. The first operation accepting unit accepts an operation of the software key when the first operation accepting unit determines that the coordinate of the third direction has changed. When the first operation accepting unit accepts the operation of the software key, the display control unit switches the screen displayed by the display unit from the first screen to a second screen.

## Claims

### Claim 1

An operation display device, comprising:
a display unit;
a display control unit that causes the display unit to display a screen;
a coordinate measuring unit that measures a coordinate of a first direction, a coordinate of a second direction, and a coordinate of a third direction indicative of a position of an object corresponding to a position of the object within a predetermined distance from the screen, the first direction and the second direction being directions to specify a plane of coordinates on the screen, the third direction being a direction vertical to the screen;
an overlap determining unit that determines whether the object within the predetermined distance from a first screen overlaps a software key viewed from the third direction or not using the coordinate of the first direction, the coordinate of the second direction, and the coordinate of the third direction in a state where the first screen is displayed on the display unit, the first screen being the screen including the software key; and
a first operation accepting unit that accepts an operation of the software key when the first operation accepting unit determines that the coordinate of the third direction has changed in a state where the overlap determining unit determines that the object overlaps the software key; wherein
when the first operation accepting unit accepts the operation of the software key, the display control unit switches the screen displayed by the display unit from the first screen to a second screen, the second screen being the screen different from the first screen.

### Claim 2 (depends on 1)

The operation display device according to claim 1, wherein:
in a state where the overlap determining unit determines that the object overlaps the software key, the first operation accepting unit determines whether the object approaches the software key or not from a change in the coordinate of the third direction; and
when the first operation accepting unit determines the object approaches the software key, the first operation accepting unit accepts the operation of the software key.

### Claim 3 (depends on 2)

The operation display device according to claim 2, further comprising:
an undo operation accepting unit that accepts an operation to return to a previous screen when the object within the predetermined distance from the second screen is determined to overlap a position where the software key is displayed on the first screen viewed from the third direction and is brought away from the second screen after switched to the second screen using the coordinate of the first direction, the coordinate of the second direction, and the coordinate of the third direction measured by the coordinate measuring unit; wherein
when the undo operation accepting unit accepts an operation to return to a previous screen, the display control unit switches the screen displayed by the display unit from the second screen to the first screen.

### Claim 4 (depends on 1)

The operation display device according to claim 1, wherein:
the software key includes a plurality of software keys, predetermined settings being assigned to the respective plurality of software keys;
the operation display device further comprises
a setting unit that accepts a setting assigned to the software key whose operation is accepted when the first operation accepting unit accepts any of operations of the plurality of the software keys, and
a screen switch accepting unit that accepts switching of the screens when the screen switch accepting unit determines that the coordinate of the third direction changes while the overlap determining unit determines that the object does not overlap any of the plurality of software keys; and
when the screen switch accepting unit accepts the switching of the screens, the display control unit switches the screen displayed by the display unit from the first screen to the second screen.

### Claim 5 (depends on 1)

The operation display device according to claim 1, wherein:
the coordinate measuring unit has a panel surface where the object is to be touched, the coordinate measuring unit being a touch panel unit using an electrostatic capacity method having a first function and a second function, the first function detecting a position of the panel surface being touched, the second function measuring the coordinate of the first direction, the coordinate of the second direction, and the coordinate of the third direction;
the display unit includes a display panel unit and the touch panel unit, the display panel unit displaying the screen, the touch panel unit being arranged on the display panel unit;
the operation display device includes
a second operation accepting unit that accepts the operation of the software key when the object touches the panel surface on the software key in a state where the display panel unit displays the first screen, and
a mode selection accepting unit that accepts selection of a touch operation mode and a non-touch operation mode;
the touch operation mode performs acceptance of the operation of the software key and switching from the first screen to the second screen using the display panel unit, the first function of the touch panel unit, the display control unit, and the second operation accepting unit; and
the non-touch operation mode performs the acceptance of the operation of the software key and the switching from the first screen to the second screen using the display panel unit, the second function of the touch panel unit, the display control unit, the overlap determining unit, and the first operation accepting unit.

### Claim 6

An operation display device, comprising:
a display unit;
a display control unit that causes the display unit to display a screen including a numerical value display region;
a coordinate measuring unit that measures a coordinate of a first direction, a coordinate of a second direction, and a coordinate of a third direction indicative of a position of an object corresponding to a position of the object within a predetermined distance from the screen, the first direction and the second direction being directions to specify a plane of coordinates on the screen, the third direction being a direction vertical to the screen;
an overlap determining unit that determines whether the object within the predetermined distance from the screen overlaps a predetermined region of the screen viewed from the third direction or not using the coordinate of the first direction, the coordinate of the second direction, and the coordinate of the third direction; and
a first numerical input unit that accepts an input of values of different magnitudes according to the coordinate of the third direction in a state where the overlap determining unit determines that the object overlaps the predetermined region; wherein
the display control unit causes a value accepted by the first numerical input unit to be displayed at the numerical value display region.

### Claim 7 (depends on 6)

The operation display device according to claim 6, wherein:
in a state where the overlap determining unit determines that the object overlaps the predetermined region, the first numerical input unit (1) accepts an input of a value decreased as the object is brought close to the predetermined region, and accepts an input of a value increased as the object is brought away from the predetermined region, or (2) accepts an input of a value increased as the object is brought close to the predetermined region, and accepts an input of a value decreased as the object is brought away from the predetermined region.

### Claim 8 (depends on 6)

The operation display device according to claim 6, wherein:
when the overlap determining unit determines that the coordinate of the third direction does not change and the object changes from a state of overlapping the predetermined region to a state of not overlapping the predetermined region, the first numerical input unit fixes a value displayed at the numerical value display region as an input value and terminates acceptance of an input of a value.

### Claim 9 (depends on 6)

The operation display device according to claim 6, wherein the predetermined region is the numerical value display region.

### Claim 10 (depends on 6)

The operation display device according to claim 6, wherein:
the coordinate measuring unit has a panel surface where the object is to be touched, the coordinate measuring unit being a touch panel unit using an electrostatic capacity method having a first function and a second function, the first function detecting a position of the panel surface being touched, the second function measuring the coordinate of the first direction, the coordinate of the second direction, and the coordinate of the third direction;
the display unit includes a display panel unit and the touch panel unit, the display panel unit displaying the screen, the touch panel unit being arranged on the display panel unit;
the operation display device includes
a second numerical input unit that accepts an input of a value displayed at the numerical value display region when the object touches the panel surface on the software key to operate the software key in a state where the display panel unit displays the screen including a software key for numerical input, and
a mode selection accepting unit that accepts selection of a touch operation mode and a non-touch operation mode;
the touch operation mode inputs a value displayed at the numerical value display region using the display panel unit, the first function of the touch panel unit, the display control unit, and the second numerical input unit; and
the non-touch operation mode inputs a value displayed at the numerical value display region using the display panel unit, the second function of the touch panel unit, the display control unit, the overlap determining unit, and the first numerical input unit.

### Claim 11

An operation display method, comprising:
causing a display unit to display a screen;
measuring a coordinate of a first direction, a coordinate of a second direction, and a coordinate of a third direction indicative of a position of an object corresponding to a position of the object within a predetermined distance from the screen, the first direction and the second direction being directions to specify a plane of coordinates on the screen, the third direction being a direction vertical to the screen;
determining whether the object within the predetermined distance from a first screen overlaps a software key viewed from the third direction or not using the coordinate of the first direction, the coordinate of the second direction, and the coordinate of the third direction in a state where the first screen is displayed on the display unit, the first screen being the screen including the software key; and
accepting an operation of the software key when the first operation accepting unit determines that the coordinate of the third direction has changed in a state where the overlap determining unit determines that the object overlaps the software key; wherein
when the accepting includes accepting the operation of the software key, the display control unit switches the screen displayed by the display unit from the first screen to a second screen, the second screen being the screen different from the first screen.
