Display input device and method for controlling same
AssigneeKYOCERA Document Solutions Inc.
InventorShinichi KAWAGUCHI
Life of this patent
Estimating the term…
Abstract
A display input device includes a head mount display and a main apparatus. The head mount display includes an imager, a transmissive display, a sight line detector, a processor, and an HMD communicator. The main apparatus includes an operation panel including a display panel and an operation portion, a main-apparatus communicator, and a controller. The processor causes the transmissive display to display a virtual item button for selecting an item. When an item belonging to a lowest hierarchical layer is selected, the controller causes the display panel to display a setting-value setting screen. The operation portion accepts setting of a setting value.
Claims11
A display input device comprising:
- a head mount display;
- and
- a main apparatus,
- wherein the head mount display comprises
- an imager,
- a transmissive display which, while transmitting external light, causes a virtual image to be visually recognized,
- a sight line detector for detecting a sight line of a user,
- a processor which controls display on the transmissive display, and
- an HMD communicator,
- wherein the main apparatus comprises
- an operation panel which includes a display panel and an operation portion,
- a main-apparatus communicator which communicates with the HMD communicator, and
- a controller which controls display on the display panel,
- wherein the processor
- causes the transmissive display to display a virtual item button for item selection while the imager is capturing an image of the operation panel,
- recognizes, based on an output of the sight line detector, the virtual item button selected, and
- recognizes, as a selected item, an item corresponding to the virtual item button selected,
- wherein the item is one of a plurality of kinds of items which are classified in a hierarchical structure, and
- wherein, when the selected item belongs to a lowest hierarchical layer,
- the processor causes the HMD communicator to transmit, to the main-apparatus communicator, a first notification indicating the selected item,
- the controller, based on the first notification, causes the display panel to display a setting-value setting screen for setting a setting value for the selected item, and
- the operation portion accepts setting of the setting value.
A method for controlling a display input device, the method comprising:
- including a head mount display and a main apparatus in a display input device;
- causing a virtual image to be visually recognized using the head mount display while the head mount display transmitting external light;
- detecting a sight line of a user using the head mount display;
- providing the main apparatus with an operation panel which includes a display panel and an operation portion;
- controlling display on the display panel using the main apparatus;
- displaying, on the head mount display, a virtual item button for selecting an item while an imager of the head mount display is capturing an image of the operation panel;
- recognizing, based on a detected sight line, the virtual item button selected;
- recognizing, as a selected item, an item corresponding to the virtual item button selected;
- the item being one of a plurality of kinds of items which are classified in a hierarchical structure;
- the head mount display transmitting, to the main apparatus, a first notification indicating the selected item, when the selected item belongs to a lowest hierarchical layer;
- the display panel displaying, based on the first notification, a setting-value setting screen for setting a setting value for the selected item;
- and
- accepting setting of the setting value.
Dependencies are inferred from the claim text.