Wearable display and method of controlling the wearable display generating a user interface according to that of an external device

A method for controlling a Head Mount Display (HMD), the method comprising:

• detecting an external device from an image captured by the HMD,
• recognizing a first keyboard component and a first window component from the external device, wherein the first window component of the external device outputs hidden data corresponding to an input signal currently received at the external device via the first keyboard component having a first keyboard layout,
• switching the external device from a normal mode to a protection mode if the processor recognizes the first keyboard component and the first window component from the external device,
• displaying a protection layer over one or more components of the external device if the external device is in the protection mode,
• generating a second keyboard component corresponding to the first keyboard component and a second window component corresponding to the first window component, wherein the second window component outputs data corresponding to the input signal without hiding data,
• providing the second keyboard component overlaying the first keyboard component, and
• indicating a key included in the second keyboard component corresponding to the input signal currently received via the first keyboard component,
• wherein the second keyboard component displayed corresponding to the first keyboard component has a second keyboard layout different from the first keyboard layout of the first keyboard component and the input signal is received by using the second keyboard layout and in accordance with the second keyboard layout, and
• wherein each of the first keyboard layout and the second keyboard layout includes a plurality of keys.

A Head Mount Display (HMD) for use with an external device, the HIVID comprising:

• an at least partially see-through display;
• a sensor configured to capture an image;
• a processor configured to:
• detect the external device in the image;
• recognize a first keyboard component including a plurality of keys in a first keyboard layout and a first window component of a first user interface of the external device in the image, wherein the first window component of the external device displays in a hidden format current input data that is input via an input signal to the first keyboard component;
• when the first keyboard component and the first window component from the external device are recognized, send an instruction to the external device via a communication unit of the HIVID to cause the external device to switch from a normal mode to a protection mode, wherein the protection mode causes the display of a protection layer over one or more of the first keyboard component and the first window component;
• generate a second user interface for display on the at least partially see- through display of the HMD, the second user interface including a second keyboard component including a plurality of keys of a second keyboard layout different than the first keyboard layout, and being displayed at a position corresponding to a position of the first keyboard component so as to overlay the first keyboard component as viewed through the at least partially see-through display, and a second window component displayed at a position corresponding to a position of the first window component so as to at least partially overlay the first window component as viewed through the at least partially see-through display, wherein the second window component displays the current input data in an unhidden format, and wherein the second keyboard component displays a graphical indication of selection of a selected key of the plurality of keys according to the input signal, a value of the selected key being determined according to the second keyboard layout.