# US 2019/0174088 A1 · Display System > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0174088 A1 - Document ID: US20190174088A1 - Status: Published application - Kind: A1 - Application number: 16/265,724 - Filed: 2019-02-01 - Published: 2019-06-06 - Earliest claimed: 2016-08-05 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Seung Wook Kim; Camille Moussette; Adam S. Meyer - Web page: https://patentgrep.com/patent/US20190174088A1 ## CPC - H04N 5/44504: {Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits} - G02B 27/017: {Head mounted} - G06F 1/163: {Wearable computers, e.g. on a belt} - G06F 3/0233: {Character input methods} - G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A system may be provided in which input is gathered from a user with input-output devices. The input-output devices may include physical keyboards, touch screen displays, data gloves, and other input-output devices. Control circuitry in the system may use a head-mounted display, a display on a keyboard, and a display in a tablet computer or other electronic device to display images. Virtual reality content may be presented to a user with the head-mounted display. The virtual reality content may include virtual documents with virtual text, virtual keyboards with virtual keys, and other virtual objects. A virtual keyboard may be overlaid on top of a physical keyboard or on top of a keyboard display or touch screen display in a tablet computer or other electronic device. Virtual key labels may be updated in response to user key press input and other input. ## Claims ### Claim 1 A system, comprising: a touch screen display; a head-mounted display; and control circuitry configured to communicate with the touch screen display and the head-mounted display, wherein the control circuitry is further configured to: receive touch input from a user with the touch screen display; and display a virtual keyboard overlaid on the touch screen display with the head-mounted display. ### Claim 2 (depends on 1) The system defined in claim 1, wherein the control circuitry is configured to use the head-mounted display to display a virtual document for the user. ### Claim 3 (depends on 2) The system defined in claim 2, wherein the control circuitry is configured to display virtual text in the virtual document in response to the touch input received from the user with the touch screen display. ### Claim 4 (depends on 3) The system defined in claim 3, wherein the control circuitry is configured to receive the touch input with the touch screen display at the virtual keyboard. ### Claim 5 (depends on 3) The system defined in claim 3, wherein the control circuity is configured to display the virtual text without displaying content on the touch screen display that reveals the virtual text. ### Claim 6 (depends on 5) The system defined in claim 5, wherein the touch screen display is configured to be black while the virtual text is displayed by the head-mounted display. ### Claim 7 (depends on 5) The system defined in claim 5, wherein the control circuitry is configured to display a screen saver on the touch screen display while the virtual text is displayed by the head-mounted display. ### Claim 8 (depends on 5) The system defined in claim 5, wherein the control circuitry is configured to display a dummy text document on the touch screen display while the virtual text is displayed by the head-mounted display. ### Claim 9 (depends on 1) The system defined in claim 1, wherein the virtual keyboard overlaid on the touch screen display comprises virtual key labels. ### Claim 10 A system, comprising: a physical keyboard having physical keys and having a touch screen display; a head-mounted display; and control circuitry configured to: receive key press input from a user with the physical keys of the keyboard including key press input associated with pressing a letter key among the physical keys; and in response to receiving the key press input associated with pressing the letter key, use the head-mounted display to display virtual key labels overlaid on the touch screen display. ### Claim 11 (depends on 10) The system defined in claim 10, wherein the virtual key labels comprise accented versions of a letter that is associated with the letter key of the physical keyboard. ### Claim 12 (depends on 11) The system defined in claim 11, wherein the control circuitry is configured to use the touch screen display to gather touch input from the user to select between the accented versions of the letter. ### Claim 13 (depends on 10) The system defined in claim 10, wherein the control circuitry is configured to use the head-mounted display to display a virtual trackpad adjacent the physical keyboard. ### Claim 14 (depends on 13) The system defined in claim 13, further comprising: a camera configured to detect input from the user at the virtual trackpad. ### Claim 15 (depends on 13) The system defined in claim 13, wherein the touch screen display is a strip-shaped touch screen display formed on a first side of the physical keyboard and wherein the control circuitry is configured to use the head-mounted display to display the virtual trackpad on a second side of the physical keyboard. ### Claim 16 A system, comprising: a touch screen display; a head-mounted display; and control circuitry configured to communicate with the touch screen display and the head-mounted display, wherein the control circuitry is further configured to: receive touch input with the touch screen display; use the head-mounted display to display text on a virtual document based on the touch input; and display content on the touch screen display that does not reveal the text. ### Claim 17 (depends on 16) The system defined in claim 16, wherein the control circuitry is configured to display a screen saver on the touch screen display while using the head-mounted display to display the text on the virtual document. ### Claim 18 (depends on 16) The system defined in claim 16, wherein the control circuitry is configured to display dummy characters on the touch screen display while using the head-mounted display to display the text on the virtual document. ### Claim 19 (depends on 16) The system defined in claim 16, wherein the control circuitry is configured to display a black screen on the touch screen display while using the head-mounted display to display the text on the virtual document. ### Claim 20 (depends on 16) The system defined in claim 16, wherein the control circuitry does not update the content on the touch screen display when updating the text on the virtual document.