# US 11,115,596 B2 · Full-screen display with sub-display camera > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,115,596 B2 - Document ID: US11115596B2 - Status: Granted - Kind: B2 - Application number: 16/671,896 - Filed: 2019-11-01 - Published: 2021-05-06 - Granted: 2021-09-07 - Earliest claimed: 2019-11-01 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Ping Tong Chu; Chung Chun Wan - Web page: https://patentgrep.com/patent/US11115596B2 ## CPC - H04M 1/0264: {for a camera module assembly} - H04N 23/63: by using electronic viewfinders - G02B 26/0816: {by means of one or more reflecting elements} - G06F 1/1686: {the I/O peripheral being an integrated camera} - G09G 3/3208: organic, e.g. using organic light-emitting diodes [OLED] - H04M 1/0266: {for a display module assembly} - H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images - H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof - H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract An apparatus includes a camera, a primary display panel including a pixel array and an aperture adjacent the pixel array, an auxiliary display, and an optical assembly including a reflecting optical element and an actuator coupled to the reflecting optical element. The actuator is configured to switch the reflecting optical element between a first arrangement and a second arrangement. The first arrangement defines an optical path from the aperture to the camera and the second arrangement defines an optical path from the aperture to the auxiliary display. ## Claims ### Claim 1 An apparatus, comprising: a camera; a primary display panel comprising a first pixel array and an aperture adjacent the first pixel array; an auxiliary display comprising a second pixel array; and an optical assembly comprising a reflecting optical element and an actuator coupled to the reflecting optical element, the actuator being configured to switch the reflecting optical element between a first arrangement and a second arrangement, wherein in the first arrangement defines an optical path from the aperture to the camera and the second arrangement defines an optical path from the aperture to the auxiliary display. ### Claim 2 (depends on 1) The apparatus of claim 1, further comprising an electronic control module in communication with the camera, the primary display panel, the auxiliary display, and the actuator, the electronic control module being programmed to operate the camera when the optical assembly is in the first arrangement and to operate the auxiliary display when the optical assembly is in the second arrangement. ### Claim 3 (depends on 2) The apparatus of claim 2, wherein the electronic control module is programmed to synchronize operation of the primary display panel and the auxiliary display to present a continuous image across the aperture in the display panel. ### Claim 4 (depends on 1) The apparatus of claim 1, wherein the primary display panel and the auxiliary display have the same pixel density. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein the primary display panel is an OLED display panel. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the auxiliary display is an OLED display. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the aperture forms a notch in the pixel array. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein the reflecting optical element is a prism comprising a reflecting surface. ### Claim 9 (depends on 8) The apparatus of claim 8, wherein the actuator is configured to rotate the prism to change an orientation of the reflecting surface with respect to the aperture axis. ### Claim 10 (depends on 1) The apparatus of claim 1, wherein the actuator is configured to switch the reflecting optical element between one or more additional arrangements, wherein each of the one or more additional arrangements define a corresponding optical path from the aperture different from the optical paths of the first and second arrangements. ### Claim 11 (depends on 10) The apparatus of claim 10, wherein each of the optical paths of the additional arrangements are from the aperture to a sensor or emitter. ### Claim 12 (depends on 1) The apparatus of claim 1, wherein the apparatus is a mobile phone. ### Claim 13 (depends on 1) The apparatus of claim 1, wherein the apparatus is a tablet computer. ### Claim 14 A method, comprising: receiving light through an aperture in a primary display panel; directing the light, via a reflecting optical element, to a camera located behind the primary display panel; acquiring an image of a scene in front of the primary display using the camera; reorienting the reflecting optical element to receive light from an auxiliary display located behind the primary display panel; and directing light from the auxiliary display, via the reflecting optical element, through the aperture, the light from the auxiliary display and light from the primary display panel providing an imagery displayed a device. ### Claim 15 (depends on 14) The method of claim 14, wherein the reflecting optical element is reoriented by rotating the reflecting optical element. ### Claim 16 (depends on 14) The method of claim 14, wherein the reflecting optical element is reoriented in response to a camera activation from a user of the device.