# US 11,994,686 B2 · Computing device with live background and related method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,994,686 B2 - Document ID: US11994686B2 - Status: Granted - Kind: B2 - Application number: 17/647,092 - Filed: 2022-01-05 - Published: 2023-05-25 - Granted: 2024-05-28 - Earliest claimed: 2021-11-25 - Assignees: Citrix Systems, Inc. - Applicants: Citrix Systems, Inc. - Inventors: Qiming Li; Dai Li; Zhenxing Liu - Web page: https://patentgrep.com/patent/US11994686B2 ## CPC - G02B 27/0179: {Display position adjusting means not related to the information to be displayed} - G09G 5/026: {Control of mixing and/or overlay of colours in general (G09G5/022 and G09G5/024 take precedence)} - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/017: {Head mounted} - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G09G 5/003: {Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto (specific for a CRT G09G1/165; for a flat panel G09G3/2092)} - G09G 5/14: Display of multiple viewports - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G09G 2320/103: Detection of image changes, e.g. determination of an index representative of the image change - G09G 2340/12: Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels - G09G 2340/125: wherein one of the images is motion video - G09G 2340/14: Solving problems related to the presentation of information to be displayed - G09G 2354/00: Aspects of interface with display user - G09G 2370/20: Details of the management of multiple sources of image data - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A computing device includes an image sensor, an IMU, a display, and a processor coupled to the image sensor, the IMU, and the display. The processor is configured to generate a GUI current screen on the display. The GUI current screen includes a background, and foreground GUI elements overlaying the background. The processor is configured to when the IMU generates motion data indicative of movement, render the background to comprise a video image from the image sensor. ## Claims ### Claim 1 A method of operating a computing device comprising: a processor, an image sensor, an inertial measurement unit (IMU), and a touchscreen display; the processor coupled to the image sensor, the IMU, and the touchscreen display, the processor configured to generate a graphical user interface (GUI) current screen on the touchscreen display, the GUI current screen comprising a chat application with an opaque background, and a plurality of foreground GUI elements overlaying the opaque background, the foreground elements including textual elements; in response to the IMU generating motion data indicative of walking or running movement and detecting user input applied through the touchscreen display, replace the opaque background of the chat application with a video image from the image sensor. ### Claim 2 (depends on 1) The method of claim 1 further comprising operating the processor to, when the IMU generates the motion data indicative of movement and when ambient illumination is less than a threshold, activate a flash device in the computing device and render the opaque background to comprise the video image from the image sensor. ### Claim 3 (depends on 1) The method of claim 1 further comprising operating the processor to replace the opaque background of the chat application with the video image from the image sensor until a set time period expires. ### Claim 4 A computing device comprising: an image sensor; an inertial measurement unit (IMU); a touchscreen display; and a processor coupled to the image sensor, the IMU, and the touchscreen display, the processor configured to generate a graphical user interface (GUI) current screen on the touchscreen display, the GUI current screen comprising a chat application with an opaque background, and a plurality of foreground GUI elements overlaying the opaque background, the foreground elements including textual elements, and in response to the IMU generating motion data indicative of walking or running movement and detecting user input applied through the touchscreen display, replace the opaque background of the chat application with a video image from the image sensor. ### Claim 5 (depends on 4) The computing device of claim 4 further comprising a flash device adjacent the image sensor; and wherein the processor is configured to, when the IMU generates the motion data indicative of movement and when ambient illumination is less than a threshold, activate the flash device and render the opaque background to comprise the video image from the image sensor. ### Claim 6 (depends on 4) The computing device of claim 4 wherein the processor is configured to replace the opaque background of the chat application with the video image from the image sensor until a set time period expires. ### Claim 7 (depends on 4) The computing device of claim 4 further comprising a housing carrying the image sensor, the IMU, the touchscreen display, and the processor; and wherein the image sensor is carried by a major surface of the housing, the major surface being opposite the touchscreen display. ### Claim 8 (depends on 4) The computing device of claim 4 wherein the video image from the image sensor comprises a live video image. ### Claim 9 A computing device comprising: an image sensor; an inertial measurement unit (IMU); a touchscreen display; and a processor coupled to the image sensor, the IMU, and the touchscreen display, the processor configured to generate a graphical user interface (GUI) current screen on the touchscreen display, the GUI current screen comprising a chat application with an opaque background, and a plurality of foreground GUI elements overlaying the opaque background, the foreground elements including textual chat elements, and in response to the IMU generating motion data indicative of walking movement and detecting user input applied through the touchscreen display, replace the opaque background with a live video image from the image sensor. ### Claim 10 (depends on 9) The computing device of claim 9 further comprising a flash device adjacent the image sensor; and wherein the processor is configured to, when the IMU generates the motion data indicative of at least one walking movement, when the touch user input is detected, and when ambient illumination is less than a threshold, activate the flash device and render the opaque background to comprise the live video image from the image sensor. ### Claim 11 (depends on 9) The computing device of claim 9 wherein the processor is configured to replace the opaque background with the live video image from the image sensor until a set time period expires. ### Claim 12 (depends on 9) The computing device of claim 9 further comprising a housing carrying the image sensor, the IMU, the touchscreen display, and the processor; and wherein the image sensor is carried by a major surface of the housing, the major surface being opposite the touchscreen display.