# US 2021/0243101 A1 · System-latency-aware display device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0243101 A1 - Document ID: US20210243101A1 - Status: Published application - Kind: A1 - Application number: 16/893,327 - Filed: 2020-06-04 - Published: 2021-08-05 - Earliest claimed: 2020-02-04 - Assignees: NVIDIA Corporation - Applicants: Nvidia Corporation - Inventors: Joohwan Kim; Benjamin Boudaoud; Josef B. Spjut; Morgan S. McGuire; Seth P. Schneider; Rouslan L. Dimitrov; Lars Nordskog; Cody J. Robson; Sau Yan Keith Li; Gerrit Ary Slavenburg; Tom J. Verbeure - Web page: https://patentgrep.com/patent/US20210243101A1 ## CPC - G09G 3/006: {Electronic inspection or testing of displays and display drivers, e.g. of LED or LCD displays (testing individual LED's G01R31/2635; testing lamps G01R31/44; testing of optical features of LCD displays G02F1/1309)} - H04L 43/106: using time related information in packets, e.g. by adding timestamps - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining - G09G 5/14: Display of multiple viewports - H04L 43/045: for graphical visualisation of monitoring data - H04L 43/0852: Delays - H04L 43/0858: {One way delays} - G09G 2310/08: Details of timing specific for flat panels, other than clock recovery - G09G 2330/12: Test circuits or failure detection circuits included in a display system, as permanent part thereof - G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas - G09G 2354/00: Aspects of interface with display user - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A display device for measuring the end-to-end latency of a computing system. The computing system includes an input device, a computing device, and the display device. The display device is directly connected with the input device and receives input data packets generated by the input device in response to received user input events. The display device passes the input packets to the computing device for graphics processing. The display device measures the end-to-end latency comprising the sum of three latencies. A first latency comprises an input delay of the input device. A second latency comprises an amount of time between generation of the input packet and a corresponding change in pixel values caused by the input event at the display device. A third latency comprises a display latency. The display device also displays latency information associated with the measured end-to-end latency. ## Claims ### Claim 1 A computer-implemented method for determining a system latency, the method comprising: detecting an input packet that has been generated in response to an input event received by an input device; generating a first timestamp in response to detecting the input packet; detecting a change in one or more pixel values that are associated with one or more target pixel locations within a display screen of a display device and caused by the input event; generating a second timestamp in response to detecting the change in the one or more pixel values; and determining the system latency based on the first timestamp and the second timestamp. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, further comprising displaying information associated with the system latency to a user via a user interface. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein detecting the change in the one or more pixel values comprises detecting that the one or more pixel values have changed by at least a threshold amount. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, further comprising determining an input latency associated with the input device, wherein the system latency is further based on the input latency. ### Claim 5 (depends on 4) The computer-implemented method of claim 4, wherein the input latency comprises an amount of time between when the input event occurs and when the input packet is generated in response to the input event. ### Claim 6 (depends on 4) The computer-implemented method of claim 4, wherein the input latency comprises an estimated input latency associated with the input device. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, further comprising determining a display latency associated with the display device, wherein the system latency is further based on the display latency. ### Claim 8 (depends on 7) The computer-implemented method of claim 7, wherein the display latency comprises an amount of time between when the change in the one or more pixel values of the one or more target pixel locations and when a corresponding photon event occurs on the display screen of the display device. ### Claim 9 (depends on 7) The computer-implemented method of claim 7, wherein display latency comprises an estimated display latency based on a screen resolution and a refresh rate of the display device. ### Claim 10 (depends on 1) The computer-implemented method of claim 1, wherein the system latency is further based on an input latency and a display latency. ### Claim 11 One or more non-transitory computer-readable media including instructions that, when executed by one or more processors, cause the one or more processors to determine a system latency by performing the steps of: detecting an input packet that has been generated in response to an input event received by an input device; generating a first timestamp in response to detecting the input packet; detecting a change in one or more pixel values that are associated with one or more target pixel locations within a display screen of a display device and caused by the input event; generating a second timestamp in response to detecting the change in the one or more pixel values; and determining the system latency based on the first timestamp and the second timestamp. ### Claim 12 (depends on 11) The one or more non-transitory computer-readable media of claim 11, further comprising displaying information associated with the system latency to a user via a user interface. The one or more non-transitory computer-readable media of claim 11, wherein detecting the change in the one or more pixel values comprises detecting that the one or more pixel values have changed by at least a threshold amount. ### Claim 14 (depends on 11) The one or more non-transitory computer-readable media of claim 11, further comprising determining an input latency associated with the input device, wherein the system latency is further based on the input latency. ### Claim 15 (depends on 11) The one or more non-transitory computer-readable media of claim 11, further comprising determining a display latency associated with the display device, wherein the system latency is further based on the display latency. ### Claim 16 A display device, comprising: a display screen; and a latency engine that determines a system latency by performing the steps of: detecting an input packet that has been generated in response to an input event received by an input device; generating a first timestamp in response to detecting the input packet; detecting a change in one or more pixel values that are associated with one or more target pixel locations within the display screen and caused by the input event; generating a second timestamp in response to detecting the change in the one or more pixel values; and determining the system latency based on the first timestamp and the second timestamp. ### Claim 17 (depends on 16) The display device of claim 16, wherein the latency engine performs the additional steps of determining an input latency associated with the input device, wherein the input packet is generated by the input device, and the input device is directly connected to the display device. ### Claim 18 (depends on 17) The display device of claim 17, wherein the input latency comprises an amount of time between when the input event occurs and when the input packet is generated in response to the input event. ### Claim 19 (depends on 16) The display device of claim 16, wherein the latency engine performs the additional steps of determining a display latency associated with the display device, wherein the system latency is further based on the display latency. ### Claim 20 (depends on 19) The display device of claim 19, wherein the display latency comprises an estimated display latency based on a screen resolution and a refresh rate of the display device.