# US 2024/0202895 A1 · Optical sensor signal processing for visual artifact detection and display self-diagnostics

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202895 A1
- Document ID: US20240202895A1
- Status: Published application
- Kind: A1
- Application number: 18/459,774
- Filed: 2023-09-01
- Published: 2024-06-20
- Earliest claimed: 2022-12-15
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Ki-Chan LEE
- Web page: https://patentgrep.com/patent/US20240202895A1

## CPC

- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G09G 3/006: {Electronic inspection or testing of displays and display drivers, e.g. of LED or LCD displays (testing individual LED's G01R31/2635; testing lamps G01R31/44; testing of optical features of LCD displays G02F1/1309)}
- G09G 5/006: {Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04)}
- G06T 2207/30168: Image quality inspection
- G09G 2320/0247: Flicker reduction other than flicker reduction circuits used for single beam cathode-ray tubes
- G09G 2320/0257: Reduction of after-image effects
- G09G 2320/0693: Calibration of display systems
- G09G 2320/08: Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
- G09G 2330/10: Dealing with defective pixels
- G09G 2330/12: Test circuits or failure detection circuits included in a display system, as permanent part thereof
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/145: the light originating from the display screen
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Visual artifact detection systems and methods are disclosed herein. In an example system, optical characteristic measurements (e.g., a luminance value) for a display are obtained over a length of time, such as during power cycle events of a computing device coupled to the display. Based on the measurements, ripple values are generated, where each ripple value indicates a change of the optical characteristic over a period of time. A first ripple value is identified that exceeds a threshold and a first time window for identifying a subsequent ripple exceeding the threshold is commenced. If a second ripple value exceeds the threshold in the first time window, a determination is made that the first ripple value corresponds to a visual artifact on the display. In response, a visual artifact indication is generated, such as a notification to a user and/or a dynamic adjustment to a display parameter for remediating the artifact.

## Claims

### Claim 1

A system for self-diagnosing a visual artifact, comprising:
a display physically coupled to a computing device;
an optical sensor integral to the computing device that captures optical characteristic measurements of the display;
a processor circuit; and
a memory device that stores program code structured to cause the processor to:
generate a first ripple value and a second ripple value based on the optical characteristic measurements, the first ripple value and the second ripple value each representing a rate of a change of an optical characteristic;
determine that the first ripple value and the second ripple value exceed a threshold ripple value, the first ripple value and the second ripple value associated with optical characteristic measurements in a first time window;
in response to a determination that the first ripple value and the second ripple value exceed the threshold ripple value, determine that the first ripple value corresponds to a visual artifact; and
generate a visual artifact indication in response to a determination that the first ripple value corresponds to a visual artifact.

### Claim 2 (depends on 1)

The system of claim 1, wherein the visual artifact comprises one of a:
flashing;
shading;
flickering;
sparkling;
scrambling;
shifting;
juddering; or
shut down of one or more pixels.

### Claim 3 (depends on 1)

The system of claim 1, wherein the program code is further structured to cause the processor to:
generate a third ripple value and a fourth ripple value based on the optical characteristic measurements;
determine that the third ripple value and the fourth ripple value exceed the threshold ripple value, the third ripple value and the fourth ripple value associated with optical characteristic measurements in a second time window that has a length shorter than the first time window;
determine that the third ripple value does not correspond to a visual artifact.

### Claim 4 (depends on 1)

The system of claim 1, wherein the program code is further structured to cause the processor to:
generate a third ripple value based on the optical characteristic measurements;
determine that the third ripple value exceeds the threshold ripple value and is associated with optical characteristic measurements in the first time window;
in response to a determination that the third ripple value exceed the threshold ripple value in the first time window, determine that the first ripple value and second ripple value correspond to visual artifacts.

### Claim 5 (depends on 1)

The system of claim 1, wherein the visual artifact indication comprises at least one of:
a notification presented in a user interface identifying the visual artifact, or
a calibration signal to a computing component for altering an output provided to the display.

### Claim 6 (depends on 1)

The system of claim 1, wherein the optical sensor is adjacent to one or more keys of a keyboard housed in a base portion of the computing device, the base portion being movably attached to the display.

### Claim 7 (depends on 1)

The system of claim 1, further comprising:
a plurality of optical sensors housed in a base portion of the computing device, wherein the base portion of the computing device is rotatably attached to the display and each optical sensor is configured to capture the optical characteristic measurements of the display.

### Claim 8

A method for self-diagnosing a visual artifact, comprising:
capturing optical characteristic measurements of a display using an optical sensor integral to a computing device, the computing device physically coupled to the display;
generating a first ripple value and a second ripple value based on the optical characteristic measurements, the first ripple value and the second ripple value each representing a rate of a change of an optical characteristic;
determining that the first ripple value and the second ripple value exceed a threshold ripple value, the first ripple value and the second ripple value associated with optical characteristic measurements in a first time window;
in response to a determination that the first ripple value and the second ripple value exceed the threshold ripple value, determining that the first ripple value corresponds to a visual artifact; and
generating a visual artifact indication in response to a determination that the first ripple value corresponds to a visual artifact.

### Claim 9 (depends on 8)

The method of claim 8, wherein the visual artifact comprises one of a:
flashing;
shading;
flickering;
sparkling;
scrambling;
shifting;
juddering; or
shut down of one or more pixels.

### Claim 10 (depends on 8)

The method of claim 8, further comprising:
generating a third ripple value and a fourth ripple value based on the optical characteristic measurements;
determining that the third ripple value and the fourth ripple value exceed the threshold ripple value, the third ripple value and the fourth ripple value associated with optical characteristic measurements in a second time window that has a length shorter than the first time window;
determining that the third ripple value does not correspond to a visual artifact.

### Claim 11 (depends on 8)

The method of claim 8, further comprising:
generating a third ripple value based on the optical characteristic measurements;
determining that the third ripple value exceeds the threshold ripple value and is associated with optical characteristic measurements in the first time window;
in response to a determination that the third ripple value exceed the threshold ripple value in the first time window, determining that the first ripple value and second ripple value correspond to visual artifacts.

### Claim 12 (depends on 8)

The method of claim 8, wherein the visual artifact indication comprises at least one of:
a notification presented in a user interface identifying the visual artifact, or
a calibration signal to a computing component for altering an output provided to the display.

### Claim 13 (depends on 8)

The method of claim 8, wherein the optical sensor is adjacent to one or more keys of a keyboard housed in a base portion of the computing device, the base portion being movably attached to the display.

### Claim 14 (depends on 8)

The method of claim 8, wherein the capturing the optical characteristic measurements comprises:
capturing the optical characteristic measurements of the display using a plurality of optical sensors housed in a base portion of the computing device, wherein the base portion of the computing device is rotatably attached to the display.

### Claim 15

A computer-readable storage medium having computer program code recorded thereon that when executed by at least one processor causes the at least one processor to perform a method comprising:
capturing optical characteristic measurements of a display using an optical sensor integral to a computing device, the computing device physically coupled to the display;
generating a first ripple value and a second ripple value based on the optical characteristic measurements, the first ripple value and the second ripple value each representing a rate of a change of an optical characteristic;
determining that the first ripple value and the second ripple value exceed a threshold ripple value, the first ripple value and the second ripple value associated with optical characteristic measurements in a first time window;
in response to a determination that the first ripple value and the second ripple value exceed the threshold ripple value, determining that the first ripple value corresponds to a visual artifact; and
generating a visual artifact indication in response to a determination that the first ripple value corresponds to a visual artifact.

### Claim 16 (depends on 15)

The computer-readable storage medium of claim 15, wherein the visual artifact comprises one of a:
flashing;
shading;
flickering;
sparkling;
scrambling;
shifting;
juddering; or
shut down of one or more pixels.

### Claim 17 (depends on 15)

The computer-readable storage medium of claim 15, wherein the method further comprises:
generating a third ripple value based on the optical characteristic measurements;
determining that the third ripple value exceeds the threshold ripple value and is associated with optical characteristic measurements in the first time window;
in response to a determination that the third ripple value exceed the threshold ripple value in the first time window, determining that the first ripple value and second ripple value correspond to visual artifacts.

### Claim 18 (depends on 15)

The computer-readable storage medium of claim 15, wherein the visual artifact indication comprises at least one of:
a notification presented in a user interface identifying the visual artifact, or
a calibration signal to a computing component for altering an output provided to the display.

### Claim 19 (depends on 15)

The computer-readable storage medium of claim 15, wherein the optical sensor is adjacent to one or more keys of a keyboard housed in a base portion of the computing device, the base portion being movably attached to the display.

### Claim 20 (depends on 15)

The computer-readable storage medium of claim 15, wherein the capturing the optical characteristic measurements comprises:
capturing the optical characteristic measurements of the display using a plurality of optical sensors housed in a base portion of the computing device, wherein the base portion of the computing device is rotatably attached to the display.
