# US 2020/0404233 A1 · Light source response compensation for light projection system using a graphics processing unit

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404233 A1
- Document ID: US20200404233A1
- Status: Published application
- Kind: A1
- Application number: 17/012,938
- Filed: 2020-09-04
- Published: 2020-12-24
- Earliest claimed: 2017-12-21
- Assignees: STMicroelectronics S.r.l.
- Applicants: STMicroelectronics Ltd; STMicroelectronics S.r.l.
- Inventors: Massimo RATTI; Eli YASER; Naomi PETRUSHEVSKY; Yotam NACHMIAS
- Web page: https://patentgrep.com/patent/US20200404233A1

## CPC

- H04N 9/3182: {Colour adjustment, e.g. white balance, shading or gamut (white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607)}
- G02B 26/0833: {the reflecting element being a micromechanical device, e.g. a MEMS mirror, DMD (G02B26/0825 takes precedence; micromechanical devices in general B81B)}
- G02B 26/0858: {the reflecting means being moved or deformed by piezoelectric means}
- G02B 26/101: {with both horizontal and vertical deflecting means, e.g. raster or XY scanners (colour television using laser beams scanning a display screen H04N9/3129)}
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- H04N 9/3135: {Driving therefor}
- G02B 27/017: {Head mounted}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A light projection system includes a microelectromechanical (MEMS) mirror configured to operate in response to a mirror drive signal and to generate a mirror sense signal as a result of the operation. A mirror driver is configured to generate the mirror drive signal in response to a drive control signal. A zero cross detector is configured to detect zero crosses of the mirror sense signal. A controller is configured to generate the drive control signal as a function of the detected zero crosses of the mirror sense signal.

## Claims

### Claim 1

A light projection system, comprising:
a microelectromechanical (MEMS) mirror configured to operate in response to a mirror drive signal and to generate a mirror sense signal as a result of the operation;
a mirror driver configured to generate the mirror drive signal in response to a drive control signal;
a zero cross detector configured to detect zero crosses of the mirror sense signal; and
a controller configured to generate the drive control signal as a function of the detected zero crosses of the mirror sense signal.

### Claim 2 (depends on 1)

The light projection system of claim 1, wherein the controller generates the drive control signal as a function of the detected zero crosses by: setting the drive control signal so that transitions of the mirror drive signal occur as a function of the detected zero crosses.

### Claim 3 (depends on 2)

The light projection system of claim 2, wherein the controller sets the drive control signal so that the transitions of the mirror drive signal occur as a function of the detected zero crosses by:
determining peaks of the mirror sense signal as a function of the detected zero crosses; and
adjusting the drive control signal so that transitions of the mirror drive signal occur at the determined peaks.

### Claim 4 (depends on 3)

The light projection system of claim 3, wherein the controller determines the peaks of the mirror sense signal as a function of the detected zero crosses by:
measuring elapsed time between successive detected zero crosses;
determining a gap value to be equal to one half the measured elapsed time between successive detected zero crosses; and
determining the peaks of the mirror sense signal to occur at times spaced apart from the detected zero crosses by the gap value.

### Claim 5 (depends on 4)

The light projection system of claim 4, wherein the controller measures the elapsed time between successive detected zero crosses by counting a number of clock cycles between successive detected zero crosses; and wherein the controller determines the gap value to be equal to one half the measured elapsed time by determining the gap value to be equal to one half the number of counted clock cycles between successive detected zero crosses.

### Claim 6 (depends on 5)

The light projection system of claim 5, wherein the controller is further configured to compensate the determined gap value by subtracting a response delay time from the gap value.

### Claim 7 (depends on 6)

The light projection system of claim 6, wherein the response delay time is an elapsed time between generation of a given value of the mirror sense signal and determination of one half the number of counted clock cycles between successive detected zero crosses.

### Claim 8 (depends on 1)

The light projection system of claim 1, wherein the controller, in an initial setup mode, is configured to set the drive control signal so that transitions of the mirror drive signal occur at expected peaks of the mirror sense signal, and thereafter, in a normal operation mode, is configured to determine peaks of the mirror sense signal as a function of the detected zero crosses, and set the drive control signal so that transitions of the mirror drive signal occur at the determined peaks.

### Claim 9 (depends on 8)

The light projection system of claim 8, wherein the controller, in the normal operation mode, determines the peaks of the mirror sense signal as a function of the detected zero crosses by:
measuring elapsed time between successive detected zero crosses;
determining a gap value to be equal to one half the measured elapsed time between successive detected zero crosses; and
determining the peaks of the mirror sense signal to occur at times spaced apart from the detected zero crosses by the gap value.

### Claim 10 (depends on 9)

The light projection system of claim 9, wherein the controller, in the normal operation mode, measures the elapsed time between successive detected zero crosses by counting a number of clock cycles between successive detected zero crosses; and wherein the controller determines the gap value to be equal to one half the measured elapsed time by determining the gap value to be equal to one half the number of counted clock cycles between successive detected zero crosses.

### Claim 11 (depends on 1)

The light projection system of claim 1, further comprising:
a laser configured to emit a laser beam directed at the MEMS mirror so that the MEMS mirror reflects the laser beam across the surface in a scan pattern;
a processing unit configured to:
receive video data containing video images for display;
estimate positions of the laser beam on the surface as the MEMS mirror reflects the laser beam across the surface in the scan pattern, with some of the estimated positions being within a designated display area for video images within video data and with some of the estimated positions being designated as calibration positions; and
process the video data based upon the estimated positions, the processing including adding calibration pixels to the video data for display in the calibration positions;
a laser driver configured to control the laser as a function of the processed video data such that the video images are displayed within the designated display area and such that the calibration pixels are displayed in the calibration positions; and
photodetection circuitry configured to detect display of the calibration pixels.

### Claim 12

A method, comprising steps of:
a) generating a drive control signal for a mirror driver that generates a mirror drive signal in response to the drive control signal, the drive control signal being generated so that transitions of the mirror drive signal occur at expected peaks of an expected mirror sense signal;
b) receiving an actual mirror sense signal from a microelectromechanical (MEMS) mirror driven by the mirror drive signal;
c) detecting zero crosses of the actual mirror sense signal;
d) determining when the actual mirror sense signal actually peaks as a function of the detected zero crosses;
e) adjusting the drive control signal such that the transitions of the mirror drive signal occur at the actual peaks of the actual mirror sense signal; and
f) returning to step b).

### Claim 13 (depends on 12)

The method of claim 12, wherein step d) is performed by measuring an elapsed time between successive detected zero crosses and determining that the actual mirror sense signal actually peaks at times spaced apart from the detected zero crosses by one half the measured elapsed time.

### Claim 14 (depends on 13)

The method of claim 13, wherein the elapsed time between successive zero crosses is measured by counting a number of clock cycles between the successive zero crosses, and wherein one half the measured elapsed time is equal to one half the counted number of clock cycles.

### Claim 15 (depends on 13)

The method of claim 13, further comprising compensating the measured elapsed time to accommodate for a delay in performing steps b), c), and d).

### Claim 16

A light projection system, comprising:
a microelectromechanical (MEMS) mirror configured to operate in response to a mirror drive signal and to generate a mirror sense signal as a result of the operation of the MEMS mirror in response to the mirror drive signal;
a mirror driver configured to generate the mirror drive signal in response to a drive control signal;
a controller configured to:
a) receive the mirror sense signal from the MEMS mirror;
b) obtain a first sample of the mirror sense signal at a first phase of the mirror drive signal;
c) obtain a second sample of the mirror sense signal at a second phase of the mirror drive signal, wherein the first and second phases are separated by a half period of the mirror drive signal, with the second phase occurring after the first phase; and
d) generate the drive control signal as a function of a difference between the first and second samples so as to keep the mirror drive signal separated in phase from the mirror sense signal by a desired amount of phase separation.

### Claim 17 (depends on 16)

The light projection system of claim 16, wherein the desired amount of phase separation is 90 degrees.

### Claim 18 (depends on 16)

The light projection system of claim 16, wherein the first phase is 90 degrees and the second phase is 270 degrees.

### Claim 19 (depends on 16)

The light projection system of claim 16, wherein the desired amount of phase separation is a phase separation at which the MEMS mirror is operating at its resonance frequency.

### Claim 20 (depends on 16)

The light projection system of claim 16, wherein the desired amount of phase separation is a phase separation at which the first and second samples are equal.

### Claim 21 (depends on 16)

The light projection system of claim 16, wherein the first sample being less than the second sample indicates that the phase separation between the mirror drive signal and mirror sense signal is less than 90 degrees; and wherein the mirror generates the drive control signal so as to increase the phase separation to 90 degrees.

### Claim 22 (depends on 16)

The light projection system of claim 16, wherein the first sample being greater than the second sample indicates that the phase separation between the mirror drive signal and mirror sense signal is greater than 90 degrees; and wherein the mirror generates the drive control signal so as to decrease the phase separation to 90 degrees.

### Claim 23 (depends on 16)

The light projection system of claim 16, wherein the controller is configured to, in an initial setup mode, generate the drive control signal so that the mirror drive signal is expected to be separated in phase from the mirror sense signal by the desired amount, and thereafter, in a normal operation mode, perform a), b), c), and d).

### Claim 24

A light projection system, comprising:
a microelectromechanical (MEMS) mirror configured to operate based on a mirror drive signal and to generate a mirror sense signal as a result of the operation of the MEMS mirror based upon the mirror drive signal;
a mirror driver configured to generate the mirror drive signal in response to a drive control signal;
a controller configured to:
a) receive the mirror sense signal from the MEMS mirror;
b) obtain first and seconds samples of the mirror sense signal; and
c) generate the drive control signal such the first and second samples are equal.

### Claim 25 (depends on 24)

The light projection system of claim 24, wherein the controller obtains the first and second samples at phases of the mirror drive signal at which the first and second samples would be expected to be equal, and the controller generates the drive control signal such that the first and second samples are actually equal.

### Claim 26 (depends on 24)

The light projection system of claim 24, wherein the first and second samples being equal indicates that the mirror drive signal and the mirror sense signal are separated in phase by a desired amount.

### Claim 27 (depends on 24)

The light projection system of claim 24, wherein the first and second samples being equal indicates that the MEMS mirror is operating at its resonance frequency.

### Claim 28 (depends on 24)

The light projection system of claim 24, wherein the controller is configured to, in an initial setup mode, generate the drive control so that the first and second samples will be expected to be equal, and thereafter, in a normal operation mode, perform a), b), and c) so that the first and second samples are actually equal.

### Claim 29

A method, comprising steps of:
a) generating a mirror drive signal in response to a drive control signal and applying the mirror drive signal to a microelectromechanical (MEMS) mirror to drive oscillation of that mirror;
b) sampling a mirror sense signal produced by the MEMS mirror twice to produce first and second samples, the first sample being sampled when the mirror drive signal is at a first phase, the second sample being sampled when the mirror drive signal is at a second phase that occurs subsequent to the first phase by half a period of the mirror drive signal;
c) determining a difference between the first and second samples;
d) adjusting the drive control signal based upon the difference, if the difference is other than zero; and
e) returning to step a).

### Claim 30 (depends on 29)

The method of claim 29, wherein the adjustment of the drive control signal serves to adjust a phase of the mirror drive signal so as to be separated from that of the mirror sense signal by 90 degrees, thereby operating the MEMS mirror at its resonance frequency.

### Claim 31 (depends on 29)

The method of claim 29, wherein the adjustment of the drive control signal serves to adjust the phase of the mirror drive signal so as to be separated from that of the mirror sense signal by a desired phase difference, thereby operating the MEMS near its resonance frequency.

### Claim 32 (depends on 29)

The method of claim 29, wherein the first phase is 90 degrees and the second phase is 270 degrees.

### Claim 33 (depends on 29)

The method of claim 29, wherein the first sample being less than the second sample results in the adjustment of the drive control signal at step d) such that a frequency of the mirror drive signal decreases.

### Claim 34 (depends on 29)

The method of claim 29, wherein the first sample being greater than the second sample results in the adjustment of the drive control signal at step d) such that a frequency of the mirror drive signal increases.

### Claim 35 (depends on 29)

The method of claim 29, wherein the adjustment of the drive control signal is expected to cause the mirror drive signal to be separated from the mirror sense signal by 90 degrees of phase.

### Claim 36 (depends on 29)

The method of claim 29, wherein the drive control signal after adjustment is expected to result in the mirror drive signal operating the MEMS mirror near or at its resonance frequency.
