# US 2019/0377072 A1 · A 3d-camera device including a dirt detection unit

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0377072 A1
- Document ID: US20190377072A1
- Status: Published application
- Kind: A1
- Application number: 16/489,137
- Filed: 2018-02-22
- Published: 2019-12-12
- Earliest claimed: 2017-02-27
- Assignees: Veoneer Sweden AB
- Applicants: Veoneer Sweden AB
- Inventors: RICKARD ASTROM; EVELINA ERIKSSON; JONAS WIHLBECK; HALLSTIG EMIL
- Web page: https://patentgrep.com/patent/US20190377072A1

## CPC

- G01S 7/497: Means for monitoring or calibrating
- G02B 27/0006: {with means to keep optical surfaces clean, e.g. by preventing or removing dirt, stains, contamination, condensation (G02B1/18 takes precedence; cleaning in general B08B)}
- G01S 7/4815: {using multiple transmitters}
- G01S 17/894: Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
- G08B 21/182: {Level alarms, e.g. alarms responsive to variables exceeding a threshold}
- H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects
- H04N 13/296: Synchronisation thereof; Control thereof
- H04N 17/002: {for television cameras}
- H04N 23/811: {by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor}
- G01S 2007/4975: {of sensor obstruction by, e.g. dirt- or ice-coating, e.g. by reflection measurement on front-screen}
- H04N 23/50: Constructional details
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A 3D-camera device (1) comprising a Time-Of-Flight sensor (5) and a light guide (4) with a light transparent cover (3). A light source (6) is arranged to emit light (7) into the transparent cover (3), whereby at least a portion (10) of the emitted light (7) is reflected out through a second portion (3.1) of the transparent cover (3) by dirt (100) present on the outer surface (3.20) of the transparent cover (3). The Time-Of-Flight sensor (5) is arranged to receive light (10) reflected by dirt (100) on the outer surface (3.20) of the transparent cover (3) and to output a signal (L) relative the amount of received reflected light (10). A control unit (20) configured to determine the presence of dirt (100) on the outer surface (3.20) of the transparent cover (3) from the magnitude of the signal (L) from the Time-Of-Flight sensor (5).

## Claims

### Claim 1

A 3D-camera device comprising,
a light guide,
a Time-of Flight sensor,
wherein the light guide has a first end for receiving incident light and a second end for emitting received light directed towards the Time-of Flight sensor wherein the first end comprises a light transparent cover having a first portion comprising an outer surface facing the external surroundings of the 3D-camera device,
a dirt detection unit for detecting dirt on the outer surface of the transparent cover:
the dirt detection unit including a light source arranged to provide emitted light into the transparent cover, wherein the emitted light is directed in a predetermined angle such that at least a portion of the emitted light is reflected out through a second portion of the transparent cover by dirt present on the outer surface of the transparent cover, and, wherein;
the Time-of-Flight sensor is arranged to receive the portion of emitted light reflected by dirt on the outer surface of the transparent cover and to output a signal having a magnitude relative the amount of the received portion of emitted reflected light, and;
a control unit connected to the Time-of-Flight sensor configured to determine the presence of the dirt on the outer surface of the transparent cover from the magnitude of the signal from the Time-of-Flight sensor.

### Claim 2 (depends on 1)

The 3D-camera device according to claim 1 further comprising wherein the control unit is configured to:
switch the light source between an off-state in which no light is emitted from the light source and an on-state in which light is emitted from the light source such that light is emitted as a light pulse from the light source, and to
control the Time-of-Flight sensor to perform an exposure and to;
synchronize the exposure of the Time-of-Flight sensor with the light pulse such that an end of the exposure overlaps a beginning of the light pulse.

### Claim 3 (depends on 1)

The 3D-camera device according to claim 1 further comprising the control unit is configured to:
switch the light source repeatedly between an on-state and an off-state such that a series of light pulses are emitted from the light source and to;
control the Time-of-Flight sensor to perform a first series of exposures which are synchronized with the series of light pulses from the light source such an end of each exposure overlaps a beginning of the light pulse, and to;
control the Time-of-Flight sensor to perform a second series of exposures which are synchronized with the first series of light pulses from the light source such that each of the exposures is performed prior to the beginning of a light pulse and to;
determine the presence of the dirt on the outer cover of the transparent cover from the difference between the magnitude of the signal from the first series of exposures and from the second series of exposures thereby providing a dirt magnitude signal.

### Claim 4 (depends on 2)

The 3D-camera device according to claim 2 further comprising wherein, when the light source is in the off-state, the Time-of-Flight sensor outputs at least a first off-light magnitude signal and, when the light source is in the on-state, and outputs at least a first on-light magnitude signal, wherein the control unit is configured to;
determine the difference between the at least first off-light magnitude signal and the at least first on-light magnitude signal; and
output at least a first of the dirt magnitude signal indicative of the magnitude of the difference between the at least first off-light magnitude signal and the at least first on-light magnitude signal.

### Claim 5 (depends on 2)

The 3D-camera device according to claim 2 further comprising wherein, when the light source is in the off-state, the Time-of-Flight sensor outputs a plurality of individual off-light magnitude signals and, when the light source is in the on-state, outputs a plurality of individual on-light magnitude signals wherein the control unit is configured to, determine a plurality of individual of the dirt magnitude values from the difference between the individual off-light magnitude signals and the individual on-light magnitude signals and;
output the dirt magnitude signal indicative of difference between the individual off-light magnitude signals and the individual on-light magnitude signals.

### Claim 6 (depends on 5)

The 3D-camera device according to claim 5 further comprising wherein the dirt magnitude signal is indicative of the difference between an integration or an average magnitude of the individual off-light magnitude signals and an integration or an average magnitude of the individual on-light magnitude signals.

### Claim 7 (depends on 4)

The 3D-camera device according to claim 4 wherein the control unit comprises a dirt alert unit and a memory comprising predetermined threshold values for the dirt magnitude signal, wherein the control unit is arranged to compare the dirt magnitude signal with the predetermined threshold values, and to output an alert signal on the user alert interface when the dirt magnitude signal exceeds a predetermined threshold value.

### Claim 8 (depends on 1)

The 3D-camera device according to claim 1 further comprising a housing having an wall portion, wherein the transparent cover is arranged in the wall portion, thereby forming a window in the housing.

### Claim 9 (depends on 1)

The 3D-camera device according to claim 1 wherein the light source is arranged to emit the light into the second portion of the transparent cover in a direction of the outer surface.

### Claim 10 (depends on 1)

The 3D-camera device according to claim 1 wherein the second portion of the transparent cover comprises an inner surface of a circumferential edge surface of the transparent cover.

### Claim 11 (depends on 10)

The 3D-camera device according to claim 10 further comprising wherein the light source is arranged to emit the light into one of the inner surface and the circumferential edge surface of the transparent cover and wherein the predetermined angle is selected such that at least a portion of the emitted light is reflected out through the inner surface of the transparent cover by the dirt present on the outer surface of the transparent cover.

### Claim 12 (depends on 1)

The 3D-camera device according to claim 1 further comprising wherein the light guide is an optical lens or an arrangement of several optical lenses or a camera lens.

### Claim 13 (depends on 1)

The 3D-camera device according to claim 1 further comprising wherein the predetermined angle is selected such that a first portion of the emitted light is transmitted through the inner surface of the transparent cover and a second portion of the emitted light is directly reflected by the inner surface of the transparent cover, and such that the directly reflected light is directed away from the Time-of-Flight sensor.
