# US 2020/0264281 A1 · Computation device, sensing device and processing method based on time of flight

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0264281 A1
- Document ID: US20200264281A1
- Status: Published application
- Kind: A1
- Application number: 16/660,823
- Filed: 2019-10-23
- Published: 2020-08-20
- Earliest claimed: 2019-02-19
- Assignees: Lite-On Electronics (Guangzhou) Limited; Lite-On Technology Corporation
- Applicants: Lite-On Electronics (Guangzhou) Limited; Lite-On Technology Corporation
- Inventors: Shou-Te Wei; Wei-Chih Chen; Jun-Hao Wu
- Web page: https://patentgrep.com/patent/US20200264281A1

## CPC

- G01S 7/4808: {Evaluating distance, position or velocity data}
- G01S 17/894: Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
- G01S 7/4915: Time delay measurement, e.g. operational details for pixel components (signal extraction and conditioning G01S7/493); Phase measurement
- G01S 7/4918: {Controlling received signal intensity, gain or exposure of sensor}
- G01S 17/10: using transmission of interrupted, pulse-modulated waves (determination of distance by phase measurements G01S17/32)
- G01S 17/32: using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated
- G01S 17/36: with phase comparison between the received signal and the contemporaneously transmitted signal
- G01S 17/89: for mapping or imaging
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 2207/20201: Motion blur correction
- G06T 2207/30168: Image quality inspection
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A computation device, a sensing device and a processing method based on time-of-flight (ToF) ranging are provided. In the method, intensity information of at least two phases corresponding to at least one pixel is obtained. The intensity information is generated by sensing a modulation light with time delays using these phases. Whether to abandon the intensity information of the at least two phases corresponding to the pixel is determined according to the difference between the intensity information of the at least two phases. Accordingly, the influence caused by motion blur would be reduced on depth information estimation.

## Claims

### Claim 1

A computation device based on time-of-flight (ToF) ranging, comprising:
a memory, recording intensity information of at least two phases corresponding to at least one pixel and a programming code corresponding to a processing method for the computation device, wherein the intensity information is generated by sensing modulation light with time delays using the at least two phases; and
a processor, coupled to the memory, and configured to execute the programming code, the processing method comprising:
obtaining the intensity information of the at least two phases; and
determining, according to a difference between the intensity information of the at least two phases, whether to abandon the intensity information of the at least two phases corresponding to the pixel.

### Claim 2 (depends on 1)

The computation device based on ToF ranging according to claim 1, wherein the processing method further comprises:
adaptively adjusting an exposure time of detecting the modulation light of the at least two phases to obtain again the intensity information of at least two phases corresponding to the pixel at a different time point.

### Claim 3 (depends on 1)

The computation device based on ToF ranging according to claim 1, wherein the processing method further comprises:
determining whether the difference is greater than a difference threshold;
in response to the difference being greater than the difference threshold, abandoning the intensity information of the at least two phases corresponding to the pixel;
in response to abandoning the intensity information of the at least two phases corresponding to the pixel, determining whether to obtain again the intensity information of at least two phases corresponding to the pixel at a different time point; and
computing depth information according to the intensity information of different phases corresponding to a plurality of pixels.

### Claim 4 (depends on 3)

The computation device based on ToF ranging according to claim 3, wherein the memory further records attitude information which corresponds to a device for sensing the modulation light of the at least two phases, and the processing method further comprises:
in response to the difference being greater than the difference threshold, determining, according to the attitude information, whether motion blur causing the difference is global or local;
in response to the motion blur being global, abandoning the intensity information of the at least two phases corresponding to the pixel, and obtaining again the intensity information of at least two phases corresponding to the pixel at a different time point; and
in response to the motion blur being local, determining, according to a blur pixel quantity, whether to obtain again the intensity information of at least two phases corresponding to the pixel at a different time point, wherein the blur pixel quantity is a quantity accumulated in response to the pixel being determined to have the motion blur.

### Claim 5 (depends on 4)

The computation device based on ToF ranging according to claim 4, wherein the processing method further comprises:
in response to the blur pixel quantity being greater than a quantity threshold, abandoning the intensity information of the at least two phases corresponding to the pixel, and obtaining again the intensity information of at least two phases corresponding to the pixel at a different time point.

### Claim 6 (depends on 3)

The computation device based on ToF ranging according to claim 3, wherein the processing method further comprises:
in response to the difference being greater than the difference threshold, abandoning the intensity information of the different phases corresponding to at least one of the pixels, wherein the at least one abandoned pixel is determined to have the motion blur; and
computing the depth information according to the intensity information of the different phases corresponding to a plurality of pixels that are not abandoned among the pixels.

### Claim 7

A sensing device based on time-of-flight (ToF) ranging, comprising:
a modulation-light emitting circuit, emitting modulation light;
a modulation-light receiving circuit, receiving the modulation light with time delays using at least two phases;
a memory, recording intensity information of at least two phases corresponding to at least one pixel and a programming code corresponding to a processing method for the sensing device; and
a processor, coupled to the modulation-light receiving circuit and the memory, and configured to execute the programming code, the processing method comprising:
obtaining the intensity information of the at least two phases, wherein the intensity information is generated by sensing the modulation light with the time delays using the at least two phases; and
determining, according to a difference between the intensity information of the at least two phases, whether to abandon the intensity information of the at least two phases corresponding to the pixel.

### Claim 8 (depends on 7)

The sensing device based on ToF ranging according to claim 7, wherein the processing method further comprises:
adaptively adjusting an exposure time of detecting the modulation light of the at least two phases by the modulation-light receiving circuit to obtain again the intensity information of at least two phases corresponding to the pixel at a different time point.

### Claim 9 (depends on 7)

The sensing device based on ToF ranging according to claim 7, further comprising:
an attitude sensor, sensing an attitude of the sensing device, and accordingly generating attitude information, the processing method further comprising:
in response to the difference being greater than a difference threshold, determining, according to the attitude information, whether motion blur causing the difference is global or local;
in response to the motion blur being global, abandoning the intensity information of the at least two phases corresponding to the pixel, and obtaining again, by the modulation-light receiving circuit, the intensity information of at least two phases corresponding to the pixel at a different time point; and
in response to the motion blur being local, determining, according to a blur pixel quantity, whether to obtain again, by the modulation-light receiving circuit, the intensity information of at least two phases corresponding to the pixel at a different time point, wherein the blur pixel quantity is a quantity accumulated in response to being determined to have the motion blur.

### Claim 10

A processing method based on time-of-flight (ToF) ranging, comprising:
obtaining intensity information of at least two phases corresponding to at least one pixel, wherein the intensity information is generated by sensing a modulation light with time delays using the at least two phases; and
determining, according to a difference between the intensity information of the at least two phases, whether to abandon the intensity information of the at least two phases corresponding to the pixel.

### Claim 11 (depends on 10)

The processing method based on ToF ranging according to claim 10, wherein after determining whether to abandon the intensity information of the at least two phases corresponding to the pixel, the method further comprises:
adaptively adjusting an exposure time of detecting the modulation light of the at least two phases to obtain again the intensity information of at least two phases corresponding to the pixel at a different time point.

### Claim 12 (depends on 10)

The processing method based on ToF ranging according to claim 10, wherein determining whether to abandon the intensity information of the at least two phases corresponding to the pixel comprises:
determining whether the difference is greater than a difference threshold;
in response to the difference being greater than the difference threshold, abandoning the intensity information of the at least two phases corresponding to the pixel;
in response to abandoning the intensity information of the at least two phases corresponding to the pixel, determining whether to obtain again the intensity information of at least two phases corresponding to the pixel at a different time point; and
computing depth information according to the intensity information of different phases corresponding to a plurality of pixels.

### Claim 13 (depends on 12)

The processing method based on ToF ranging according to claim 12, wherein after determining whether the difference is greater than the difference threshold, the method further comprises:
obtaining attitude information, wherein the attitude information corresponds to a device for sensing the modulation light of the at least two phases;
in response to the difference being greater than the difference threshold, determining, according to the attitude information, whether motion blur causing the difference is global or local;
in response to the motion blur being global, abandoning the intensity information of the at least two phases corresponding to the pixel, and obtaining again the intensity information of at least two phases corresponding to the pixel at a different time point; and
in response to the motion blur being local, determining, according to a blur pixel quantity, whether to obtain again the intensity information of at least two phases corresponding to the pixel at a different time point, wherein the blur pixel quantity is a quantity accumulated in response to the pixel being determined to have the motion blur.

### Claim 14 (depends on 13)

The processing method based on ToF ranging according to claim 13, wherein after determining whether the difference is greater than the difference threshold, the method further comprises:
in response to the blur pixel quantity being greater than a quantity threshold, abandoning the intensity information of the at least two phases corresponding to the pixel, and obtaining again the intensity information of at least two phases corresponding to the pixel at a different time point.

### Claim 15 (depends on 12)

The processing method based on ToF ranging according to claim 12, wherein after determining whether the difference is greater than the difference threshold, the method further comprises:
in response to the difference being greater than the difference threshold, abandoning the intensity information of the different phases corresponding to at least one of the pixels, wherein the at least one abandoned pixel is determined to have the motion blur; and
computing the depth information according to the intensity information of the different phases corresponding to a plurality of pixels that are not abandoned among the pixels.
