# US 12,003,894 B1 · Systems, methods, and apparatus for event detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,003,894 B1
- Document ID: US12003894B1
- Status: Granted
- Kind: B1
- Application number: 17/136,940
- Filed: 2020-12-29
- Granted: 2024-06-04
- Earliest claimed: 2020-12-29
- Assignees: Waymo LLC
- Applicants: Waymo LLC
- Inventors: Vlad Constantin Cardei; Lucian Ion
- Web page: https://patentgrep.com/patent/US12003894B1

## CPC

- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- H04N 23/61: based on recognised objects
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- H04N 23/651: {for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems, apparatus, and methods are presented for event detection. One method may include receiving event data from an event capture device while the event capture device is in a stationary state. The event capture device may be coupled to a vehicle. The method may also include generating a command and sending the command to the event capture device. The command is configured to cause the event capture device to change from the stationary state to a non-stationary state.

## Claims

### Claim 1

A method comprising:
receiving, by one or more processors, event data of a scene from sensing elements of an event capture device while the event capture device is in a stationary state, wherein each of the sensing elements of the event capture device generates event data in response to changes of light intensity, and wherein the event capture device is coupled to a vehicle;
generating, by the one or more processors, a command when the one or more processors no longer receive event data from one or more of the sensing elements of the event capture device for a period of time, wherein the one or more of the sensing elements of the event capture device no longer generate event data corresponding to a portion of the scene when the event capture device is in the stationary state and the one or more of the sensing elements maintain a substantially constant distance relative to the portion of the scene; and
sending, from the one or more processors, the command to an actuator to cause the event capture device to change from the stationary state to a non-stationary state, wherein the one or more of the sensing elements of the event capture device generates event data while the event capture device is in the non-stationary state, and wherein the actuator comprises a mechanism configured to cause displacement or movement of the event capture device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the event capture device includes a dynamic vision sensor.

### Claim 3 (depends on 1)

The method of claim 1, wherein each of the sensing elements of the event capture device generates event data when the change in light intensity exceeds a threshold level.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
detecting, by the event capture device, at least one event;
generating, by the event capture device, event data associated with the at least one event; and
asynchronously sending, by the event capture device, the event data to the one or more processors.

### Claim 5 (depends on 4)

The method of claim 4, wherein the event data associated with the at least one event is generated in response to a change in an environmental condition, a change in an intensity of electromagnetic energy, or a change in an intensity of visible light.

### Claim 6 (depends on 1)

The method of claim 1, wherein the event data includes location information and timing information associated with the scene.

### Claim 7 (depends on 6)

The method of claim 6, wherein the location information includes a location of at least one sensing element in a sensor array of the event capture device, and wherein the timing information includes a time stamp.

### Claim 8 (depends on 1)

The method of claim 1, further comprising determining a time stamp associated with the event data of the scene, and wherein the command is generated after the period of time.

### Claim 9 (depends on 1)

The method of claim 1, further comprising receiving, by the one or more processors, the event data generated by the event capture device when the event capture device is in the non-stationary state.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
generating, by the event capture device, event data when the event capture device is in the non-stationary state; and
detecting, by the one or more processors, a portion of at least one object in the scene based on the event data.

### Claim 11 (depends on 1)

The method of claim 1, wherein the one or more of the sensing elements of the event capture device no longer generate event data corresponding to a portion of the scene, and wherein the portion of the scene is located near a center portion of a field of view of the event capture device.

### Claim 12 (depends on 1)

The method of claim 1, wherein the one or more of the sensing elements of the event capture device no longer generate event data corresponding to a portion of the scene, and further comprising:
receiving, from an image capture device, image data; and
determining, based on the image data, that the portion of the scene is within a field of view of the image capture device.

### Claim 13

An apparatus comprising:
a memory;
at least one processor configured to:
receive event data of a scene from sensing elements of an event capture device while the event capture device is in a stationary state, wherein each of the sensing elements of the event capture device generates event data in response to changes of light intensity, and wherein the event capture device is coupled to a vehicle;
generate a command when the one or more processors no longer receive event data from one or more of the sensing elements of the event capture device for a period of time, wherein the one or more of the sensing elements of the event capture device no longer generate event data corresponding to a portion of the scene when the event capture device is in the stationary state and the one or more of the sensing elements maintain a substantially constant distance relative to the portion of the scene; and
send the command to an actuator configured to cause the event capture device to change from the stationary state to a non-stationary state, wherein the one or more of the sensing elements of the event capture device generates event data while the event capture device is in the non-stationary state, and wherein the actuator comprises a mechanism configured to cause displacement or movement of the event capture device.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the event capture device comprises a dynamic vision sensor.

### Claim 15

A non-transitory computer-readable medium storing instructions, the instructions being executable by one or more processors to perform operations comprising:
receiving event data of a scene from sensing elements of an event capture device while the event capture device is in a stationary state, wherein each of the sensing elements of the event capture device generates event data in response to changes of light intensity, and wherein the event capture device is coupled to a vehicle;
generating a command when the one or more processors no longer receive event data from one or more of the sensing elements of the event capture device for a period of time, wherein the one or more of the sensing elements of the event capture device no longer generate event data corresponding to a portion of the scene when the event capture device is in the stationary state and the one or more of the sensing elements maintain a substantially constant distance relative to the portion of the scene; and
sending the command to an actuator configured to cause the event capture device to change from the stationary state to a non-stationary state, wherein the one or more of the sensing elements of the event capture device generates event data while the event capture device is in the non-stationary state, and wherein the actuator comprises a mechanism configured to cause displacement or movement of the event capture device.

### Claim 16 (depends on 1)

The method of claim 1, wherein the mechanism is configured to cause movement of the event capture device.

### Claim 17 (depends on 16)

The method of claim 16, wherein the movement of the event capture device comprises at least one of an in-plane motion, an out-of-plane motion, a pitch, a yaw, or a roll.

### Claim 18 (depends on 13)

The apparatus of claim 13, wherein the mechanism is a vibrating mechanism.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein the vibrating mechanism is in contact with the event capture device.

### Claim 20 (depends on 18)

The apparatus of claim 18, wherein the vibrating mechanism is integrated with the event capture device.
