Back to results
US 10,489,222 B2Granted
Distributed computing resource management
AssigneeNauto, Inc.
InventorsSuchitra Sathyanarayana, Stefan Heck, Rohit Saboo
Life of this patent
Estimating the term…
Abstract
Systems and methods for distributed event detection. Sensor data is synchronized, and an on-board detector included in a vehicle detects an event from the synchronized sensor data. The synchronized sensor data is transmitted to a remote system. At the remote system, a remote detector detects the event and generates a remote label from at least a data subset of the synchronized sensor data.
Claims20
A method for distributed event detection, comprising:
- at a vehicle, sampling synchronized interior and exterior image data;
- with an on-board detector executing on-board the vehicle, the on-board detector comprising a first computational model type:
- detecting a first event based on the synchronized interior and exterior image data;
- in response to first event detection, selecting a data subset from the synchronized interior and exterior image data based on the first event;
- and
- in response to first event detection, transmitting the data subset to a remote system;
- and
- with a remote detector executing at the remote system, determining a remote label based on the data subset, wherein the remote detector is associated with the first event, comprises a second computational model type different from the first computational model type, and is more accurate than the on-board detector.
5 more elements
A vehicle computing system comprising:
- an interior camera configured to generate interior image data of a vehicle;
- an exterior camera configured to generate exterior image data of the vehicle;
- a sensor synchronization subsystem configured to generate synchronized image data of the interior camera and the exterior camera;
- an on-board detector comprising a first computational model type, and configured to detect a first event from the synchronized image data;
- and
- a communication system configured to transmit the synchronized image data to a remote system;
- wherein the remote system comprises a remote detector configured to detect the first event and to generate a remote label from at least a data subset of the synchronized image data;
- wherein the communication system is configured to receive weights of a trained instance of the on-board detector from the remote system and update the on-board detector to include the received weights;
- and
- wherein the remote system comprises a training module that is configured to train the instance of the on-board detector based on the remote label and the synchronized image data.
7 more elements
A vehicle computing system comprising:
- an interior camera configured to generate interior image data of a vehicle;
- an exterior camera configured to generate exterior image data of the vehicle;
- a sensor synchronization subsystem configured to generate synchronized image data of the interior camera and the exterior camera;
- an on-board detector comprising a first computational model type, and configured to detect a first event from the synchronized image data;
- and
- a communication system configured to transmit the synchronized image data to a remote system;
- wherein the remote system comprises a remote detector configured to detect the first event and to generate a remote label from at least a data subset of the synchronized image data;
- and
- wherein at least one of the communication system and the on-board detector is configured to select a portion of the synchronized image data send to the remote system based on the detected first event, and to control transmission of the selected portion to the remote system.
6 more elements
A system comprising:
- an on-board detector of a vehicle configured to detect a first event and to generate an associated on-board label from synchronized interior image data and exterior image data of the vehicle;
- and
- a remote detector of a remote system, the remote detector configured to detect the first event and to generate a remote label from at least a portion of the synchronized interior image data and exterior image data of the vehicle, wherein the remote detector receives the interior image data and the exterior image data from the vehicle;
- wherein the remote detector and the on-board detector are different types of detectors;
- wherein the remote detector is more accurate than the on-board detector;
- and
- wherein in response to generation of the on-board label, the on-board detector is configured to select additional vehicle sensor data to send to the remote system based on the on-board label, and transmit the selected additional vehicle sensor data to the remote system in association with the interior image data and the exterior image data.
4 more elements
A system comprising:
- an on-board detector of a vehicle configured to detect a first event and to generate an associated on-board label from synchronized interior image data and exterior image data of the vehicle;
- and
- a remote detector of a remote system, the remote detector configured to detect the first event and to generate a remote label from at least a portion of the synchronized interior image data and exterior image data of the vehicle;
- wherein the remote detector receives the interior image data and the exterior image data from the vehicle, wherein the remote detector and the on-board detector are different types of detectors;
- wherein the remote detector is more accurate than the on-board detector;
- and
- wherein the on-board detector is configured to update weights used by the onboard detector with updated weights received from the remote system, the updated weights being weights of a trained instance of the on-board detector trained by the remote system.
4 more elements
Dependencies are inferred from the claim text.