Joint processing for embedded data inference
AssigneeNetradyne, Inc.
InventorsDavid Jonathan JULIAN, Avneesh AGRAWAL
Life of this patent
Estimating the term…
Abstract
Systems and methods are provided for embedded data inference. The systems and methods may process camera and other sensor data in by leveraging processing and storage capacity of one or more devices nearby or in the cloud to augment or update the sensor processing of an embedded device. The joint processing may be used in stationary cameras or in vehicular systems such as cars and drones, and may improve crop assessments, navigation, and safety.
Claims27
A method for updating a model on a machine, comprising:
- obtaining sensor data at a first device;
- wherein the sensor data were captured at a sensor attached to the machine, and wherein the first device is proximate to the sensor;
- identifying, at the first device, an object and determining a class of the object based on the sensor data and an embedded model on the first device;
- sending communication data based on the sensor data to a second device;
- determining a first model at a second device based on identifying from the communication data at least one of:
- one or more additional classes of the object,
- one or more additional objects, or
- a context of the machine;
- sending model information about the first model from the second device to the first device;
- and
- updating the embedded model on the first device based on the model information.
6-8. (canceled)
(canceled)
17-23. (canceled)
A method of joint processing for data inference, comprising:
- processing sensor data on a first device with a first model to create first inference data, wherein the sensor data were captured at a sensor, and wherein the first device is proximate to the sensor;
- sending first communication data based on the sensor data to a second device;
- processing the first communication data at the second device using a second model to create second inference data;
- and
- sending second communication data based on the second inference data from the second device to the first device.
30-37. (canceled)
41-55. (canceled)
A computer program product for updating a machine learning model on a device, the computer program product comprising:
- a non-transitory computer-readable medium having program code recorded thereon, the program code comprising:
- program code to obtain sensor data on a first device;
- process sensor data on the first device with a first machine learning model to create first classification data;
- send first communication data based on the sensor data to a second device;
- process the first communication data at the second device using a second machine learning model to create second classification data;
- determine differences between the first classification data and the second classification data;
- and
- update the first model based on the determined differences.
Dependencies are inferred from the claim text.