Object classification and related applications based on frame and event camera processing

A method, comprising:

• acquiring an output of image sensor circuitry;
• determining a first object classification result based on feature points associated with one or more first objects in a first frame of the acquired output;
• executing an event-camera signal processing operation on at least two frames of the acquired output to generate an event frame, wherein
• the generated event frame comprises pixel-level movement information associated with one or more second objects;
• determining a second object classification result based on the pixel-level movement information;
• determining whether there is a difference between the determined first object classification result and the determined second object classification result;
• determining one or more object classification tags based on the determination that there is no difference between the determined first object classification result and the determined second object classification result, wherein
• the determined one or more object classification tags correspond to one or more objects included in at least the one or more first objects and the one or more second objects;
• determining, based on the determination that there is the difference between the determined first object classification result and the determined second object classification result, an errored object from one of the one or more first objects or the one or more second objects, wherein
• the determined errored object is one of misclassified, unclassified, detected but unclassified, mis-detected, or mis-detected and mis-classified;
• executing a pattern matching operation for the determined errored object based on the determined difference, the determined first object classification result, and the determined second object classification result;
• and
• classifying the determined errored object into a first object class based on the execution of the pattern matching operation.

A non-transitory computer-readable medium having stored thereon, computer-executable instructions that when executed by a system, causes the system to execute operations, the operations comprising:

• acquiring an output of image sensor circuitry;
• determining a first object classification result based on feature points associated with one or more first objects in a first frame of the acquired output;
• executing an event-camera signal processing operation on at least two frames of the acquired output to generate an event frame, wherein
• the generated event frame comprises pixel-level movement information associated with one or more second objects;
• determining a second object classification result based on the pixel-level movement information;
• determining whether there is a difference between the determined first object classification result and the determined second object classification result;
• determining one or more object classification tags based on the determination that there is no difference between the determined first object classification result and the determined second object classification result, wherein
• the determined one or more object classification tags correspond to one or more objects included in at least the one or more first objects and the one or more second objects;
• determining, based on the determination that there is the difference between the determined first object classification result and the determined second object classification result, an errored object from one of the one or more first objects or the one or more second objects, wherein
• the determined errored object is one of misclassified, unclassified, detected but unclassified, mis-detected, or mis-detected and mis-classified;
• executing a pattern matching operation for the determined errored object based on the determined difference, the determined first object classification result, and the determined second object classification result;
• and
• classifying the determined errored object into a first object class based on the execution of the pattern matching operation.