System and method for identifying atypical events and generating an alert using deep learning model

One or more non-transitory computer-readable storage medium storing the one or more sequence of instructions, which when executed by the one or more processors, causes to perform a method for identifying and generating an alert for a plurality of atypical events on an electronic whiteboard using a deep learning model, comprising:

• receiving a plurality of canvases at concurrent sessions from a user device associated with a user, wherein each canvas comprises strokes, wherein each stroke is a timestamped scalable vector graphics element;
• annotating the plurality of canvases by (i) displaying the strokes from each canvas of a session, (ii) assigning labels for the strokes by selecting at least one category related to any of the plurality of atypical events, (iii) enabling an instance-level annotation for each category that comprises the strokes to select a contiguous group of sketches, and (iv) high-lighting the strokes belonging to the contiguous group of sketches to obtain annotated plurality of canvases;
• detecting historical atypical events from the annotated plurality of canvases by (i) detecting, using an image-based object detection, the high-lighted strokes of the contiguous group of sketches to represent as spatially localized objects (ii) extracting a plurality of features from the spatially localized objects, and (iii) generating feature maps from the extracted features;
• training the deep learning model by correlating the historical atypical events, historical bounding boxes with historical canvases in historical sessions to obtain a trained deep learning model;
• processing, using the deep learning model, the plurality of canvases by determining a bounding box around each atypical event, thereby identifying the plurality of atypical events during the activity on the electronic whiteboard using the bounding box around each atypical event;
• and
• generating, using an event record table, an alert for identified plurality of atypical events by (i) recording atypical event information related to on-going sessions, (ii) analyzing, using a rule base method, the atypical event information to generate an appropriate alert by relaying to an appropriate session, thereby displaying the appropriate alert on an user interface of the user device associated with the user.

A system for identifying and generating an alert for a plurality of atypical events on an electronic whiteboard using a deep learning model, the system comprising:

• a device processor;
• and
• a non-transitory computer-readable storage medium storing one or more sequences of instructions, which when executed by the device processor, causes
• receive a plurality of canvases at concurrent sessions from a user device associated with a user, wherein each canvas comprises strokes, wherein each stroke is a timestamped scalable vector graphics element;
• annotate the plurality of canvases by (i) displaying the strokes from each canvas of a session, (ii) assigning labels for the strokes by selecting at least one category related to any of the plurality of atypical events, (iii) enabling an instance-level annotation for each category that comprises the strokes to select a contiguous group of sketches, and (iv) high-lighting the strokes belonging to the contiguous group of sketches to obtain annotated plurality of canvases;
• detect historical atypical events from the annotated plurality of canvases by (i) detecting, using an image-based object detection, the high-lighted strokes of the contiguous group of sketches to represent as spatially localized objects (ii) extracting a plurality of features from the spatially localized objects, and (iii) generating feature maps from the extracted features;
• train the deep learning model by correlating the historical atypical events, historical bounding boxes with historical canvases in historical sessions to obtain a trained deep learning model;
• process, using the deep learning model, the plurality of canvases by determining a bounding box around each atypical event, thereby identifying the plurality of atypical events during the activity on the electronic whiteboard using the bounding box around each atypical event;
• and
• generate, using an event record table, an alert for identified plurality of atypical events by (i) recording atypical event information related to on-going sessions, (ii) analyzing, using a rule base method, the atypical event information to generate an appropriate alert by relaying to an appropriate session, thereby displaying the appropriate alert on an user interface of the user device associated with the user.