Systems and methods for management and processing of electronic documents using video annotations

A system for managing building plan documents, comprising:

• one or more computing devices;
• and
• non-transitory computer readable memory storing program code that when executed by the one or more computing devices is configured to cause the system to perform operations comprising:
• receiving an electronic building plan document including a plurality of plan sheets;
• providing a user interface enabling a user to upload a video file;
• providing an asset menu including a plurality of different physical structure types, including at least one of a high rise building, a low rise building, a private home, a hospital, a school, a bridge, a tunnel, or a water containment structure, via which the user can select a physical structure type;
• receiving a user selection of a physical structure type via the asset menu;
• selecting a toolbox of building project-related annotation tools, comprising a first plurality of different geometrical shapes configured to be selectively placed on video frames of structures corresponding to the selected physical structure type, wherein each geometrical shape in the first plurality of different geometrical shapes indicates a different physical structure defect type and is associated with respective metadata indicating the physical structure defect type, wherein the toolbox of building project-related annotation tools is selected based at least in part on the received user selection of the physical structure type;
• providing a user interface comprising:
• the toolbox of building project-related annotation tools selected based at least in part on the received user selection of the physical structure type;
• an interface enabling a user to select one or more video frames from an uploaded video file;
• an editing area configured to display at least one user selected frame and enabling the user to drag and drop a geometric shape that indicates a respective physical structure defect type over a portion of a frame displayed in the editing area and to size the geographic shape;
• a user interface configured to enable a user to associate a criticality level from a plurality of criticality levels, including at least a critical event level and an informational event level, with the geometric shape dropped over the over the portion of a frame displayed in the editing area;
• an association interface enabling the user to define a relationship between a video file and the building plan document;
• receiving a user annotation of at least one video frame, the user annotation comprising a geometrical shape selected by the user from the toolbox and corresponding metadata indicating a criticality of a building project related defect;
• receiving an association of the video file with a first building project-related task comprising remediation or inspection;
• storing the user annotation of the at least one video frame, the user annotation comprising the geometrical shape selected by the user from the toolbox and corresponding metadata indicating the criticality of the building project related defect and physical structure defect type;
• storing the association of the video file with the first building project and the first building project-related task;
• providing a search limiter user interface enabling the user to identify a building project for which a search is to be limited to;
• providing a search interface enabling the user to search for building project-related annotated video files;
• receiving a project identification via the search limiter interface;
• receiving a first user search query via the search interface enabling the user to search for building project-related annotated video files;
• identifying, based at least in part on a comparison of the first search query with video file metadata, at least one building project-related annotated video file;
• and
• providing search results comprising the at least one identified building project-related annotated video file, wherein the search results including the at least one identified building project-related annotated video file are limited to the project identified via the search limiter user interface.

Non-transitory computer readable memory storing program code that when executed by one or more computing devices is configured to cause the one or more computing devices to perform operations comprising:

• receiving an electronic building plan document including a plurality of plan sheets;
• providing a user interface enabling a user to upload a video file;
• providing an asset menu including a plurality of different physical structure types, including at least one of a high rise building, a low rise building, a private home, a hospital, a school, a bridge, a tunnel, or a water containment structure, via which the user can select a physical structure type;
• receiving a user selection of a physical structure type via the asset menu;
• selecting building project-related annotation tools, comprising a first plurality of different geometrical shapes configured to be selectively placed on video frames of structures corresponding to the selected physical structure type, wherein a given geometrical shape in the first plurality of different geometrical shapes indicates a respective physical structure defect type and is associated with respective metadata indicating the physical structure defect type, wherein the toolbox of building project-related annotation tools is selected based at least in part on the received user selection of the physical structure type;
• providing a user interface comprising:
• the building project-related annotation tools selected based at least in part on the received user selection of the physical structure type;
• an interface enabling a user to select one or more video frames from an uploaded video file;
• an editing area configured to display at least one user selected frame and enabling the user to drag and drop a geometric shape that indicates a respective physical structure defect type over a portion of a frame displayed in the editing area and to size the geographic shape;
• a user interface configured to enable a user to associate a criticality level, indicating how critical a respective defect is, from a plurality of criticality levels with the geometric shape dropped over the over the portion of a frame displayed in the editing area;
• an association interface enabling the user to define a relationship between a video file and the building plan document;
• receiving a user annotation of at least one video frame, the user annotation comprising a geometrical shape selected by the user from the building project-related annotation tools and corresponding metadata indicating a criticality of a building project related defect;
• receiving an association of the video file with a first building project-related task comprising remediation or inspection;
• storing the user annotation of the at least one video frame, the user annotation comprising the geometrical shape selected by the user from the building project-related annotation tools and corresponding metadata indicating the criticality of the building project related defect and physical structure defect type;
• storing the association of the video file with the first building project and the first building project-related task;
• providing a search interface enabling the user to identify a building project for which a search is to be limited to and to search for building project-related annotated video files;
• receiving a first user search query via the search interface enabling the user to search for building project-related annotated video files;
• identifying, based at least in part on a comparison of the first search query with video file metadata, at least one building project-related annotated video file;
• and
• providing search results comprising the at least one identified building project-related annotated video file, wherein the search results including the at least one identified building project-related annotated video file are limited to the project identified via the search limiter user interface.