Building security systems and methods utilizing language-vision artificial intelligence

A method comprising:

• providing, by one or more processors, one or more machine learning models, at least one of the one or more machine learning models trained to identify contextual information within video data, the at least one machine learning model trained using at least one of video data or image data and annotations to the at least one of the video data or the image data;
• and
• providing, by the one or more processors, a chatbot configured to:
• receive one or more input videos and process the one or more input videos using the at least one machine learning model to identify the contextual information from the one or more input videos;
• receive a query from a user relating to the one or more input videos;
• and
• generate, by the one or more machine learning models, a response to the query using the contextual information identified by the at least one machine learning model.

One or more non-transitory computer-readable media storing instructions thereon that, when executed by one or more processors, cause the one or more processors to perform actions comprising:

• providing one or more machine learning models, at least one of the one or more machine learning models trained to identify contextual information within video data, the at least one machine learning model trained using at least one of video data or image data and annotations to the at least one of the video data or the image data;
• and
• providing a chatbot configured to:
• receive one or more input videos and process the one or more input videos using the at least one machine learning model to identify the contextual information from the one or more input videos;
• receive a query from a user relating to the one or more input videos;
• and
• generate, by the one or more machine learning models, a response to the query using the contextual information identified by the at least one machine learning model.