Natural language search over security videos

A system comprising:

• at least one memory storing instructions thereon;
• and
• at least one processor coupled to the at least one memory and configured by the instructions to:
• generate a first representation of sampled video information in a multidimensional format via a first machine learning model;
• receive a request including a natural language input;
• generate a second representation of the natural language input in the multidimensional format via a second machine learning model that is a different from the first machine learning model;
• determine that the first representation has a predefined relationship with the second representation based on a learned proximity metric between the first representation and the second representation in the multidimensional format;
• and
• present the second representation as a response to the request based on the first representation having the predefined relationship with the second representation.

A non-transitory computer-readable device having instructions thereon that, when executed by at least one computing device, causes the at least one computing device to perform operations comprising:

• generating a first representation of sampled video information in a multidimensional format via a first machine learning model;
• receiving a request including a natural language input;
• generating a second representation of the natural language input in the multidimensional format via a second machine learning model that is a different from the first machine learning model;
• determining that the first representation has a predefined relationship with the second representation based on a learned proximity metric between the first representation and the second representation in the multidimensional format;
• and
• presenting the second representation as a response to the request based on the first representation having the predefined relationship with the second representation.