Video management system and method for audio event search and classification

A system comprising:

• a vector database;
• and
• one or more hardware computing devices configured to:
• define, by an audio encoder, a set of audio embeddings for an audio signal detected and obtained in conjunction with images provided in a video content generated by a camera system;
• store the set of audio embeddings of the detected audio signal to the vector database and the video content in a video catalog library;
• define, by a text encoder, a set of text embeddings for a text prompt indicative of a search query for a desired video content having audio data indicative of a sound feature that is defined as a search parameter of the search query;
• rank a plurality of audio embeddings indicative of a plurality of audio signals and provided in the vector database using the set of text embeddings of the search query;
• detect a relevant audio record associated with an identified audio embedding from among the ranked audio embeddings;
• and
• output a relevant video content associated with the relevant audio record to have a computing device play the relevant video content, the relevant video content being obtained from among a plurality of video content stored in the video catalog library.

A non-transitory computer-readable medium comprising instructions for a system that, when executed by one or more hardware computing devices cause the one or more hardware computing devices to perform operations including to:

• define, by an audio encoder, a set of audio embeddings for an audio signal provided in a video content generated by a camera system;
• store the set of audio embeddings of the audio signal provided to a vector database and the video content generated in a video catalog library;
• define, by a text encoder, a set of text embeddings for a text prompt indicative of a search query for a desired video content having audio data indicative of a sound feature that is defined as a search parameter of the search query;
• rank a plurality of audio embeddings indicative of a plurality of audio signals provided in the vector database using the set of text embeddings of the search query;
• detect a relevant audio record associated with an identified audio embedding from among the ranked audio embeddings;
• and
• output a relevant video content associated with the relevant audio record to have a computing device play the relevant video content, the relevant video content being obtained from the video catalog library.