US 2026/0300378 A1Published application

System and methods for human-interpretable autonomous scene search

OwnerRuslan Burakov, Mikhail Erofeev +2inventors

InventorsRuslan Burakov, Mikhail Erofeev, Nikolai Shcheglov, Andrey Rykov

Life of this patent

Estimating the term…

Loading patent…

Abstract

Provided herein is a system and method for human-interpretable autonomous scene search, the system including: at least one processor; a memory communicatively connected to the at least one processor, wherein the memory contains instructions configuring the at least one processor to: receive a plurality of frames of video data; preprocess the plurality of frames of video data, wherein preprocessing the plurality of frames of video data includes removing duplicative data from the plurality of frames of video data; generate a natural language scene description, using a primary large language model; save the natural language scene description to a scene search database; receive from a user, a user-defined query; and return one or more frames of video data selected from the plurality of frames of video data as a function of associated natural language scene descriptions for the plurality of frames of video data and the user-defined query.

Claims20

Dependent claims

A system for human-interpretable autonomous scene search, the system comprising:

at least one processor;
a memory communicatively connected to the at least one processor, wherein the memory contains instructions configuring the at least one processor to:
receive a plurality of frames of video data;
preprocess the plurality of frames of video data, wherein preprocessing the plurality of frames of video data comprises removing duplicative data from the plurality of frames of video data;
generate a natural language scene description, using a primary large language model, wherein generating the natural language scene description comprises:
inputting the preprocessed plurality of frames of video data and a prompt into the primary large language model;
and
receiving, as output from the primary large language model, the natural language scene description;
save the natural language scene description to a scene search database;
receive from a user, a user-defined query;
and
return one or more frames of video data selected from the plurality of frames of video data as a function of associated natural language scene descriptions for the plurality of frames of video data and the user-defined query.

9 more elements

A method for human-interpretable autonomous scene search, the method comprising:

receiving, using at least one processor, a plurality of frames of video data;
preprocessing, using the at least one processor, the plurality of frames of video data, wherein preprocessing the plurality of frames of video data comprises removing duplicative data from the plurality of frames of video data;
generating, using the at least processor, a natural language scene description, using a primary large language model, wherein generating the natural language scene description comprises:
inputting the preprocessed plurality of frames of video data and a prompt into the primary large language model;
and
receiving, as output from the primary large language model, the natural language scene description;
saving, using the at least one processor, the natural language scene description to a scene search database;
receiving, using the at least one processor, from a user, a user-defined query;
and
returning, using the at least one processor, one or more frames of video data selected from the plurality of frames of video data as a function of associated natural language scene descriptions for the plurality of frames of video data and the user-defined query.

7 more elements

Dependencies are inferred from the claim text.