Method for Real-Time Detection of Objects, Structures or Patterns in a Video, an Associated System and an Associated Computer Readable Medium
AssigneeAugere Medical AS
InventorsHåvard Nygaard Espeland, Michael Alexander Riegler
Life of this patent
Estimating the term…
Abstract
This invention relates to methods and systems for the real-time detection of objects, structures and/or patterns in videos, such as anatomical structures and/or anatomical landmarks in endoscopic videos of a subject, e.g. endoscopic videos of the gastrointestinal tract (GI tract).
Claims19
A method for real-time detection of one or more objects and/or one or more structures and/or one or more patterns in a video, the method comprising
- receiving a sequence of frames of the video;
- applying a sliding window to the sequence of frames, and for each position of the sliding window, extracting one or more visual features from the frames within the sliding window, thereby generating a plurality of time images;
- applying a trained classifier to each time image, wherein the trained classifier determines one or more detection scores that indicate likelihoods that a respective time image includes the one or more objects and/or one or more structures and/or one or more patterns;
- and
- outputting, in real-time, the detection of the one or more objects and/or one or more structures and/or one or more patterns when a detection score of the one or more detection scores is higher than a detection threshold of the trained classifier.
A system for real-time detection of one or more objects and/or one or more structures and/or one or more patterns in a video, the system comprising:
- an input configured to receive a sequence of frames of a video;
- a processing system configured to access and process the sequence of frames, wherein to process the sequence of frames, the processing system is configured to:
- receive a sequence of frames of the video;
- apply a sliding window to the sequence of frames, and for each position of the sliding window, extract one or more visual features from the frames within the sliding window, thereby generating a plurality of time images;
- and
- apply a trained classifier to each time image, wherein the trained classifier determines one or more detection scores that indicate a likelihood that a respective time image includes the one or more objects and/or one or more structures and/or one or more patterns;
- and
- output, in real-time, the detection of the one or more objects and/or one or more structures and/or one or more patterns when a detection score of the one or more detection scores is higher than a detection threshold of the trained classifier.
A non-transitory computer readable medium storing computer readable instructions for real-time detection of one or more objects and/or one or more structures and/or one or more patterns in a video, wherein the computer readable instructions, when executed by a processing system, cause the processing system to:
- receive a sequence of frames of the video;
- apply a sliding window to the sequence of frames, and for each position of the sliding window, extract one or more visual features from the frames within the sliding window, thereby generating a plurality of time images;
- apply a trained classifier to each time image, wherein the trained classifier determines one or more detection scores that indicate a likelihood that a respective time image includes the one or more objects and/or one or more structures and/or one or more patterns;
- and
- output, in real-time, the detection of the one or more objects and/or one or more structures and/or one or more patterns when a detection score of the one or more detection scores is higher than a detection threshold of the trained classifier.
Dependencies are inferred from the claim text.