Techniques for simultaneously running discrete imaging modalities
AssigneeGyrus ACMI, Inc.
InventorsFrank Filiciotto, Dawei Liu, Thorsten Juergens
Life of this patent
Estimating the term…
Abstract
A system and processing techniques for simultaneously analyzing multiple imaging modalities. The discussed technique can include capturing a combined image stream including a first modality stream and at least a second modality stream. The technique continues by analyzing the first modality stream with a first analysis module and, concurrently, analyzing a second modality stream with a second analysis module. The combined image stream can be generated using timed lighting modalities to generate interleaved image streams or by extracting narrow color bands from a primary color sensor.
Claims21
A method for simultaneously analyzing multiple imaging modalities, the method comprising:
- capturing a combined image stream including a first modality stream and at least a second modality stream;
- analyzing the first modality stream with a first analysis module;
- analyzing, concurrently with the analyzing the first modality stream, the second modality stream with a second analysis module;
- and
- generating a graphical output display including images from the first modality stream with output from the second analysis module overlaid on the images from the first modality stream including selectively displaying specific areas of the second modality stream in a picture-in-picture configuration based on output from the second analysis module, wherein the first modality stream is a white light,
- wherein output from the first analysis module includes identification of an abnormality and output from the second analysis module includes classification of the abnormality,
- wherein the selectively displaying specific areas of the second modality stream in the picture-in-picture configuration includes displaying a magnified view of the abnormality from the second modality stream.
A system comprising:
- an endoscope with a camera and a lighting system, the camera and the lighting system configured to generate a first modality stream and a second modality stream;
- a processor and a memory device, the memory device including instructions that, when executed by the processor, cause the processor to perform operations comprising:
- capturing a combined image stream including a first modality stream and at least a second modality stream;
- analyzing the first modality stream with a first analysis module;
- analyzing, concurrently with the analyzing the first modality stream, the second modality stream with a second analysis module;
- and
- outputting, based on analyzing the first modality stream and analyzing the second modality stream, a recommended image stream and overlaying results from the first analysis module and the second analysis module on the recommended image stream including overlaying specific areas of the second modality stream onto corresponding areas of the first modality stream based on output from the second analysis module,
- wherein output from the first analysis module includes identification of an abnormality and output from the second analysis module includes classification of the abnormality, and
- wherein overlaying specific areas of the second modality stream includes overlaying an area of the abnormality with a corresponding area of second modality stream.
Dependencies are inferred from the claim text.