Back to results
US 2026/0281548 A1Published application
Techniques for simultaneously running discrete imaging modalities
AssigneeGyrus ACMI, Inc. d/b/a Olympus Surgical Technologies America
InventorsFrank Filiciotto, Dawei Liu, Thorsten Juergens
Life of this patent
Estimating the term…
Abstract
A system and processing techniques for simultaneously analyzing multiple imaging modalities. The discussed technique can include capturing a combined image stream including a first modality stream and at least a second modality stream. The technique continues by analyzing the first modality stream with a first analysis module and, concurrently, analyzing a second modality stream with a second analysis module. The combined image stream can be generated using timed lighting modalities to generate interleaved image streams or by extracting narrow color bands from a primary color sensor.
Claims20
A method comprising:
- capturing, using a color image sensor including a plurality of spectrally-distinct channels, a plurality of frames under different illumination configurations, each illumination configuration providing illumination in a plurality of narrow spectral bands, wherein each spectral bands of the plurality of narrow spectral bands falls within a sensitivity range of a respective channel of the plurality of spectrally-distinct channels;
- extracting spectral band data from the plurality of frames, the spectral band data corresponding to the plurality of narrow spectral bands distributed across the plurality of spectrally-distinct channels of the color image sensor;
- generating a first imaging modality stream by combining a first subset of the spectral band data;
- generating a second imaging modality stream by combining a second subset of the spectral band data, wherein the second subset differs from the first subset;
- processing the first imaging modality stream with a first analysis module to generate a first analysis output;
- processing, concurrently with the processing of the first imaging modality stream, the second imaging modality stream with a second analysis module to generate a second analysis output;
- and
- generating a display output based on at least one of the first analysis output and the second analysis output.
5 more elements
A non-transitory computer-readable medium including instructions that, when executed by one or more processors, cause the one or more processors to perform operations including:
- receiving, from a color image sensor including a plurality of spectrally-distinct channels, image data captured across a plurality of frames, each frame captured under a respective illumination configuration providing illumination in a plurality of narrow spectral bands positioned within sensitivity ranges of the plurality of spectrally-distinct channels of the color image sensor;
- extracting spectral band data from the image data, the spectral band data representing a plurality of narrow spectral bands distributed across the plurality of spectrally-distinct channels of the color image sensor;
- generating a first imaging modality stream by combining a first subset of the spectral band data;
- generating a second imaging modality stream by combining a second subset of the spectral band data, wherein the second subset differs from the first subset;
- executing a first analysis module to process the first imaging modality stream and generate a first analysis output;
- executing a second analysis module to process the second imaging modality stream and generate a second analysis output;
- and
- generating a display output based on at least one of the first analysis output and the second analysis output.
5 more elements
An apparatus comprising:
- a light source configured to emit illumination in a plurality of illumination configurations, each illumination configuration providing illumination in a respective set of narrow spectral bands;
- a color image sensor having a plurality of spectrally-distinct channels, the color image sensor configured to capture a plurality of frames, each frame captured under a respective one of the plurality of illumination configurations, wherein each narrow spectral band falls within a sensitivity range of a respective channel of the color image sensor;
- a processor coupled to the color image sensor, the processor configured to:
- extract spectral band data from the plurality of frames, the spectral band data representing a plurality of narrow spectral bands distributed across the plurality of spectrally-distinct channels;
- generate a first imaging modality stream by combining a first subset of the spectral band data;
- generate a second imaging modality stream by combining a second subset of the spectral band data, wherein the second subset differs from the first subset;
- execute a first analysis module to process the first imaging modality stream and produce a first analysis output;
- execute a second analysis module to process the second imaging modality stream and produce a second analysis output;
- and
- generate a display output based on at least one of the first analysis output and the second analysis output;
- and
- a display device coupled to the processor and configured to render the display output.
9 more elements
Dependencies are inferred from the claim text.