Multiple band pass Bayer pattern filter

A surgical system comprising:

• one or more display devices;
• an image sensing apparatus configured to receive electromagnetic radiation reflected or transmitted from a surgical scene, the image sensing apparatus comprising:
• a pixel array comprising two or more photo-sensor elements, and
• a first optical filter disposed on a first photo-sensor element of the pixel array, the first optical filter configured such that a spectral response of the first optical filter includes:
• a first passband in a first wavelength range, and
• a second passband in a second wavelength range, the first passband and the second passband being separated by a first stop band, the second passband having a wavelength between 1200 and 1250 nm, and
• a second optical filter disposed on a second photo-sensor element of the pixel array, the second optical filter configured such that a spectral response of the second optical filter includes:
• a third passband in the first wavelength range, and
• a fourth passband in the second wavelength range, the third passband and the fourth passband being separated by a second stop band, the fourth passband having a wavelength between 1300 and 1350 nm;
• wherein the first and second optical filters are arranged in a Bayer pattern, the first wavelength range is non-overlapping with second wavelength range, and the second optical filter is configured such that absorption characteristic of a first tissue type in the third passband is higher than absorption characteristic of a second tissue type in the third passband, and absorption characteristic of the second tissue type in the fourth passband is higher than absorption characteristic of the first tissue type in the fourth passband;
• one or more processing devices configured to:
• obtain a representation of a first image of a surgical scene using electromagnetic radiation in the first wavelength range,
• obtain a representation of a second image of the surgical scene using electromagnetic radiation in the second wavelength range, and
• present a visual representation of the surgical scene on the one or more displays, wherein the visual representation is rendered using the representation of the first image and the representation of the second image;
• and
• an input device configured to receive a user-input for controlling at least a portion of a surgical device.

A method of providing visual feedback during a surgical process using a visual representation of a surgical scene rendered on one or more displays associated with a surgical device, the method comprising:

• illuminating a surgical scene using electromagnetic radiation in a first illumination-wavelength range;
• obtaining, responsive to illuminating the surgical scene using electromagnetic radiation in the first illumination-wavelength range, a representation of a first image of the surgical scene using a pixel array including two or more photo-sensor elements, wherein a first photo-sensor element of the two or more photo-sensor elements is configured to receive electromagnetic radiation though a first filter that includes a first passband in a first wavelength range and a second passband in a second wavelength range, the second passband having a wavelength between 1200 and 1250 nm, the first passband and the second passband being separated by a first stop band, and wherein a second photo-sensor element of the two or more photo-sensor elements is configured to receive electromagnetic radiation though a second filter that includes a third passband in the first wavelength range and a fourth passband in the second wavelength range, the fourth passband having a wavelength between 1300 and 1350 nm, the third passband and the fourth passband being separated by a second stop band wherein the first and second optical filters are arranged in a Bayer pattern, the first wavelength range is non-overlapping with second wavelength range, and the second optical filter is configured such that absorption characteristic of a first tissue type in the third passband is higher than absorption characteristic of a second tissue type in the third passband, and absorption characteristic of the second tissue type in the fourth passband is higher than absorption characteristic of the first tissue type in the fourth passband;
• illuminating the surgical scene using electromagnetic radiation in a second illumination-wavelength range;
• obtaining, responsive to illuminating the surgical scene using electromagnetic radiation in the second illumination-wavelength range, a representation of a second image of the surgical scene using the pixel array;
• and
• presenting the visual representation of the surgical scene on the one or more displays, wherein the visual representation is rendered using the representation of the first image and the representation of the second image.