Systems and methods for integrating imagery captured by different imaging modalities into composite imagery of a surgical space

A method comprising:

• generating, by a computing system, a composite image of a surgical space based on a first image captured by a first imaging modality and a second image captured by a second imaging modality different from the first imaging modality, the composite image comprising:
• a first portion of the composite image that includes a first representation of a first portion of the surgical space, the first representation generated based on the first image, and
• a second portion of the composite image that includes a second representation of a second portion of the surgical space, the second representation generated based on the second image modified by gradient information of the first image;
• and
• directing, by the computing system, a display device to display the composite image.

A non-transitory computer-readable medium comprising computer-readable instructions executable by one or more computer processors to:

• generate a composite image of a surgical space based on a first image captured by a first imaging modality and a second image captured by a second imaging modality different from the first imaging modality, the composite image comprising:
• a first portion of the composite image that includes a first representation of a first portion of the surgical space, the first representation generated based on the first image, and
• a second portion of the composite image that includes a second representation of a second portion of the surgical space, the second representation generated based on the second image modified by gradient information of the first image;
• and
• direct a display device to display the composite image.