# US 2023/0267698 A1 · Intelligent camera illumination and projector

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267698 A1
- Document ID: US20230267698A1
- Status: Published application
- Kind: A1
- Application number: 18/109,986
- Filed: 2023-02-15
- Published: 2023-08-24
- Earliest claimed: 2022-02-18
- Assignees: B. Braun New Ventures GmbH
- Applicants: B. Braun New Ventures GmbH
- Inventors: Tim Beyl; Robert Jakob
- Web page: https://patentgrep.com/patent/US20230267698A1

## CPC

- G06V 10/143: Sensing or illuminating at different wavelengths
- A61B 90/30: Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
- G02B 21/0012: {Surgical microscopes (counterbalanced structures for surgical microscopes G02B7/001)}
- G02B 21/06: Means for illuminating specimens
- G06T 7/50: Depth or shape recovery
- G06T 15/00: Three-dimensional [3D] image rendering
- H04N 23/11: for generating image signals from visible and infrared light wavelengths
- A61B 2090/309: {using white LEDs}
- A61B 2090/371: {with simultaneous use of two cameras}
- G06T 2207/10056: Microscopic image
- G06T 2207/10152: Varying illumination
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An imaging system, medical microscope, surgical light, robotic system, imaging method, and computer-readable storage medium. The imaging system creates an optimized image of a region to be imaged and includes an irradiation system. The irradiation system has at least a first and a second individually adjustable radiation emitter for individual irradiation of the region to be imaged. A camera system includes at least one camera that creates an image of the region to be imaged. An image analysis unit is adapted to analyze the image and digitally provide an analysis result. A control unit is adapted to control the irradiation system based on the analysis result and change an irradiation of the first and/or second radiation emitter in an intensity of the radiation and/or in a wavelength of the radiation to achieve an optimized irradiation for the image.

## Claims

### Claim 1

An imaging system for creating an optimized image of a region to be imaged, the imaging system comprising:
an irradiation system comprising at least a first radiation emitter and a second radiation emitter, the first radiation emitter and the second radiation emitter each being individually adjustable for individual irradiation of the region to be imaged;
a camera system comprising at least one camera that creates an image of the region to be imaged;
an image analysis unit adapted to analyze the image and digitally provide an analysis result; and
a control unit adapted to control the irradiation system based on the analysis result and to change an irradiation of the first radiation emitter and/or the second radiation emitter to change an intensity of radiation and/or a wavelength of radiation in order to achieve an optimized irradiation for the image of the region to be imaged.

### Claim 2 (depends on 1)

The imaging system according to claim 1, further comprising a filter that is controllable by the control unit and is adapted to controllably selectively lower the intensity of radiation and/or to filter wavelengths in order to serve as the first radiation emitter (12) and/or second radiation emitter together with an upstream radiation source.

### Claim 3 (depends on 2)

The imaging system according to claim 2, wherein the filter is adapted to set a different absorption of radiation at at least two different portions through which radiation passes, so that the intensity of radiation is locally selectively adjustable.

### Claim 4 (depends on 1)

The imaging system according to claim 1, further comprising at least one projector, the at least one projector having a grid-shaped or matrix-shaped arrangement of individually controllable radiation emitters that include the first radiation emitter and the second radiation emitter, so that a projected irradiation with individually controllable radiations is provided for different regions of the region to be imaged.

### Claim 5 (depends on 4)

The imaging system according to claim 4, wherein the at least one projector comprises a first projector and a second projector, wherein the first projector emits a first wavelength.

### Claim 6 (depends on 5)

The imaging system according to claim 5, wherein the first projector emits wavelengths in the IR range and/or UV range and/or X-ray range, and the second projector emits wavelengths in the visible range in order to provide the user with an adapted illumination of the region to be imaged.

### Claim 7 (depends on 4)

The imaging system according to claim 4, wherein the irradiation system is a lighting system and the control unit is adapted to control the lighting system such that a provided, in particular colored, picture is projected via the lighting system directly into the region to be imaged in order to act as an augmented reality projector.

### Claim 8 (depends on 1)

The imaging system according to claim 1, wherein the at least one camera has a sensor with a matrix-shaped arrangement of semiconductor sensor pixels for radiation measurement.

### Claim 9 (depends on 1)

The imaging system according to claim 1, wherein the at least one camera comprises a 3D camera to create a 3D image with depth information.

### Claim 10 (depends on 1)

The imaging system according to claim 1, further comprising a prism in order to realize in sections a common beam path of the irradiation system and the camera system.

### Claim 11 (depends on 1)

The imaging system according to claim 1, wherein characterized in that the camera system comprises at least two sensors having different sensitivities for different wavelength ranges in order to combine a highest possible sensitivity for different wavelength ranges.

### Claim 12 (depends on 1)

The imaging system according to claim 1, wherein the control unit is adapted to iteratively perform imaging, analyzing, and adapting of irradiation to obtain the optimized irradiation for the image and thus the optimized image of the region to be imaged.

### Claim 13 (depends on 1)

A medical microscope comprising the imaging system according to claim 1.

### Claim 14 (depends on 1)

A surgical light, wherein the surgical light comprises the imaging system according to claim 1.

### Claim 15 (depends on 1)

A surgical robotic system comprising at least one robot and the imaging system according to claim 1.

### Claim 16 (depends on 1)

An imaging method comprising the step of creating an optimized image of a region to be imaged with the imaging system according to claim 1,
wherein the imaging system is in a medical microscope, in a surgical light, in a robotic system with robots, or in an endoscope.

### Claim 17

An imaging method for creating an optimized image of a region to be imaged, the imaging method comprising the steps of:
irradiating the region to be imaged with at least a first radiation emitter and a second radiation emitter, the first radiation emitter and the second radiation emitter each being individually adjustable;
imaging the irradiated region to be imaged by a camera system comprising a camera;
analyzing an image by an image analysis unit; and
controlling the first radiation emitter and the second radiation emitter such that an irradiation of the first radiation emitter and/or the second radiation emitter is changed in an intensity of the radiation and/or in a wavelength of the radiation in order to achieve the optimized image of the region to be imaged.

### Claim 18 (depends on 17)

A computer-readable storage medium comprising commands which, when executed by a computer, cause the computer to perform the imaging method according to claim 17.

### Claim 19 (depends on 17)

A computer program comprising commands which, when executed by a computer, cause the computer to perform the imaging method according to claim 17.

### Claim 20 (depends on 1)

The imaging system according to claim 1, wherein the irradiation system is a lighting system.
