# US 2009/0244272 A1 · Methods and apparatus for imaging using a light guide bundle and a spatial light modulator

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0244272 A1
- Document ID: US20090244272A1
- Status: Published application
- Kind: A1
- Application number: 12/259,232
- Filed: 2008-10-27
- Published: 2009-10-01
- Earliest claimed: 1999-12-17
- Assignees: Motic China Group Co., Ltd.
- Inventors: Calum E. MacAulay; Andrew L.P. Dlugan; Pierre M. Lane
- Web page: https://patentgrep.com/patent/US20090244272A1

## CPC

- A61B 1/00172: {with means for scanning}
- A61B 1/00165: {with light-conductive means, e.g. fibre optics (A61B1/07 takes precedence)}
- G02B 21/0028: {specially adapted for specific applications, e.g. for endoscopes, ophthalmoscopes, attachments to conventional microscopes}
- G02B 21/0032: {Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers (G02B21/0036 - G02B21/008; means for illumination of specimens in general G02B21/06)}
- G02B 21/0056: {based on optical coherence, e.g. phase-contrast arrangements, interference arrangements}
- G02B 21/0072: {details concerning resolution or correction, including general design of CSOM objectives}
- G02B 23/2453: {of the proximal end}
- G02B 23/26: using light guides {(for illumination G02B23/2469)}
- A61B 1/07: using light-conductive means, e.g. optical fibres
- G02B 6/06: the relative position of the fibres being the same at both ends, e.g. for transporting images
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

Endoscopes and other viewing devices that control the light that contacts a sample and/or that is detected emanating from a sample. The viewing devices are particularly well suited for in vivo imaging, although other uses are also included. The viewing devices, and methods related thereto, comprise a spatial light modulator in the illumination and/or detection light path so that light transmitted to the target via a bundle of light guides or optical system is transmitted substantially only into the cores of the light guide bundle and not into the cladding surrounding the light guides, filler between the light guides in the bundle, or undesired light guides. Also, methods and apparatus for mapping the pixels of the spatial light modulator to the cores of the light guides in the bundle (preferably at least 3 pixels (e.g., at least 3 mirrors for a digital micromirror device) for each core), as well as for mapping the light guides of one light guide bundle to another.

## Claims

### Claim at position 1

1-8. (canceled)

### Claim 9

A viewing system comprising a spatial light modulator and a light guide bundle having a proximal end and a distal end, wherein spatial light modulator is optically connected to the proximal end of the light guide bundle in a same conjugate image plane as the proximal end such that the spatial light modulator controls the location of light impinging on the proximal end,
wherein the spatial light modulator is operably connected to a controller comprising computer-implemented programming able to set to an on-state pixels of the spatial light provide on-pixels and able to set to an off-state pixels corresponding to inter-core areas of the light guide bundle to provide off-pixels,
wherein the viewing system further comprises a pixelated detector optically connected to receive light emanating from the proximal end of the light guide bundle and the controller further comprises computer-implemented programming that distinguishes between light emanating from the light guides corresponding to on-pixels of the spatial light modulator and light emanating from other light guides, and
wherein the controller further comprises computer-implemented programming that detects light emanating from the other light guides to provide out-of-focus data and the programming incorporates the out-of-focus data with the light emanating from the light guides corresponding to the on-pixels to provide an enhanced image.

### Claim 10 (depends on 9)

The viewing system of claim 9 wherein the controller fits the out-of-focus data and the light emanating from the light guides corresponding to the on-pixels using a 2D Gaussian distribution.

### Claim at position 4

11-12. (canceled)

### Claim 13 (depends on 9)

The viewing system of claim 9 wherein the controller further comprises computer-implemented programming that maps pixels of the spatial light modulator to corresponding cores of corresponding light guides in the light guide bundle to provide a map comprising corresponding pixels and non-corresponding pixels.

### Claim 14 (depends on 13)

The viewing system of claim 13 wherein the viewing system further comprises a scanner that controls the location of light transmitted to the spatial light modulator and on to the proximal end of the light guide bundle, and the controller further comprises computer-implemented programming that directs the scanner to scan the spatial light modulator and simultaneously sets at least one of the corresponding pixels to an on-state and sets other pixels of the spatial light modulator to an off-state, thereby causing light from the light source to be transmitted substantially only to the cores of corresponding light guides.

### Claim at position 7

15-20. (canceled)

### Claim 21

A flexible endoscope system, providing confocal microscopy of a target tissue, the system comprising an endoscope comprising a light guide bundle comprising at least 100 light guides and having a proximal end and a distal end, the system further comprising a spatial light modulator that is optically connected to the proximal end of the light guide bundle in a same conjugate image plane as the proximal end such that the spatial light modulator controls the location of light impinging on the proximal end, and a controller comprising computer-implemented programming that is operably connected to the spatial light modulator and that is able to set to an on-state groups of pixels of the spatial light modulator corresponding to cores of corresponding light guides in the light guide bundle to provide groups of on-pixels and able to set to an off-state pixels corresponding to inter-core areas of the light guide bundle to provide off-pixels,
wherein a plurality of selected groups of the on-pixels are in the on-state, the selected groups being spaced apart such that light emanating from the distal end of a first light guide corresponding to a first selected group of on-pixels does not substantially interfere with light emanating from the distal end of a second light guide corresponding to a second selected group of on-pixels, and other pixels of the spatial light modulator are in the off-state,
wherein the endoscope further comprises a pixelated detector optically connected to receive light emanating from the proximal end of the light guide bundle and the controller further comprises computer-implemented programming that distinguishes between light emanating from, the light guides corresponding to on-pixels of the spatial light modulator and light emanating from other lights guides, and
wherein the controller further comprises computer-implemented programming that detects light emanating from the other light guides to provide out-of-focus data and the programming incorporates the out-of-focus data with the light emanating from the light guides corresponding to the on-pixels to provide an enhanced image.

### Claim at position 9

22-43. (canceled)

### Claim 44

A method of obtaining and image of a target comprising:
a) transmitting light from a light source via a spatial light modulator to a light guide bundle, then emitting the light from a distal end of the light guide bundle to illuminate the target and thereby cause light to emanate form the target to provide emanating light;
b) collecting the emanating light that contacts the distal end of the light guide bundle; and
c) transmitting the emanating light via the light guide bundle to a detector to provide an image of the target at the detector,
wherein the detector comprises and eyepiece ocular,
wherein the detector comprises a pixelated detector.
wherein the method comprises setting to an on-state pixels of the spatial light modulator that correspond to cores of corresponding light guides in the light guide bundle to provide on-pixels and setting to an off-state pixels corresponding to inter-core areas of the light guide bundle to provide off-pixels,
wherein the method comprises setting a plurality of selected groups of the on-pixels to an on-state wherein the selected groups are spaced apart such that light emanating from the distal end of a first light guide corresponding to a first selected group of on-pixels does not substantially interfere in the target with light emanating from the distal end of at least one second light guide corresponding to at least one second selected group of on-pixels, and substantially all other pixels of the spatial light modulator are in the off-state to provided other light guides,
wherein the method further comprises ignoring light emanating from the other light guides, and
wherein the method further comprises evaluating the light emanating from the other light guides to provide out-of-focus data and the incorporating the out-of-focus data with the light emanating from the light guides corresponding to the on-pixels to provide an enhanced image.

### Claim at position 11

45-47. (canceled)

### Claim 48

A method of using a linear shift invariant imaging system comprising, within the linear shift invariant imaging system:
selectively illuminating a series of discrete locations in a sample to be imaged;
sensing and recording light emanating from each of the discrete locations and sensing and recording light emanating from an area adjacent each of the illuminated discrete locations in the sample using a known spatial pattern for each of the discrete locations.

### Claim 49 (depends on 48)

The method of claim 48 wherein the emanating light is reflected light.

### Claim 50 (depends on 48)

The method of claim 48 wherein the emanating light is fluorescence light.

### Claim 51 (depends on 48)

The method of claim 48 in the discrete locations are illuminated using as a series of known patterns of illuminated locations and light emanating from the illuminated areas and the adjacent areas is recorded using the known spatial patterns such that light from both the illuminated locations and the adjacent areas are recorded for each of the illuminated locations.

### Claim 52 (depends on 51)

The method of claim 51 wherein the illuminated locations are sufficiently separated from one another such that the illumination light and the emanating light from each of the illuminated locations do not interact with each other.

### Claim 53 (depends on 48)

The method of claim 48 wherein the known spatial pattern is a Cartesian pattern centered on the illumination location.

### Claim 54 (depends on 53)

The method of claim 53 wherein the Cartesian pattern consists of locations in a plane perpendicular to an optical imaging axis of the system as it intersects the sample at the focal point of the illumination spot.

### Claim 55 (depends on 53)

The method of claim 53 wherein the Cartesian pattern consists of locations in a plane perpendicular to an optical imaging axis of the system as it intersects the sample at the focal point of the illumination spot and adjacent perpendicular planes above and below the focal point.

### Claim 56 (depends on 48)

The method of claim 48 wherein the sensing is performed by a pixelated sensor and wherein the Cartesian pattern corresponds to pixels of the pixilated sensor in a conjugate image plane of the sample and the illumination locations.

### Claim 57 (depends on 53)

The method of claim 53 wherein the recorded data from the illuminated location and the adjacent area is combined to remove out of focus information.

### Claim 58 (depends on 53)

The method of claim 53 wherein the recorded data from the illuminated location and the adjacent area is combined to enhance resolution of the illuminated location.

### Claim 59 (depends on 53)

The method of claim 53 wherein the recorded data from the illuminated location and the adjacent area is used to improve the performance of deconvolution algorithms to enhance the image resolution of the system.

### Claim 60 (depends on 53)

The method of claim 53 wherein the recorded data from the illuminated location and the adjacent area is used to improve the speed with which deconvolution algorithms can enhance the image resolution of the system.

### Claim 61 (depends on 53)

The method of claim 53 wherein the recorded data from the illuminated location and the adjacent area is used to improve the resolution improvement of deconvolution algorithms to enhance the image resolution of the system.

### Claim 62 (depends on 56)

The method of claim 56 wherein the recorded data from the illuminated location and the adjacent area is combined using an image processing kernel applied to all the data associated with one illumination pattern of the series to provide a processed result and then the processed result is combined with processed data from the other illumination patterns of the series to form an image of the sample.

### Claim 63 (depends on 57)

The method of claim 57 wherein the recorded data from the illuminated location and the adjacent area is combined using an image processing kernel applied to the data associated with one illumination pattern of the series to provide a processed result directed only to the illuminated location and then the processed result is combined with the processed data associated only with the illuminated locations from the other illumination patterns to form an image of the sample.
