# US 9,517,009 B2 · Structured illumination ophthalmoscope > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,517,009 B2 - Document ID: US9517009B2 - Status: Granted - Kind: B2 - Application number: 14/432,096 - Filed: 2013-09-26 - Published: 2015-10-22 - Granted: 2016-12-13 - Earliest claimed: 2012-09-28 - Assignees: Ruprecht-Karls-UniversitäT Heidelberg; Friedrich-Schiller-Universität Jena - Applicants: Universität Heidelberg; Friedrich-Schiller-Universität Jena - Inventors: Christoph Cremer; Gerrit Best; Roman Amberger; Rainer Heintzmann; Stefan Dithmar; Thomas Ach - Web page: https://patentgrep.com/patent/US9517009B2 ## CPC - A61B 3/12: for looking at the eye fundus, e.g. ophthalmoscopes (A61B3/13 takes precedence) - A61B 3/0008: {provided with illuminating means (A61B3/117, A61B3/14 take precedence)} - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) ## Abstract A method for non-invasive observations of a fundus using an ophthalmoscope is provided. The method includes illuminating a retinal region of an eye by projecting an illumination pattern of illumination light onto the retinal region, at least one of detecting a portion of fluorescent light emitted from the retinal region and detecting a portion of illumination light reflected from the retinal region, thereby capturing a series of images of the retinal region at a plurality of different relative positions of the retinal region with respect to the illumination pattern projected onto the retinal region, wherein between the capturing of at least two images of the series the relative position of the retinal region with respect to the illumination pattern projected onto the retinal region is shifted in a non-controlled manner, and processing the captured images to extract a sub-resolution image of the retinal region. ## Claims ### Claim 1 A method for non-invasive observations of a fundus using an ophthalmoscope (100), the method comprising: illuminating a retinal region of an eye (52) by projecting an illumination pattern of illumination light onto the retinal region of the eye (52); at least one of detecting at least a portion of fluorescent light emitted from the retinal region of the eye (52) and detecting at least a portion of illumination light reflected from the retinal region of the eye (52), thereby capturing a series of images of the retinal region of the eye (52) at a plurality of different relative positions of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52), wherein between the capturing of at least two images of the series the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52) is shifted in a non-controlled manner; and processing the captured images to extract a sub-resolution image of the retinal region of the eye (52). ### Claim 2 (depends on 1) The method according to claim 1, wherein the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52) is shifted in a non-controlled manner by utilizing at least one of stochastic saccades of the eye (52), stochastic stage scanning, and stochastic movement of a focusing lens system (42, 44) of an ophthalmoscope objective (40). ### Claim 3 (depends on 1) The method according to claim 1, wherein processing the captured images comprises: for each image of the series determining the non-controlled shift of the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52); a-posteriori shifting of each image of the series to reverse the determined shift of the relative position of the retinal region of the eye (52) with respect to the projected illumination pattern, thereby obtaining a corresponding shifted image; and processing the shifted images to extract a sub-resolution image of the retinal region of the eye (52). ### Claim 4 (depends on 3) The method according to claim 3, wherein determining the non-controlled shift of the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal of the eye (52) comprises: applying an analytic deconvolution of each of a second and subsequent images of the series by a first image of the series to obtain a corresponding deconvolved image; determining the position of a maximum (P) of the analytic deconvolution of each of the deconvolved images; and determining the non-controlled shift of the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52) for each of the second and subsequent images of the series from the determined position of the maximum (P) of the analytic deconvolution. ### Claim 5 (depends on 3) The method according to claim 3, wherein determining of the non-controlled shift of the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal of the eye (52) comprises: Fourier-transforming of each of the images of the series; dividing each of the Fourier-transformed second and each subsequent images by the Fourier-transformed first image to obtain a corresponding divided image; inverse Fourier-transforming each of the divided images; determining the position of a maximum (P) of intensity of each of the inverse Fourier-transformed divided images; and determining the non-controlled shift of the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal of the eye (52) for each of the second and subsequent images of the series from the determined position of the maximum (P) of intensity of the inverse Fourier-transformed divided image. ### Claim 6 (depends on 1) The method according to claim 1, wherein the illumination pattern is projected onto the retinal region of the eye (52) through at least one objective (40) of the ophthalmoscope (100) having a numerical aperture of less than 0.5. ### Claim 7 (depends on 1) The method according to claim 1, wherein the retinal region of the eye (52) is illuminated only when images are captured. ### Claim 8 (depends on 7) The method according to claim 7, wherein the duration of on-times during which the retinal region of the eye (52) is illuminated is shorter than the duration of off-times during which the illumination of the retinal region of the eye (52) is interrupted. ### Claim 9 (depends on 1) The method according to claim 1, further comprising the steps of: detecting non-controlled shifts of the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52); and synchronizing the illumination of the retinal region of the eye (52) and/or the capturing of a series of images with the detected non-controlled shifts of the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52). ### Claim 10 (depends on 1) The method according to claim 1, further comprising the sorting-out one or more of the captured images, wherein a particular image is sorted out if it is determined that the non-controlled shift of the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52) during the capturing of the image exceeds a predetermined threshold. ### Claim 11 (depends on 1) The method according to claim 1, further comprising: focusing the illumination pattern of illumination light in a plurality of different focal planes; for each focal plane obtaining a set of images including a plurality of images captured at a plurality of different relative positions of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52); and generating a three-dimensional image based on the obtained sets of images for the plurality of different focal planes. ### Claim 12 An ophthalmoscope (100) for non-invasive observations of a fundus, the ophthalmoscope (100) comprising: a light source (10; 11; 12) configured to emit illumination light; a pattern generation system (20; 22; 24) arranged in the optical path of the illumination light, said pattern generation system (20; 22; 24) configured to generate an illumination pattern of the illumination light; at least one objective (40) arranged and configured to illuminate the retinal region of an eye (52) by projecting the illumination pattern onto the retinal region of the eye (52); an image capturing system (70) configured to detect at least one of at least a portion of fluorescent light emitted from the retinal region of the eye (52) and at least a portion of illumination light reflected from the retinal region of the eye (52), thereby capturing a series of images of the retinal region of the eye (52) at a plurality of different relative positions of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52), wherein between the capturing of at least two images of the series the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52) is shifted in a non-controlled manner; and a data processing system configured to process data obtained from the series of captured images, thereby producing a sub-resolution image of the retinal region of the eye (52). ### Claim 13 (depends on 12) The ophthalmoscope (100) according to claim 12, wherein the at least one objective (40) has a numerical aperture of less than 0.5. ### Claim 14 (depends on 12) The ophthalmoscope (100) according to claim 12, wherein the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52) is shifted in a non-controlled manner by utilizing at least one of stochastic saccades of the eye (52), stochastic stage scanning, and stochastic movement of a focusing lens system (42, 44) of the ophthalmoscope objective (40). ### Claim 15 (depends on 12) The ophthalmoscope (100) according to any claim 12, wherein the light source (10; 11; 12) is configured to emit stroboscopic illumination light having on- and off-times, wherein the retinal region of the eye (52) is illuminated only during the on-times, and wherein the on-times are respectively shorter than the off-times during which the illumination of the retinal region of the eye (52) is interrupted. ### Claim 16 (depends on 12) The ophthalmoscope (100) according to claim 12, further comprising: a shift detector for detecting non-controlled shifts of the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52); and a synchronizer configured to synchronize at least one of the illumination of the retinal region of the eye (52) and the capturing of a series of raw images with the detected non-controlled shifts of the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52). ### Claim 17 (depends on 12) The ophthalmoscope (100) according to claim 12, wherein the pattern generation system (20; 22; 24) comprises an intensity modulating light transmitting spatial light modulator. ### Claim 18 A computer implemented method for generating sub-resolution images of a fundus based on a series of images of the retinal region of the eye (52) obtained by an ophthalmoscope (100), wherein the series of images is obtained by projecting an illumination pattern of illumination light onto the retinal region of the eye (52), thereby illuminating the retinal region of the eye 52 and at least one of detecting at least a portion of fluorescent light emitted from the retinal region of the eye (52) and detecting at least a portion of illumination light reflected from the retinal region of the eye (52), thereby capturing a series of images at a plurality of different relative positions of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52), wherein between the capturing of at least two images of the series the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52) is shifted in a non-controlled manner, said method comprising: receiving the series of images of the retinal region of the eye (52); for each received image determining the non-controlled shift of the relative position of the retinal region of the eye (52) with respect to the illumination pattern projected onto the retinal region of the eye (52); a-posteriori shifting of each received image to reverse the corresponding non-controlled shift of the retinal region of the eye (52) with respect to the projected illumination pattern, thereby obtaining a corresponding shifted image; and processing the shifted images to extract a sub-resolution image. ### Claim 19 (depends on 18) A computer program product, which, when loaded into the memory of a computer and executed by the computer performs a computer implemented method according to claim 18.