# US 12,019,397 B2 · Method of forming a complex image of a sample

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,019,397 B2
- Document ID: US12019397B2
- Status: Granted
- Kind: B2
- Application number: 17/646,208
- Filed: 2021-12-28
- Published: 2022-07-07
- Granted: 2024-06-25
- Earliest claimed: 2020-12-28
- Assignees: Commissariat A L'energie Atomique Et Aux Energies Alternatives; Centre National De La Recherche Scientifique; Universite Grenoble Alpes
- Applicants: Commissariat à l'Energie Atomique et aux Energies Alternatives; Centre National De La Recherche Scientifique; Université Grenoble Alpes
- Inventors: Marc Zelsmann; Pierre Marcoux; Emmanuel Picard
- Web page: https://patentgrep.com/patent/US12019397B2

## CPC

- G03H 1/0891: {Processes or apparatus adapted to convert digital holographic data into a hologram (G03H1/2294 takes precedence)}
- G03H 1/0443: {Digital holography, i.e. recording holograms with digital recording means (holobject computation G03H1/0866)}
- G03H 1/0866: {Digital holographic imaging, i.e. synthesizing holobjects from holograms}
- G03H 1/2645: {Multiplexing processes, e.g. aperture, shift, or wavefront multiplexing}
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- H04N 23/56: provided with illuminating means
- G03H 2001/0447: {In-line recording arrangement}
- G03H 2001/0452: {arranged to record an image of the object}
- G03H 2001/0458: {Temporal or spatial phase shifting, e.g. parallel phase shifting method}
- G03H 2001/0471: {Object light being transmitted through the object, e.g. illumination through living cells}
- G03H 2210/55: Having particular size, e.g. irresolvable by the eye
- G03H 2223/13: Phase mask
- G03H 2223/26: Means providing optical delay, e.g. for path length matching
- G03H 2226/02: Computing or processing means, e.g. digital signal processor [DSP]
- G06T 2207/30004: Biomedical image processing
- G03H: HOLOGRAPHIC PROCESSES OR APPARATUS (holograms, e.g. point holograms, used as ordinary optical elements G02B5/32; producing stereoscopic or other three-dimensional effects G02B30/00; diffraction-grating systems G02B27/44; systems using moiré fringes G02B27/60; optical logic elements G02F3/00; stereo-photography G03B35/00; photosensitive materials or processes for photographic purposes G03C; {stereo-photographic or similar processes G03C9/00}; apparatus for processing exposed photographic materials G03D; analogue computers performing mathematical operations with the aid of optical elements G06E3/00; authentication by radiation, of concealed information carried by holograms or diffraction gratings G06K19/16; holographic storage G11B7/0065, G11C13/04; {stereoscopic or other three dimensional effects in television systems H04N13/00})
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for obtaining an image of a sample includes illuminating the sample using a light source; acquiring, using an image sensor, a first image of the sample, the image being formed in the detection plane, the first image being representative of an exposure light wave propagating, from the sample, to the image sensor, along a first optical path; modifying an optical refractive index, between the image sensor and the sample; acquiring a second image of the sample, the image being representative of the exposure light wave along a second optical path; and implementing an iterative algorithm that combines the first and second images so as to obtain an image of the sample.

## Claims

### Claim 1

A method for obtaining an image of a sample, the method comprising:
(a) illuminating the sample using a light source configured to emit a light wave that propagates to the sample;
(b) acquiring, using an image sensor, a first image of the sample, said first image being formed in a detection plane, the sample being placed between the light source and the image sensor, the first image being representative of an exposure light wave propagating from the sample, to the image sensor, along a first optical path;
(c) modifying an optical refractive index, between the image sensor and the sample, so as to obtain a variation in the optical path of the exposure light wave;
(d) acquiring, using the image sensor, a second image of the sample, the second image being formed in the detection plane, the second image being representative of the exposure light wave propagating, from the sample, to the image sensor, along a second optical path, the second optical path corresponding to the first optical path plus the variation in optical path resulting from (c);
(e) implementing an iterative algorithm comprising the substeps of:
(ei) forming an initial image, in the detection plane, from a starting image chosen from the first image and the second image;
(eii) applying a holographic propagation operator to the initial image or to a new complex image formed in the detection plane, resulting from a previous iteration, so as to obtain a reconstructed complex image in a reconstruction plane, a distance between the reconstruction plane and the detection plane corresponding to the variation in optical path obtained in (c), the reconstructed complex image formed in the reconstruction plane having a modulus and a phase defined in each pixel of the reconstructed complex image;
(eiii) in the reconstruction plane, updating the modulus of the reconstructed complex image formed in the reconstruction plane to form an updated complex image, resulting from (eii), in each of the pixels thereof, depending on a destination image, the destination image being chosen from the first image or the second image, the destination image being different from the starting image chosen in (ei);
(eiv) applying a holographic propagation operator to the updated complex image of (eiii), to form the new complex image in the detection plane, the new complex image formed in the detection plane having a modulus and a phase defined in each pixel of said image;
(ev) updating the modulus of the new complex image formed in the detection plane in step (eiv), in each of the pixels thereof, depending on the starting image; and
(evi) reiterating substeps (eii) to (ev) until a criterion for stopping the iterations is met; and
(f) obtaining the image of the sample from one of the new complex image resulting from step (e), the new complex image being formed in the detection plane, or the updated complex image resulting from step (e), the updated complex image being formed in the reconstruction plane.

### Claim 2 (depends on 1)

The method according to claim 1, wherein:
step (eiii) further comprises updating the new complex image, in the reconstruction plane, by replacing, in each of the pixels thereof, the modulus of the new complex image by a square root of the destination image; and
step (ev) further comprises updating the new complex image, in the detection plane, by replacing, in each of the pixels thereof, the modulus of the new complex image by a square root of the starting image.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the criterion for stopping the iterations is a pre-set number of iterations of substeps (eii) to (ev).

### Claim 4 (depends on 1)

The method according to claim 1, wherein substep (evi) of each iteration, after the first iteration, further comprises computing a mean phase deviation, the mean phase deviation comprising:
a mean deviation between the phases of each pixel of the reconstructed complex image formed, in the reconstruction plane, in substep (eii) of the iteration and in the previous iteration; or
a mean deviation between the phases of each pixel of the new complex image formed, in the detection plane, in substep (eiv) of the iteration and in the previous iteration; and
the criterion for stopping the iterations is met when the mean deviation drops below a pre-set threshold or when a difference in mean deviation, between two successive iterations, drops below a pre-set threshold.

### Claim 5 (depends on 1)

The method according to claim 1, wherein:
during the acquisition of the first image, a first material, having a first refractive index, lies between the sample and the image sensor;
step (c) further comprises replacing a portion of the first material by a second material, the second material having a second refractive index different from the first refractive index so that the second optical path is longer or shorter than the first optical path.

### Claim 6 (depends on 1)

The method according to claim 1, wherein a distance between the image sensor and the sample is identical in steps (b) and (d).

### Claim 7 (depends on 1)

The method according to claim 1, wherein:
an optical system lies between the sample and the image sensor, the optical system defining an object plane and an image plane;
the sample lies in a sample plane, the sample plane being offset with respect to the object plane; and/or
the detection plane is offset with respect to the image plane.

### Claim 8 (depends on 1)

The method according to claim 1, wherein the step (f) further comprises obtaining the image of the sample by applying a reconstruction operator to:
the updated complex image formed in the detection plane in a last iteration of substeps (eii) to (ev); or
the updated complex image formed in the reconstruction plane, in the last iteration of substeps (eii) to (ev).

### Claim 9 (depends on 1)

A device for observing a sample, the device comprising:
a light source configured to illuminate the sample;
an image sensor configured to acquire an image of the sample; and
a sample holder configured to hold the sample between the light source and the image sensor,
wherein the device is configured to allow to be placed, between the sample and the image sensor:
a first material, of a first refractive index, such that the image sensor is configured to acquire a first image of the sample when the first material is placed between the sample and the image sensor; or
a second material, instead of the first material, of a second refractive index different from the first refractive index, such that the image sensor is configured to acquire a second image of the sample, when the second material is placed between the sample and the image sensor; and
the device further comprises processing circuitry configured to implement steps (e) and (f) of the method according to claim 1.

### Claim 10 (depends on 9)

The device according to claim 9, wherein the sample holder is fixed with respect to the image sensor, such that a distance between the sample and the image sensor is identical during the acquisition of the first image and during the acquisition of the second image.

### Claim 11 (depends on 9)

The device according to claim 9, wherein:
an optical system lies between the sample and the image sensor, the optical system defining an object plane and an image plane;
the sample lies in a sample plane, the sample plane being offset with respect to the object plane; and/or
the detection plane is offset with respect to the image plane.