# US 2014/0192178 A1 · Method and system for tracking motion of microscopic objects within a three-dimensional volume

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192178 A1
- Document ID: US20140192178A1
- Status: Published application
- Kind: A1
- Application number: 14/238,727
- Filed: 2012-08-13
- Published: 2014-07-10
- Earliest claimed: 2011-08-12
- Assignees: Agency for Science, Technology and Research
- Inventors: Chao-Hui Huang; Shvetha Sankaran; Sohail Ahmed; Daniel Racoceanu; Srivats Hariharan
- Web page: https://patentgrep.com/patent/US20140192178A1

## CPC

- G02B 21/365: {Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence)}
- G02B 21/14: affording illumination for phase-contrast observation
- G02B 21/367: {providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison}
- G06T 7/181: involving edge growing; involving edge linking
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 2207/10056: Microscopic image
- G06T 2207/30024: Cell structures in vitro; Tissue sections in vitro
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Phase contrast microscopy images are collected of a liquid sample containing one or more microscopic objects. The images are analyzed to track the motion of the microscopic objects within the liquid sample. Using the updated locations of the tracking objects, a controller can generate control signals for controlling the microscopy parameters, to ensure that the portion of the liquid sample which is imaged includes the tracking objects. The tracking objects may be cells or cell-spheres. Thus, the system can, for example, track cells and cell-spheres, to observe their growth, during a long time-lapse experiment.

## Claims

### Claim 1

A system for observing one or more objects within a liquid sample, the system comprising:
a microscope for forming images of the liquid sample, the images being of respective layers of the liquid sample, the layers being transverse to an optic axis of the microscope and relatively displaced from each other parallel to the optic axis;
a camera for capturing images formed by the microscope;
a localizer arranged to analyze the captured images, and, using a set of previously stored locations for each of the respective objects, to update the set of locations for the respective objects.

### Claim 2 (depends on 1)

A system according to claim 1 further including a controller for generating control signals based on the updated locations, the control signals being for controlling the relative positions of the microscope and a platform for supporting the liquid sample, to vary the portion of the liquid sample which is imaged by the microscope.

### Claim 3 (depends on 2)

A system according to claim 2 in which the controller is arranged to identify a region of interest in the liquid sample using the updated locations, and said control signals include signals for controlling the focus of the microscope to capture images of layers of the liquid sample corresponding to said region of interest.

### Claim 4 (depends on 1)

A system according to claim 1 in which the localizer includes an object identifier for identifying portions of the captured images corresponding to the objects, a feature extraction unit for extracting features of the identified portions of the images, and a classifier for updating the set of stored locations based on the features.

### Claim 5 (depends on 4)

A system according to claim 4 in which the object identifier seeks local intensity maxima in the images.

### Claim 6 (depends on 5)

A system according to claim 5 in which, prior to seeking the intensity maxima, the object identifier processes the captured images with a Sobel operator and/or a Gaussian blur.

### Claim 7 (depends on 4)

A system according to claim 4 in which the feature extraction unit performs wavelet transformations in regions of the captured images selected based on the identified portions of the images.

### Claim 8 (depends on 7)

A system according to claim 7 in which the regions are bands encircling the identified portions of the images, the bands being selected based on contours having equal intensity in the captured images.

### Claim 9 (depends on 7)

A system according to claim 7 in which the feature extraction unit generates, for each identified position of the image, a respective data-set encoding the results of the wavelet transformations at multiple wavelet levels.

### Claim 10 (depends on 4)

A system according to claim 4 in which the classifier uses an algorithm.

### Claim 11 (depends on 1)

A system according to claim 1 in which the microscope is a phase contrast microscope.

### Claim 12

A method observing one or more objects within a liquid sample, the method comprising:
capturing microscopy images of the liquid sample, the images being of respective layers of the liquid sample, the layers being transverse to an optic axis of the microscope and relatively displaced from each other parallel to the optic axis;
analyzing the captured images, and, using a set of previously stored locations for each of the respective objects, to update the set of locations for the respective objects.

### Claim 13 (depends on 12)

A method according to claim 12 further including, based on the updated locations, controlling the relative positions of the microscope and platform, to vary the portion of the liquid sample which is imaged by the microscope.

### Claim 14 (depends on 13)

A method according to claim 13 including identifying a region of interest in the liquid sample using the updated locations, and controlling the focus of the microscope to capture images of layers of the liquid sample corresponding to said region of interest.

### Claim 15 (depends on 11)

A method according to claim 11 in which said objects are cells or cell spheres, the method further including analyzing regions of the captured images including the updated locations, to study changes in the cells or cell spheres.
