# US 2013/0156287 A1 · Observation device, observation program, and observation system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0156287 A1
- Document ID: US20130156287A1
- Status: Published application
- Kind: A1
- Application number: 13/808,520
- Filed: 2011-08-30
- Published: 2013-06-20
- Earliest claimed: 2010-08-30
- Assignees: Sanyo Electric Co., Ltd.
- Inventors: Mikio Houjou; Atsushi Oda
- Web page: https://patentgrep.com/patent/US20130156287A1

## CPC

- G01N 21/01: Arrangements or apparatus for facilitating the optical investigation
- A61B 5/0033: {Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room}
- C12M 41/36: {of biomass, e.g. colony counters or by turbidity measurements (electrooptical investigation of individual particles G01N15/14, flow cytometers G01N15/1404)}
- G01N 21/13: Moving of cuvettes or solid samples to or from the investigating station {(handling materials for automatic analysis G01N35/00)}
- G02B 21/0088: {Inverse microscopes}
- G02B 21/361: {Optical details, e.g. image relay to the camera or image sensor (G02B21/364 takes precedence; illumination details G02B21/06 and subgroups)}
- G02B 21/365: {Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence)}
- H04N 23/56: provided with illuminating means
- G01N 2201/022: Casings
- G01N 2201/062: LED's
- G01N 2201/0638: Refractive parts
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- C12M: APPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; {APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An observation device (1) is provided with: a general observation unit (10) for observing sample cells by observing an entire container (C) containing the cells and a culture solution; and a magnification observation unit (20) for magnifying a region within the container (C) and observing the cells, the general observation unit (10) and the magnification observation unit (20) each individually having lighting for illuminating the cells with light, and an optical system for observing the cells. The general observation unit (10) and the magnification observation unit (20) are thereby each provided with an individual optical system and lighting, making it possible to configure an appropriate observation unit for use both when the cells are observed by observing the entire container (C) and when a part within the container (C) is magnified and the cells are observed.

## Claims

### Claim at position 1

-22. (canceled)

### Claim 23

An observation program for making a computer execute processing, the processing comprising:
overall image sensing processing for taking an image of a sample through taking an image of an entire container containing the sample and a solution;
sample mass discrimination processing for discriminating from the image taken in the overall image sensing processing a sample mass, which is a mass of a plurality of pieces of the sample;
coordinate detection processing for detecting coordinates of a center of the sample mass discriminated in the sample mass discrimination processing;
magnified image sensing processing for taking an image of the sample mass on a magnified scale about, as a center, the coordinates detected in the coordinate detection processing; and
time keeping processing for counting days and hours from a start of observation of the sample, wherein
in the sample mass discrimination processing, discrimination of the magnified observation target sample mass is repeated every predetermined period counted in the time keeping processing with respect to sample mass discrimination until, from the image taken in the overall image sensing processing, any of sample masses, which are each a mass of a plurality of pieces of the sample, is recognized as a magnified observation target sample mass having a size equal to or larger than a predetermined size, and the discrimination of the magnified observation target sample mass is stopped on condition that a predetermined number of days have elapsed, and
in the coordinate detection processing, on condition that a magnified observation target sample mass having a size equal to or larger than the predetermined size has been recognized in the sample mass discrimination processing, coordinates of a center of the magnified observation target sample mass are detected.

### Claim 24

An observation system comprising:
an overall observation portion including
an illuminator which shines light on a sample inside a container containing the sample and a solution and
an optical system which guides light for observation of the sample,
the overall observation portion taking an image of the sample through taking an image of the entire container;
a time keeping portion which counts days and hours from a start of observation of the sample;
a data processing portion which repeats discrimination of a sample mass, which is a mass of a plurality of pieces of the sample, every predetermined period counted by the time keeping portion with respect to sample mass discrimination until a sample mass having a size equal to or larger than a predetermined size is recognized from the image taken by the overall observation portion, the data processing portion detecting coordinates of a center of the recognized sample mass having a size equal to or larger than the predetermined size;
a magnified observation portion including
an illuminator which shines light on the sample inside the container and
an optical system which guides light for observation of the sample,
the magnified observation portion taking an image of the sample mass on a magnified scale about, as a center, the coordinates detected by the data processing portion; and
a setting portion which sets
a sample mass discrimination repetition deadline until which the data processing portion recognizes the sample mass having a size equal to or larger than the predetermined size,
timing with which the magnified observation portion takes the image, and
an observation deadline until which the sample is observed.

### Claim 25

An observation program for making a computer execute processing, the processing comprising:
overall image sensing processing for taking an image of a sample through taking of a container containing the sample and a solution;
sample mass discrimination processing for discriminating from the image taken in the overall image sensing processing a sample mass, which is a mass of a plurality of pieces of the sample;
coordinate detection processing for detecting coordinates of a center of the sample mass discriminated in the sample mass discrimination processing; and
magnified image sensing processing for taking an image of the sample mass on a magnified scale about, as a center, the coordinates detected in the coordinate detection processing, wherein
in the sample mass discrimination processing, when the discriminated sample mass has a figure with a predetermined roundness, or when a ratio of a major axis length to a minor axis length of an ellipse surrounding a contour of the discriminated sample mass is equal to or less than a predetermined threshold value, the discriminated sample mass is found to have a predetermined figure, and
in the coordinate detection processing, on condition that the sample mass has been found to have the predetermined figure in the sample mass discrimination processing, the coordinates of the center of the sample mass are detected.

### Claim 26 (depends on 25)

The observation program according to claim 25, wherein
in the coordinate detection processing, arbitrary coordinates are detected on condition that the sample mass has been found not to have the predetermined figure in the sample mass discrimination processing.

### Claim 27 (depends on 25)

The observation program according to claim 25, wherein the processing further comprises time keeping processing for counting days and hours from a start of observation of the sample, wherein
in the sample mass discrimination processing, the discrimination is repeated every predetermined period counted in the time keeping processing with respect to sample mass discrimination until the sample mass having the predetermined figure is recognized, and the discrimination is stopped on condition that a predetermined number of days have elapsed.

### Claim 28

An observation system comprising:
an overall observation portion including
an illuminator which shines light on a sample inside a container containing the sample and a solution and
an optical system which guides light for observation of the sample,
the overall observation portion taking an image of the sample through taking an image of the entire container;
a time keeping portion which counts days and hours from a start of observation of the sample;
a data processing portion which repeats discrimination of a sample mass, which is a mass of a plurality of pieces of the sample, every predetermined period counted by the time keeping portion with respect to sample mass discrimination until a sample mass having a predetermined figure is recognized from the image taken by the overall observation portion, the data processing portion detecting coordinates of a center of the recognized sample mass having the predetermined figure;
a magnified observation portion including
an illuminator which shines light on the sample inside the container and
an optical system which guides light for observation of the sample,
the magnified observation portion taking an image of the sample mass on a magnified scale about, as a center, the coordinates detected by the data processing portion; and
a setting portion which sets
a sample mass discrimination repetition deadline until which the data processing portion recognizes the sample mass having the predetermined figure,
timing with which the magnified observation portion takes the image, and
an observation deadline until which the sample is observed.

### Claim 29 (depends on 23)

The observation program according to claim 23,
wherein, in the coordinate detection processing, arbitrary coordinates are detected on condition that no magnified observation target sample mass has been recognized in the sample mass discrimination processing

### Claim 30 (depends on 24)

The observation system according to claim 24,
wherein the data processing portion detects arbitrary coordinates on condition that no magnified observation target sample mass has been recognized

### Claim 31

An observation program for making a computer execute processing, the processing comprising:
overall image sensing processing for taking an image of a sample through taking of a container containing the sample and a solution;
sample mass discrimination processing for discriminating from the image taken in the overall image sensing processing a sample mass, which is a mass of a plurality of pieces of the sample;
coordinate detection processing for detecting coordinates of a center of the sample mass discriminated in the sample mass discrimination processing; and
magnified image sensing processing for taking an image of the sample mass on a magnified scale about, as a center, the coordinates detected in the coordinate detection processing, wherein
in the sample mass discrimination processing, the sample mass is found to have a predetermined figure based on one parameter selected from a group consisting of elasticity of an ellipse surrounding a contour of the sample mass, roundness of a circle surrounding the contour of the sample mass, size of a sample mass, length of the contour of a sample mass, area inside the contour of the sample mass, major axis length of an ellipse surrounding the contour of the sample mass, minor axis length of an ellipse surrounding the contour of the sample mass, circumferential length of an ellipse surrounding the contour of the sample mass, diameter of a circle surrounding the contour of the sample mass, circumferential length of a circle surrounding the contour of the sample mass, length of a rectangular surrounding the contour of the sample mass, area of a rectangular surrounding the contour of the sample mass, ratio of area of the contour of the sample mass to circumferential length thereof, ratio of area of the contour of the sample mass to area of a rectangular surrounding the contour, ratio of length of the contour of the sample mass to length of a rectangular surrounding the contour, number of corners in the contour of the sample mass, ratio of area of the contour of the sample mass to area of a circle or ellipse surrounding the contour, ratio of length of the contour of the sample mass to circumferential length of a circle or ellipse surrounding the contour, ratio of area of a rectangular surrounding the contour of the sample mass to area of a circle or ellipse surrounding the contour, and ratio of length of a rectangular surrounding the contour of the sample mass to length of a circle or ellipse surrounding the contour, and
in the coordinate detection processing, on condition that the sample mass has been found to have the predetermined figure in the sample mass discrimination processing, the coordinates of the center of the sample mass are detected.

### Claim 32

An observation system for observation of growth of cells inside a container containing the cells and a culture fluid, the system comprising:
an overall observation portion provided inside an airtight casing and including
an illuminator which shines light on the cells inside the container and
an optical system which guides light for observation of the cells,
the overall observation portion taking an image of the sample through taking an image of the entire container;
a data processing portion which discriminates from the image taken by the overall observation portion a sample mass, which is a mass of a plurality of pieces of the sample;
a magnified observation portion provided inside the casing and including
an illuminator which shines light on the cells inside the container and
an optical system which guides light for observation of the cells,
the magnified observation portion taking an image of the cells on a magnified scale about, as a center, the coordinates detected by the data processing portion;
a transport portion provided outside the casing, the transport portion holding the container and transporting the container from the overall observation portion to the magnified observation portion or from the magnified observation portion to the overall observation portion; and
a Y-axis drive mechanism provided outside the casing, at a side of the transport portion, at a position higher than the container, the Y-axis drive mechanism driving the transport portion with a motor from the overall observation portion to the magnified observation portion or from the magnified observation portion to the overall observation portion.
