# US 2019/0376955 A1 · Information processing apparatus, observation system, information processing method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0376955 A1
- Document ID: US20190376955A1
- Status: Published application
- Kind: A1
- Application number: 16/463,522
- Filed: 2017-10-20
- Published: 2019-12-12
- Earliest claimed: 2016-11-30
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Masataka Shinoda; Tomoya Onuma
- Web page: https://patentgrep.com/patent/US20190376955A1

## CPC

- G06T 7/0012: {Biomedical image inspection}
- G16H 40/67: for remote operation
- C12M 1/34: Measuring or testing with condition measuring or sensing means, e.g. colony counters
- G02B 21/00: Microscopes
- G06T 7/00: Image analysis
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- C12M: APPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; {APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

[Object] Provided are an information processing apparatus, an observation system, an information processing method, and a program, which are suitable for evaluating a fertilized ovum with a high accuracy. [Solving Means] An information processing apparatus includes an image obtaining unit, an evaluation unit, and an image capturing controller unit. The image obtaining unit obtains an image of a cell, the image being captured by an image capturing unit. The evaluation unit evaluates a growth stage of the cell. The image capturing controller unit allows the image capturing unit to capture an image of the rotated cell, according to an evaluation result of the evaluation unit.

## Claims

### Claim 1

An information processing apparatus, comprising:
an image obtaining unit that obtains an image of a cell, the image being captured by an image capturing unit;
an evaluation unit that evaluates a growth stage of the cell; and
an image capturing controller unit that allows the image capturing unit to capture an image of the rotated cell, according to an evaluation result of the evaluation unit.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, further comprising
a rotation controller unit that controls a rotation mechanism that rotates the cell, according to the evaluation result of the evaluation unit.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein
the evaluation unit evaluates the growth stage of the cell on a basis of the image obtained by the image obtaining unit.

### Claim 4 (depends on 2)

The information processing apparatus according to claim 2, wherein
the evaluation unit evaluates the growth stage of the cell on a basis of a culture time of the cell.

### Claim 5 (depends on 3)

The information processing apparatus according to claim 3, wherein
when the evaluation unit evaluates that the cell is in a growth stage in which the cell has an asymmetric shape, the image capturing controller unit allows the image capturing unit to capture the image of the rotated cell.

### Claim 6 (depends on 5)

The information processing apparatus according to claim 5, wherein
the growth stage in which the cell has the asymmetric shape is a growth stage of a blastocyst.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6, wherein
the growth stage of the blastocyst is a growth stage after a complete blastocyst.

### Claim 8 (depends on 7)

The information processing apparatus according to claim 7, wherein
the cell is a cell in the growth stage of the blastocyst having an inner cell mass, and
the evaluation unit sorts the captured image of the rotated cell, according to an image capturing direction based on a position of the inner cell mass in the cell.

### Claim 9 (depends on 8)

The information processing apparatus according to claim 8, further comprising
a storage unit that stores the image of the cell, the image being obtained by the image obtaining unit, wherein
the storage unit stores in advance a first feature amount of the cell in each growth stage, and
the evaluation unit extracts a second feature amount of the image of the cell, the image being obtained by the image obtaining unit, and evaluates the growth stage of the cell on a basis of the first feature amount and the second feature amount.

### Claim 10 (depends on 9)

The information processing apparatus according to claim 9, wherein
the storage unit stores the arbitrarily selected cell as a supervised index.

### Claim 11 (depends on 10)

The information processing apparatus according to claim 10, wherein
the image capturing controller unit controls the image capturing unit such that the image capturing unit captures images of the plurality of cells, and
the image capturing controller unit controls the image capturing unit such that the number of times of image capturing of the cell that is set as the supervised index is more than the number of times of image capturing of the cell that is not set as the supervised index.

### Claim 12 (depends on 9)

The information processing apparatus according to claim 9, wherein
the image capturing controller unit controls the image capturing unit such that the image capturing unit captures images of the plurality of cells, and
the evaluation unit sets images of a part of cells in the plurality of cells, as a supervised image, and images of other cells in the plurality of cells, as a test image, and verifies the supervised image by using the test image.

### Claim 13

An observation system, comprising:
a culture vessel including a plurality of accommodation units in which a cell is accommodated;
an image capturing unit that captures an image of the cell;
an image obtaining unit that obtains the image of the cell, the image being captured by the image capturing unit;
an evaluation unit that evaluates a growth stage of the cell;
a rotation mechanism that rotates the cell in the accommodation unit, according to an evaluation result of the growth stage of the cell of the evaluation unit; and
an image capturing controller unit that controls the image capturing unit such that the image capturing unit captures an image of the cell rotated by the rotation mechanism.

### Claim 14 (depends on 13)

The observation system according to claim 13, wherein
the rotation mechanism is a vibration apparatus that vibrates the culture vessel.

### Claim 15 (depends on 13)

The observation system according to claim 13, wherein
the accommodation unit is capable of accommodating the cell and a liquid,
the culture vessel includes the rotation mechanism, and
the rotation mechanism rotates the cell by generating a flow in the liquid in the accommodation unit.

### Claim 16

An information processing method, comprising:
evaluating a growth stage of a cell; and
capturing an image of the rotated cell when it is evaluated that the cell is in a growth stage in which the cell has an asymmetric shape.

### Claim 17

A program causing an information processing apparatus to execute:
a step of evaluating a growth stage of a cell; and
a step of capturing an image of the rotated cell when it is evaluated that the cell is in a growth stage in which the cell has an asymmetric shape.
