# US 2020/0394786 A1 · Medicine verification device and boundary recess detection method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394786 A1
- Document ID: US20200394786A1
- Status: Published application
- Kind: A1
- Application number: 17/006,414
- Filed: 2020-08-28
- Published: 2020-12-17
- Earliest claimed: 2018-03-26
- Assignees: FUJIFILM Toyama Chemical Co., Ltd.
- Applicants: FUJIFILM Toyama Chemical Co., Ltd.
- Inventors: Koji YOKOUCHI; Kazuchika IWAMI
- Web page: https://patentgrep.com/patent/US20200394786A1

## CPC

- G06T 7/0004: {Industrial image inspection}
- A61J 7/0076: {Medicament distribution means (with pill counting devices A61J7/02; with time indication A61J7/04; containers or packages with special means for dispensing contents B65D83/00)}
- B65B 57/14: and operating to control, or stop, the feed of articles or material to be packaged
- G01N 21/9508: {Capsules; Tablets}
- G06Q 50/04: Manufacturing
- G06T 7/586: from multiple light sources, e.g. photometric stereo
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- G06V 10/141: Control of illumination
- G16H 20/13: delivered from dispensers
- B65B 9/06: Enclosing successive articles, or quantities of material, in a longitudinally-folded web, or in a web folded into a tube about the articles or quantities of material placed upon it
- B65B 9/087: the web advancing continuously
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/10152: Varying illumination
- G16H 20/10: relating to drugs or medications, e.g. for ensuring correct administration to patients
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- Y02P 90/30: Computing systems specially adapted for manufacturing
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A61J: CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
- B65B: MACHINES, APPARATUS OR DEVICES FOR, OR METHODS OF, PACKAGING ARTICLES OR MATERIALS; UNPACKING (bundling and pressing devices for cigars A24C1/44; devices for tensioning and securing binders adapted to be supported by the article or articles to be bound B25B25/00; applying closure members to bottles, jars or similar containers B67B1/00-B67B6/00; concurrent cleaning, filling and closing of bottles B67C7/00; emptying bottles, jars, cans, casks, barrels or similar containers B67C9/00)
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- Y02P: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS

## Abstract

A medicine verification device of the present invention includes: a detection unit that detects a boundary recess formed at a boundary position between a plurality of packaging bags each of which packs a medicine and is connected to form a continuous packaging bag having a strip-like shape; and an image capturing unit that captures an image of a surface of an imaging target portion on which at least the boundary recess is located a plurality of times while imaging conditions are changed in a state where light is emitted toward the surface of the imaging target portion in the continuous packaging bag, wherein the detection unit detects the boundary recess in the imaging target portion on the basis of the plurality of images captured while changing the imaging conditions by the image capturing unit.

## Claims

### Claim 1

A medicine verification device comprising:
a detection unit that detects a boundary recess formed at a boundary position between a plurality of packaging bags each of which packs a medicine and is connected to form a continuous packaging bag having a strip-like shape; and
an image capturing unit that captures an image of a surface of an imaging target portion on which at least the boundary recess is located a plurality of times while imaging conditions are changed in a state where light is emitted toward the surface of the imaging target portion in the continuous packaging bag,
wherein the detection unit detects the boundary recess in the imaging target portion on the basis of the plurality of images captured while changing the imaging conditions by the image capturing unit.

### Claim 2 (depends on 1)

The medicine verification device according to claim 1, further comprising
a light irradiation unit that emits light toward the surface of the imaging target portion when the image capturing unit captures an image,
wherein the light irradiation unit includes a first light emitting unit and a second light emitting unit that emit light in mutually opposite directions in a longitudinal direction of the continuous packaging bag and emits light diagonally toward the surface of the imaging target portion,
the image capturing unit captures an image in a state where the capturing target portion is located between the first light emitting unit and the second light emitting unit in the longitudinal direction, and
the light irradiation unit changes a light emitting unit used at the time of light emission out of the first light emitting unit and the second light emitting unit when changing the imaging conditions.

### Claim 3 (depends on 2)

The medicine verification device according to claim 2,
wherein the image capturing unit captures a first image of the surface of the imaging target portion while the light irradiation unit emits light toward the surface of the imaging target portion using the first light emitting unit and captures a second image of the surface of the imaging target portion while the light irradiation unit emits light toward the surface of the imaging target portion using the second light emitting unit, and
the detection unit detects the boundary recess in the imaging target portion using the first image and the second image.

### Claim 4 (depends on 3)

The medicine verification device according to claim 3,
wherein the light emission of the second light emitting unit is stopped during the light emission performed by the light irradiation unit toward the surface of the imaging target portion using the first light emitting unit, and
the light emission of the first light emitting unit is stopped during the light emission performed by the light irradiation unit toward the surface of the imaging target portion using the second light emitting unit.

### Claim 5 (depends on 4)

The medicine verification device according to claim 4, wherein the detection unit combines a portion in the first image including an image of a region on a side farther from the first light emitting unit out of the imaging target portion and a portion in the second image including an image of a region on a side farther from the second light emitting unit out of the imaging target portion to create a combined image, and the detection unit detects the boundary recess in the imaging target portion on the basis of the combined image.

### Claim 6 (depends on 1)

The medicine verification device according to claim 1,
wherein the image capturing unit includes a first camera and a second camera that images the imaging target portion from mutually opposite directions in a thickness direction of the continuous packaging bag,
the first camera captures an image of one surface of the imaging target portion in the thickness direction,
the second camera captures an image of another surface of the imaging target portion located on the opposite side to the one surface in the thickness direction, and
the detection unit detects the boundary recess in the imaging target portion on the basis of an image captured by the first camera and an image captured by the second camera.

### Claim 7 (depends on 6)

The medicine verification device according to claim 6, wherein the detection unit specifies a candidate for the boundary recess appearing in the image captured by the first camera and specifies a candidate for the boundary recess appearing in the image captured by the second camera, and thereafter, the detection unit detects the candidate for the boundary recess appearing in both the image captured by the first camera and the image captured by the second camera, as the boundary recess in the imaging target portion.

### Claim 8 (depends on 1)

The medicine verification device according to claim 1,
wherein a medicine is packaged in the packaging bag of the continuous packaging bag, and
the image capturing unit captures an image of a surface of the imaging target portion in which at least an end of the packaging bag in which the medicine is packaged and the boundary recess adjacent to the end are located, a plurality of times while changing the imaging conditions.

### Claim 9 (depends on 8)

The medicine verification device according to claim 8,
wherein the packaging bag is light transmissive,
the image capturing unit captures an image of a surface of the imaging target portion in which at least a portion covering the medicine, the end, and the boundary recess adjacent to the end are located, out of the packaging bag in which the medicine is packaged, a plurality of times while changing the imaging conditions, and
the medicine verification device further comprises a removal process execution unit that performs, on each of the plurality of images captured under different imaging conditions, a removal process for removing an image of a medicine in each of the plurality of images.

### Claim 10 (depends on 9)

The medicine verification device according to claim 9, wherein the removal process execution unit executes the removal process of removing the image of the medicine in the image by removing a post-contraction-dilation image obtained by applying contraction and dilation on a pixel group constituting the image captured by the image capturing unit in at least one direction from an image before application of the contraction and dilation.

### Claim 11 (depends on 1)

The medicine verification device according to claim 1, wherein the boundary recess is a cutout line formed by a dashed linear groove formed from one end to the other end of the continuous packaging bag in a lateral width direction of the continuous packaging bag.

### Claim 12

A boundary recess detection method being a method of detecting a boundary recess formed at a boundary position between a plurality of packaging bags each of which packs a medicine and is connected to form a continuous packaging bag having a strip-like shape, the method comprising:
a step of capturing an image of a surface of an imaging target portion on which at least the boundary recess is located a plurality of times while imaging conditions are changed in a state where light is emitted toward the surface of the imaging target portion in the continuous packaging bag; and
a step of detecting the boundary recess in the imaging target portion on the basis of the plurality of images captured while changing the imaging conditions.

### Claim 13 (depends on 2)

The medicine verification device according to claim 2,
wherein a medicine is packaged in the packaging bag of the continuous packaging bag, and
the image capturing unit captures an image of a surface of the imaging target portion in which at least an end of the packaging bag in which the medicine is packaged and the boundary recess adjacent to the end are located, a plurality of times while changing the imaging conditions.

### Claim 14 (depends on 3)

The medicine verification device according to claim 3,
wherein a medicine is packaged in the packaging bag of the continuous packaging bag, and
the image capturing unit captures an image of a surface of the imaging target portion in which at least an end of the packaging bag in which the medicine is packaged and the boundary recess adjacent to the end are located, a plurality of times while changing the imaging conditions.

### Claim 15 (depends on 4)

The medicine verification device according to claim 4,
wherein a medicine is packaged in the packaging bag of the continuous packaging bag, and
the image capturing unit captures an image of a surface of the imaging target portion in which at least an end of the packaging bag in which the medicine is packaged and the boundary recess adjacent to the end are located, a plurality of times while changing the imaging conditions.

### Claim 16 (depends on 5)

The medicine verification device according to claim 5,
wherein a medicine is packaged in the packaging bag of the continuous packaging bag, and
the image capturing unit captures an image of a surface of the imaging target portion in which at least an end of the packaging bag in which the medicine is packaged and the boundary recess adjacent to the end are located, a plurality of times while changing the imaging conditions.

### Claim 17 (depends on 6)

The medicine verification device according to claim 6,
wherein a medicine is packaged in the packaging bag of the continuous packaging bag, and
the image capturing unit captures an image of a surface of the imaging target portion in which at least an end of the packaging bag in which the medicine is packaged and the boundary recess adjacent to the end are located, a plurality of times while changing the imaging conditions.

### Claim 18 (depends on 7)

The medicine verification device according to claim 7,
wherein a medicine is packaged in the packaging bag of the continuous packaging bag, and
the image capturing unit captures an image of a surface of the imaging target portion in which at least an end of the packaging bag in which the medicine is packaged and the boundary recess adjacent to the end are located, a plurality of times while changing the imaging conditions.
