# US 2021/0082584 A1 · Drug inspection apparatus and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0082584 A1
- Document ID: US20210082584A1
- Status: Published application
- Kind: A1
- Application number: 17/106,381
- Filed: 2020-11-30
- Published: 2021-03-18
- Earliest claimed: 2012-09-27
- Assignees: FUJIFILM Toyama Chemical Co., Ltd.
- Applicants: Fujifilm Toyama Chemical Co., Ltd.
- Inventors: Makoto YONAHA; Tetsuya TAKAMORI; Ippei TAKAHASHI; Seigo SUGIMOTO
- Web page: https://patentgrep.com/patent/US20210082584A1

## CPC

- G16H 70/40: relating to drugs, e.g. their side effects or intended usage
- G06T 7/001: {using an image reference approach}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 20/66: Trinkets, e.g. shirt buttons or jewellery items (recognising microscopic objects G06V20/69)
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 20/13: delivered from dispensers
- G06T 2207/30242: Counting objects in image
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 2201/06: Recognition of objects for industrial automation
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A drug inspection apparatus inspects drugs that are prepared based on prescription information and are packaged in a prescription bag. A drug database includes drug images of drugs that can be prepared. A comparison target selection section acquires drug images of drugs, which are prepared according to the prescription, and drugs similar thereto from the drug database. A first drug determination section compares captured images of prepared drugs with the drug images acquired from the drug database, and determines drugs present in the captured images and the number thereof. An inspection result determination section determines whether or not the prepared drugs and the number thereof match the prescription information based on the prescription information.

## Claims

### Claim 1

A drug inspection apparatus for inspecting drugs that are prepared based on prescription information and are packaged in a prescription bag, comprising:
a processor configured to
acquire drug images of only drugs that should be prepared according to prescription information from a drug database that stores drug images of drugs that can be prepared and only drugs similar to the drugs that should be prepared according to the prescription information from the drug database;
extract partial images from a captured image obtained by capturing an image of the prepared drugs packaged in the prescription bag, the partial images including an image of each of the prepared drugs;
determine a drug of the drug images acquired from the drug database, which has a closest feature amount to a feature amount extracted from the partial image, as the drug of the partial image by comparing the feature amount extracted from the partial image with a feature amount extracted from each of the drug images acquired from the drug database;
obtain an inspection result indicating whether or not the prepared drugs and the number thereof in the captured image match the prescription information by determining whether or not the determined drugs match the drugs that should be prepared according to the prescription information; and
output the inspection result to a display unit.

### Claim 2 (depends on 1)

The drug inspection apparatus according to claim 1,
wherein, when the processor determines that the prepared drugs and the number thereof match the prescription information, printing for indicating that the inspection result is OK is performed on a prescription bag corresponding to drugs determined to match the prescription information.

### Claim 3 (depends on 2)

The drug inspection apparatus according to claim 2,
wherein, when the processor determines that the prepared drugs and the number thereof do not match the prescription information, printing for indicating that the inspection result is NG is performed on a prescription bag corresponding to drugs determined not to match the prescription information using ink that cannot be visually recognized under visible light.

### Claim 4 (depends on 1)

The drug inspection apparatus according to claim 1,
wherein, when the processor determines that the prepared drugs and the number thereof do not match the prescription information, the captured image and a drug image from the drug database are displayed to prompt a user to input a checking result.

### Claim 5 (depends on 1)

The drug inspection apparatus according to claim 1,
wherein a list of drugs similar to each drug is stored in the drug database, and the processor acquires the drug images of the drugs similar to the prepared drugs with reference to the list of similar drugs.

### Claim 6 (depends on 1)

The drug inspection apparatus according to claim 1, further comprising:
a database registration section configured to prompt a user to designate a partial image of each prepared drug included in the captured image and additionally registering the designated partial image in the drug database when there is no drug image of the prepared drugs in the drug database.

### Claim 7 (depends on 1)

The drug inspection apparatus according to claim 1, further comprising:
a database registration section configured to acquire drug images of the prepared drugs by accessing a remote master database when there is no drug image of the prepared drugs in the drug database.

### Claim 8

A drug inspection method for inspecting drugs that are prepared based on prescription information and are packaged in a prescription bag using a drug inspection apparatus, the method comprising:
acquiring drug images of only drugs that should be prepared according to prescription information from a drug database that stores drug images of drugs that can be prepared and only drugs similar to the drugs that should be prepared according to the prescription information from the drug database;
extracting partial images from a captured image obtained by capturing an image of the prepared drugs packaged in the prescription bag, the partial images including an image of each of the prepared drugs;
determining a drug of the drug images acquired from the drug database, which has a closest feature amount to a feature amount extracted from the partial image, as the drug of the partial image by comparing the feature amount extracted from the partial image with a feature amount extracted from each of the drug images acquired from the drug database;
obtaining an inspection result indicating whether or not the prepared drugs and the number thereof in the captured image match the prescription information by determining whether or not the determined drugs match the drugs that should be prepared according to the prescription information; and
outputting the inspection result to a display unit.

### Claim 9 (depends on 8)

The drug inspection apparatus according to claim 8,
wherein, when the processor determines that the prepared drugs and the number thereof match the prescription information, printing for indicating that the inspection result is OK is performed on a prescription bag corresponding to drugs determined to match the prescription information.

### Claim 10 (depends on 9)

The drug inspection apparatus according to claim 9,
wherein, when the processor determines that the prepared drugs and the number thereof do not match the prescription information, printing for indicating that the inspection result is NG is performed on a prescription bag corresponding to drugs determined not to match the prescription information using ink that cannot be visually recognized under visible light.

### Claim 11 (depends on 8)

The drug inspection apparatus according to claim 8,
wherein, when the processor determines that the prepared drugs and the number thereof do not match the prescription information, the captured image and a drug image from the drug database are displayed to prompt a user to input a checking result.

### Claim 12 (depends on 8)

The drug inspection apparatus according to claim 8, further comprising:
a database registration section configured to prompt a user to designate a partial image of each prepared drug included in the captured image and additionally registering the designated partial image in the drug database when there is no drug image of the prepared drugs in the drug database.

### Claim 13 (depends on 8)

The drug inspection apparatus according to claim 8, further comprising:
a database registration section configured to acquire drug images of the prepared drugs by accessing a remote master database when there is no drug image of the prepared drugs in the drug database.

### Claim 14

A computer-readable medium, storing a set of instructions, executable by a processor, to perform a drug inspection method for inspecting drugs that are prepared based on prescription information and are packaged in a prescription bag using a drug inspection apparatus, the processor configured to:
acquire drug images of only drugs that should be prepared according to prescription information from a drug database that stores drug images of drugs that can be prepared and only drugs similar to the drugs that should be prepared according to the prescription information from the drug database;
extract partial images from a captured image obtained by capturing an image of the prepared drugs packaged in the prescription bag, the partial images including an image of each of the prepared drugs;
determine a drug of the drug images acquired from the drug database, which has a closest feature amount to a feature amount extracted from the partial image, as the drug of the partial image by comparing the feature amount extracted from the partial image with a feature amount extracted from each of the drug images acquired from the drug database;
obtain an inspection result indicating whether or not the prepared drugs and the number thereof in the captured image match the prescription information by determining whether or not the determined drugs match the drugs that should be prepared according to the prescription information; and
output the inspection result to a display unit.

### Claim 15 (depends on 14)

The drug inspection apparatus according to claim 14,
wherein, when the processor determines that the prepared drugs and the number thereof match the prescription information, printing for indicating that the inspection result is OK is performed on a prescription bag corresponding to drugs determined to match the prescription information.

### Claim 16 (depends on 15)

The drug inspection apparatus according to claim 15,
wherein, when the processor determines that the prepared drugs and the number thereof do not match the prescription information, printing for indicating that the inspection result is NG is performed on a prescription bag corresponding to drugs determined not to match the prescription information using ink that cannot be visually recognized under visible light.

### Claim 17 (depends on 14)

The drug inspection apparatus according to claim 14,
wherein, when the processor determines that the prepared drugs and the number thereof do not match the prescription information, the captured image and a drug image from the drug database are displayed to prompt a user to input a checking result.

### Claim 18 (depends on 14)

The drug inspection apparatus according to claim 14, further comprising:
a database registration section configured to prompt a user to designate a partial image of each prepared drug included in the captured image and additionally registering the designated partial image in the drug database when there is no drug image of the prepared drugs in the drug database.

### Claim 19 (depends on 14)

The drug inspection apparatus according to claim 14, further comprising:
a database registration section configured to acquire drug images of the prepared drugs by accessing a remote master database when there is no drug image of the prepared drugs in the drug database.
