# US 2020/0404196 A1 · Verification system for a pharmacy packaging system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404196 A1
- Document ID: US20200404196A1
- Status: Published application
- Kind: A1
- Application number: 16/999,327
- Filed: 2020-08-21
- Published: 2020-12-24
- Earliest claimed: 2016-09-27
- Assignees: Rxsafe LLC
- Applicants: Rxsafe LLC
- Inventors: William K. Holmes; Aaron Arsenault
- Web page: https://patentgrep.com/patent/US20200404196A1

## CPC

- G07F 11/10: two or more magazines having a common delivery chute
- A61J 1/03: for pills or tablets (containers for pills or tablets with special dispensing means therefor B65D83/04)
- B65B 1/04: Methods of, or means for, filling the material into the containers or receptacles
- B65B 41/12: Feeding webs from rolls
- G06V 10/141: Control of illumination
- G06V 10/143: Sensing or illuminating at different wavelengths
- G06V 20/00: Scenes; Scene-specific elements (control of digital cameras H04N23/60)
- G07F 11/44: in which magazines the articles are stored in bulk
- G07F 17/0092: {for assembling and dispensing of pharmaceutical articles (medical dispensers for private use, A61J7/00)}
- H04N 23/11: for generating image signals from visible and infrared light wavelengths
- H04N 23/56: provided with illuminating means
- H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
- H04N 23/74: by influencing the scene brightness using illuminating means
- A61J 2205/00: General identification or selection means
- G06T 2207/30242: Counting objects in image
- G07F: COIN-FREED OR LIKE APPARATUS (coin sorting G07D3/00; coin testing G07D5/00; {handling coins or paper currencies apart from payment activated apparatus G07D; payment architectures, schemes or protocols G06Q20/00})
- A61J: CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
- B65B: MACHINES, APPARATUS OR DEVICES FOR, OR METHODS OF, PACKAGING ARTICLES OR MATERIALS; UNPACKING (bundling and pressing devices for cigars A24C1/44; devices for tensioning and securing binders adapted to be supported by the article or articles to be bound B25B25/00; applying closure members to bottles, jars or similar containers B67B1/00-B67B6/00; concurrent cleaning, filling and closing of bottles B67C7/00; emptying bottles, jars, cans, casks, barrels or similar containers B67C9/00)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method and verification system for verifying pharmaceuticals packaged within a pouch using a pharmacy packaging system. The method includes activating a first light source to illuminate the pharmaceutical pouch, capturing a first image of the pharmaceutical pouch while illuminated by the first light source, activating a second light source to illuminate the pharmaceutical pouch, and capturing a second image of the pharmaceutical pouch while illuminated by the second light source. The method further includes generating a third image based on the first image and the second image, generating a dashboard to simultaneously display first images, second images, and third images from a plurality of pharmaceutical pouches, providing a number of pills indication of a number of pills detected in the pouch against a number of pills expected in the pouch, and displaying the dashboard.

## Claims

### Claim 1

A pharmacy packaging system comprising:
a feed roll for forming a pharmaceutical pouch;
a dispenser configured to dispense pharmaceuticals into the pharmaceutical pouch formed by the feed roll; and
a verification system including
a camera system configured to capture images in a visible spectrum and an infrared spectrum,
a first light source configured to output infrared spectrum light,
a second light source configured to output visible spectrum light, and
a processor communicatively coupled to the camera system, the first light source, and the second light source, the processor operable to:
activate the first light source to illuminate the pharmaceutical pouch,
capture a first image, using the camera system, of the pharmaceutical pouch while illuminated by the first light source,
activate the second light source to illuminate the pharmaceutical pouch,
capture a second image, using the camera system, of the pharmaceutical pouch while illuminated by the second light source,
generate a third image based on the first image and the second image,
generate a dashboard to simultaneously display first images, second images, and third images from a plurality of pharmaceutical pouches, wherein the first images, the second images, and the third images are arrayed in a grid on the dashboard, and
provide a number of pills indication on the dashboard of a number of pills detected in the pouch against a number of pills expected in the pouch.

### Claim 2 (depends on 1)

The pharmacy packaging system of claim 1, wherein the processor is further operable to:
analyze the third image to determine a first characteristic of pharmaceuticals in the pharmaceutical pouch,
determine whether the first characteristic of pharmaceuticals in the pharmaceutical pouch matches a second characteristic of expected pharmaceuticals,
when the first characteristic of pharmaceuticals in the pharmaceutical pouch matches the second characteristic of expected pharmaceuticals, provide a first indication on the third image that the pharmaceutical pouch is correctly filled, and
when the first characteristic of pharmaceuticals in the pharmaceutical pouch does not match the second characteristic of expected pharmaceuticals, provide a second indication on the third image that the pharmaceutical pouch is incorrectly filled.

### Claim 3 (depends on 2)

The pharmacy packaging system of claim 2, wherein the first indication includes a border around the third image having a first color, and wherein the second indication includes a border around the third image having a second color that is different than the first color.

### Claim 4 (depends on 2)

The pharmacy packaging system of claim 2, wherein the first indication includes a border having a first color around an individual pharmaceutical in the third image, and wherein the second indication includes a border having a second color that is different than the first color around one of a blank space or an individual pharmaceutical in the third image.

### Claim 5 (depends on 2)

The pharmacy packaging system of claim 2, wherein the processor is further configured to:
determine that an individual pharmaceutical in the pharmaceutical pouch does not correspond to an image of an expected pharmaceutical;
receive, at a user interface, a user input to add the image of the individual pharmaceutical to a database storing images of expected pharmaceuticals;
add the image of the individual pharmaceutical to the database in response to receiving the user input; and
re-analyze the images of the dashboard based on the updated database.

### Claim 6 (depends on 2)

The pharmacy packaging system of claim 2, wherein the processor is further operable to:
when the first characteristic of pharmaceuticals in the pharmaceutical pouch matches the second characteristic of expected pharmaceuticals, provide the first indication on one or more of the first image and the second image indicating the pharmaceutical pouch is correctly filled; and
when the first characteristic of pharmaceuticals in the pharmaceutical pouch does not match the second characteristic of expected pharmaceuticals, provide the second indication on one or more of the first image and the second image indicating that the pharmaceutical pouch is incorrectly filled.

### Claim 7 (depends on 8)

The pharmacy packaging system of claim 8, wherein the first indication includes a border around one or more of the first image and the second image having a first color, and wherein the second indication includes a border around one or more of the first image and the second image having a second color that is different than the first color.

### Claim 8 (depends on 1)

The pharmacy packaging system of claim 1, wherein the number of pills indication is provided on one or more of the first images and the second images.

### Claim 9 (depends on 1)

The pharmacy packaging system of claim 1, wherein the dashboard further includes images of expected pills, wherein the third image includes individual pharmaceuticals arranged in rows or columns, and wherein the third image is displayed such that the individual pharmaceuticals in the third image align with individual pharmaceuticals in the images of expected pills.

### Claim 10 (depends on 9)

The pharmacy packaging system of claim 9, wherein the third image includes a blank space that indicates where a correct pill should have been displayed, and wherein the third image includes a border around the blank space having a color to indicate that the expected pill is missing from the pharmaceutical pouch.

### Claim 11

A method of verifying pharmaceuticals packaged within a pharmaceutical pouch using a pharmacy packaging system, the pharmacy packaging system including a feed roll for forming the pharmaceutical pouch, a dispenser configured to dispense pharmaceuticals into the pharmaceutical pouch formed by the feed roll, a camera system configured to capture images in a visible spectrum and an infrared spectrum, a first light source configured to output an infrared spectrum light, a second light source configured to output a visible spectrum light, and a processor communicatively coupled to the camera system, the first light source, and the second light source, the method comprising:
activating, by the processor, the first light source to illuminate the pharmaceutical pouch;
capturing a first image, by the processor using the camera system, of the pharmaceutical pouch while illuminated by the first light source;
activating, by the processor, the second light source to illuminate the pharmaceutical pouch;
capturing a second image, by the processor using the camera system, of the pharmaceutical pouch while illuminated by the second light source;
generating, by the processor, a third image based on the first image and the second image;
generating, by the processor, a dashboard to simultaneously display first images, second images, and third images from a plurality of pharmaceutical pouches, wherein the first images, the second images, and the third images are arrayed in a grid on the dashboard;
providing a number of pills indication on the dashboard of a number of pills detected in the pouch against a number of pills expected in the pouch; and
displaying the dashboard.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
analyzing the third image to determine a first characteristic of pharmaceuticals in the pharmaceutical pouch,
determining whether the first characteristic of pharmaceuticals in the pharmaceutical pouch matches a second characteristic of expected pharmaceuticals,
when the first characteristic of pharmaceuticals in the pharmaceutical pouch matches the second characteristic of expected pharmaceuticals, providing a first indication on the third image that the pharmaceutical pouch is correctly filled, and
when the first characteristic of pharmaceuticals in the pharmaceutical pouch does not match the second characteristic of expected pharmaceuticals, providing a second indication on the third image that the pharmaceutical pouch is incorrectly filled.

### Claim 13 (depends on 12)

The method of claim 12, wherein the first indication includes a border around the third image having a first color, and wherein the second indication includes a border around the third image having a second color that is different than the first color.

### Claim 14 (depends on 12)

The method of claim 12, wherein the first indication includes a border having a first color around an individual pharmaceutical in the third image, and wherein the second indication includes a border having a second color that is different than the first color around one of a blank space or an individual pharmaceutical in the third image.

### Claim 15 (depends on 12)

The method of claim 12, further comprising:
determining, using the processor, that an individual pharmaceutical in the pharmaceutical pouch does not correspond to an image of an expected pharmaceutical;
receiving, at a user interface, a user input to add the image of the individual pharmaceutical to a database storing images of expected pharmaceuticals;
adding, using the processor, the image of the individual pharmaceutical to the database in response to receiving the user input; and
re-analyzing, using the processor, the images of the dashboard based on the updated database.

### Claim 16 (depends on 12)

The method of claim 12, further comprising:
when the first characteristic of pharmaceuticals in the pharmaceutical pouch matches the second characteristic of expected pharmaceuticals, providing the first indication on one or more of the first image and the second image indicating that the pharmaceutical pouch is correctly filled; and
when the first characteristic of pharmaceuticals in the pharmaceutical pouch does not match the second characteristic of expected pharmaceuticals, providing the second indication on one or more of the first image and the second image indicating that the pharmaceutical pouch is incorrectly filled.

### Claim 17 (depends on 16)

The method of claim 16, wherein the first indication includes a border around one or more of the first image and the second image having a first color, and wherein the second indication includes a border around one or more of the first image and the second image having a second color that is different than the first color.

### Claim 18 (depends on 11)

The method of claim 11, wherein the number of pills indication is provided on one or more of the first images and the second images.

### Claim 19 (depends on 11)

The method of claim 11, wherein the dashboard further includes images of expected pills, wherein the third image includes individual pharmaceuticals arranged in rows or columns, and wherein the third image is displayed such that the individual pharmaceuticals in the third image align with individual pharmaceuticals in the images of expected pills.

### Claim 20 (depends on 19)

The method of claim 19, wherein the third image includes a blank space that indicates where a correct pill should have been displayed, and wherein the third image includes a border around the blank space having a color to indicate that the expected pill is missing from the pharmaceutical pouch.
