# US 2019/0156697 A1 · Multi-camera imaging for iv compounding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0156697 A1
- Document ID: US20190156697A1
- Status: Published application
- Kind: A1
- Application number: 15/865,038
- Filed: 2018-01-08
- Published: 2019-05-23
- Earliest claimed: 2017-11-23
- Assignees: Aesynt Incorporated
- Applicants: Aesynt Incorporated
- Inventors: Giuseppe Trovato; Andrea Schiavinato; Luca Amato
- Web page: https://patentgrep.com/patent/US20190156697A1

## CPC

- G09B 19/003: {Repetitive work cycles; Sequence of movements}
- A61J 1/22: with means for metering the amount of fluid
- A61J 3/002: {Compounding apparatus specially for enteral or parenteral nutritive solutions (bottling liquids B67C)}
- A61M 5/002: {Packages specially adapted therefor, e.g. packages for syringes or needles or kits for diabetics}
- B65C 9/40: Controls; Safety devices
- G01F 25/0092: {for metering by volume}
- G01G 17/00: Apparatus for or methods of weighing material of special form or property (determining weight by measuring volume G01F)
- G06K 7/10722: {Photodetector array or CCD scanning}
- G06K 7/1413: {1D bar codes}
- G06T 7/62: of area, perimeter, diameter or volume
- H04N 23/56: provided with illuminating means
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- A61M 2005/3125: {Display means, e.g. to indicate dose setting}
- A61M 2205/3313: used specific wavelengths
- A61M 2205/3393: by weighing the reservoir
- A61M 2205/587: Lighting arrangements
- A61M 2205/6072: Bar codes
- B65B 3/26: Methods or devices for controlling the quantity of the material fed or filled
- B65C 2009/408: {reading information before printing and applying a label}
- G01F 22/00: Methods or apparatus for measuring volume of fluids or fluent solid material, not otherwise provided for
- G01F 23/20: by measurement of weight, e.g. to determine the level of stored liquefied gas
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 2207/10024: Color image
- G06T 2207/10048: Infrared image
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- A61J: CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
- A61M: DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY (introducing media into or onto the bodies of animals A61D7/00; means for inserting tampons A61F13/26; devices for administering food or medicines orally A61J; containers for collecting, storing or administering blood or medical fluids A61J1/05); DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY (surgery A61B; chemical aspects of surgical articles A61L); DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR {(Electrotherapy, e.g. producing anaesthesia by the use of alternating or intermittent currents A61N1/36021)}
- B65C: LABELLING OR TAGGING MACHINES, APPARATUS, OR PROCESSES (nailing or stapling in general B25C, B27F; applying labels for packaging purposes B65B; labels, name-plates G09F ){(series-printing machines B41L; containers for the storage or transport of packages B65D)}
- G01F: MEASURING VOLUME, VOLUME FLOW, MASS FLOW OR LIQUID LEVEL; METERING BY VOLUME
- G01G: WEIGHING (sorting by weighing B07C5/16)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B65B: MACHINES, APPARATUS OR DEVICES FOR, OR METHODS OF, PACKAGING ARTICLES OR MATERIALS; UNPACKING (bundling and pressing devices for cigars A24C1/44; devices for tensioning and securing binders adapted to be supported by the article or articles to be bound B25B25/00; applying closure members to bottles, jars or similar containers B67B1/00-B67B6/00; concurrent cleaning, filling and closing of bottles B67C7/00; emptying bottles, jars, cans, casks, barrels or similar containers B67C9/00)

## Abstract

Systems and methods for compounding pharmaceuticals, for example for intravenous delivery. The devices include an infrared camera and an infrared light source, and can backlight and photograph items such as syringes in infrared light for enhanced clarity. A visible light camera may also be provided, for example a color digital camera, for documenting other parts of the compounding process. The device may have other sensors, for example a bar code scanner and a weight sensor, for collecting other data about the compounding process. In one example implementation, the device is a compounding assistance device that leads a user of the device through a compounding task using instructions shown on a display. In other implementations, the device may be robotic.

## Claims

### Claim 1

A compounding assistance device, comprising:
a carrier for supporting items, wherein the material of the carrier is not opaque to infrared light;
an infrared digital camera positioned to photograph at least a portion of the carrier from above;
an area light source positioned under the carrier, the area light source configured to generate infrared light and direct the infrared light through the carrier and toward the digital camera;
a display; and
a controller programmed to guide a user of the compounding assistance device through a pharmaceutical compounding task using one or more prompts shown on the display.

### Claim 2 (depends on 1)

The compounding assistance device of claim 1, further comprising a weight sensor on which the carrier rests, the weight sensor configured to produce a signal indicating the weight of the carrier and any items on the carrier.

### Claim 3 (depends on 1)

The compounding assistance device of claim 1, wherein the infrared digital camera is a first digital camera, the compounding assistance device further comprising a second digital camera positioned to photograph at least a portion of the carrier from above, the second digital camera being a visible light camera.

### Claim 4 (depends on 3)

The compounding assistance device of claim 3, wherein the second digital camera is a color digital camera.

### Claim 5 (depends on 3)

The compounding assistance device of claim 3, further comprising a source of visible light associated with the second digital camera and controllable by the controller to emit light during the taking of a photograph using the first digital camera.

### Claim 6 (depends on 1)

The compounding assistance device of claim 1, wherein the area light source under the carrier comprises:
a plurality of infrared light emitting diodes; and
a diffuser.

### Claim 7 (depends on 1)

The compounding assistance device of claim 1, wherein:
the area light source under the carrier comprises a plurality of infrared light emitting diodes; and
the carrier is made of a diffusing material.

### Claim 8 (depends on 1)

The compounding assistance device of claim 1, further comprising a gantry spanning the carrier, wherein the infrared digital camera is mounted on the gantry.

### Claim 9 (depends on 1)

The compounding assistance device of claim 1, further comprising an adhesive label printer, wherein the controller is programmed to, upon completion of the pharmaceutical compounding task, print an adhesive label to be affixed to a container holding the pharmaceutical compounded during the compounding task.

### Claim 10 (depends on 1)

The compounding assistance device of claim 1, further comprising a bar code scanner positioned to read a bar code from an item between the bar code scanner and the carrier.

### Claim 11 (depends on 10)

The compounding assistance device of claim 10, wherein the digital camera is a first digital camera, the compounding assistance device further comprising:
a second digital camera positioned to photograph at least a portion of the carrier from above, the second digital camera being sensitive to visible light; and
a gantry spanning the carrier;
wherein the first and second digital cameras and the bar code scanner are mounted on the gantry.

### Claim 12 (depends on 1)

The compounding assistance device of claim 1, wherein the controller is further programmed to:
analyze a digital photograph of a syringe taken in infrared light by the digital camera; and
estimate an amount of liquid in the syringe based on the analysis of the digital photograph.

### Claim 13 (depends on 1)

The compounding assistance device of claim 1, wherein the carrier defines a groove of a shape and size for receiving a barrel flange of a syringe.

### Claim 14 (depends on 1)

The compounding assistance device of claim 1, wherein the controller is further programmed to:
analyze a digital photograph of a syringe taken in infrared light by the digital camera;
recognize a size of the syringe based on the analysis of the digital photograph; and
annotate the digital photograph of the syringe with volume indications.

### Claim 15

A method of compounding a medication, the method comprising:
receiving a syringe into a viewing area between an infrared area light source and an infrared digital camera;
taking a digital photograph of the syringe in infrared light using the infrared digital camera, such that the syringe is backlit by the infrared area light source; and
storing the digital photograph.

### Claim 16 (depends on 15)

The method of claim 15, further comprising automatically analyzing the digital photograph to compute a volume of liquid in the syringe.

### Claim 17 (depends on 15)

The method of claim 15, further comprising automatically analyzing the digital photograph to ascertain the size and position of the syringe in the digital photograph; and
annotating the digital photograph with volume indications.

### Claim 18 (depends on 15)

The method of claim 15, wherein:
the infrared area light source and the infrared digital camera are comprised in a compounding assistance device; and
receiving the syringe between the infrared area light source and the infrared digital camera comprises receiving the syringe manually from a user of the compounding assistance device.

### Claim 19 (depends on 18)

The method of claim 18, wherein the compounding assistance device comprises a display and a controller, and the method further comprises leading the user of the compounding assistance device through a compounding task using a series of prompts shown on the display.

### Claim 20 (depends on 15)

The method of claim 15, wherein:
the infrared area light source and the infrared digital camera are comprised in a compounding robot;
and receiving the syringe between the infrared area light source and the infrared digital camera comprises receiving the syringe from a robotic mechanism.

### Claim 21 (depends on 15)

The method of claim 15, wherein the digital photograph is a first digital photograph, the method further comprising:
taking a second digital photograph of a container involved in the compounding process using a visible light camera; and
storing the second digital photograph in association with the first digital photograph.

### Claim 22 (depends on 21)

The method of claim 21, wherein taking the second digital photograph comprises taking a color photograph.

### Claim 23

A pharmaceutical compounding device, comprising:
an infrared area light source;
an infrared digital camera;
a viewing area between the infrared area light source and the infrared digital camera; and
a controller programmed to control the infrared area light source and the infrared digital camera to take a photograph of an item in the viewing area such that the item is backlit by the infrared area light source.

### Claim 24 (depends on 23)

The pharmaceutical compounding device of claim 23, wherein:
the pharmaceutical compounding device is a compounding assistance device comprising a display; and
the controller is further programmed to guide a user of the device through a compounding task using prompts shown on the display.

### Claim 25 (depends on 23)

The pharmaceutical compounding device of claim 23, wherein the pharmaceutical compounding device is a compounding robot.

### Claim 26 (depends on 23)

The pharmaceutical compounding device of claim 23, further comprising a visible light camera under the control of the controller.
