# US 12,217,850 B2 · Systems and methods for capturing data from a medical device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,217,850 B2 - Document ID: US12217850B2 - Status: Granted - Kind: B2 - Application number: 17/531,322 - Filed: 2021-11-19 - Published: 2022-03-10 - Granted: 2025-02-04 - Earliest claimed: 2017-06-23 - Assignees: ABIOMED, Inc. - Applicants: ABIOMED, Inc. - Inventors: Alessandro Simone Agnello - Web page: https://patentgrep.com/patent/US12217850B2 ## CPC - G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS - G06V 10/95: {structured as a network, e.g. client-server architectures} - G06V 30/147: {Determination of region of interest} - G06V 30/153: {using recognition of characters or words} - G16H 15/00: ICT specially adapted for medical reports, e.g. generation or transmission thereof - G16H 30/40: for processing medical images, e.g. editing - G16H 40/40: for the management of medical equipment or devices, e.g. scheduling maintenance or upgrades - G16H 40/67: for remote operation - H04L 67/125: involving control of end-device applications over a network - A61M 60/122: Implantable pumps or pumping devices, i.e. the blood being pumped inside the patient's body - G06F 2218/08: Feature extraction - G16H 10/60: for patient-specific data, e.g. for electronic patient records - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - A61M: DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY (introducing media into or onto the bodies of animals A61D7/00; means for inserting tampons A61F13/26; devices for administering food or medicines orally A61J; containers for collecting, storing or administering blood or medical fluids A61J1/05); DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY (surgery A61B; chemical aspects of surgical articles A61L); DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR {(Electrotherapy, e.g. producing anaesthesia by the use of alternating or intermittent currents A61N1/36021)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A method for transferring data from a medical device to a server comprises receiving a video stream from the medical device, capturing an image from the video stream, transmitting the image to the server via a data network, and extracting the data from the image. The image may illustrate and/or represent data over a period of time. The method may also comprise transmitting, from a data module receiving the video stream from the medical device, a signal to a router that indicates that the data module is connected to the network. The method may also comprise transmitting a command to the data module to start capturing the image, transferring the image to the router, broadcasting a signal indicating that the data module has captured the image, receiving the broadcasted signal at the server, and storing the image at the server. ## Claims ### Claim 1 A method comprising: receiving, with a server, a first image, wherein the first image illustrates data from a medical device; masking, with the server, a first plurality of portions of the first image, wherein the first image comprises the first plurality of portions and a second plurality of portions; modifying, with the server, one or more portions of the second plurality of portions by enlarging at least one of the second plurality of portions or separating at least one of the second plurality of portions into two or more portions; generating, with the server, a second image, wherein the second image comprises the one or more modified portions; and extracting, with an optical character recognition (OCR) unit of the server, data from the second image. ### Claim 2 (depends on 1) The method of claim 1, wherein the first image is captured from a video stream from the medical device. ### Claim 3 (depends on 1) The method of claim 1, wherein extracting the data from the second image comprises: extracting, with the OCR unit, first data from a first portion of the second image; determining a validity of the first data by comparing the first data to reference data; and in response to determining that the first data is valid, extracting, with the OCR unit, second data from a second portion of the second image. ### Claim 4 (depends on 3) The method of claim 3, further comprising: in response to determining that the first data is not valid, broadcasting a signal indicating that the first data is not valid; and receiving a third image, wherein the third image illustrates data from the medical device. ### Claim 5 (depends on 1) The method of claim 1, wherein masking the first plurality of portions of the first image comprises: selecting an image mask based on the size of the first image; and occluding the first plurality of portions using the image mask. ### Claim 6 (depends on 1) The method of claim 1, further comprising extracting, with a digital signal processing (DSP) unit, waveform data from a waveform in the second image. ### Claim 7 (depends on 1) The method of claim 1, further comprising: selecting a first pixel from the second image, wherein the first pixel comprises a color; determining the color of the first pixel, wherein the color corresponds to an alarm severity; and determining the alarm severity based on the color of the first pixel. ### Claim 8 (depends on 7) The method of claim 7, further comprising: selecting a second pixel from the second image; and determining the alarm severity based on the first pixel and the second pixel. ### Claim 9 (depends on 1) The method of claim 1, wherein modifying the one or more portions of the second plurality of portions comprises enlarging at least one of the second plurality of portions. ### Claim 10 (depends on 9) The method of claim 9, wherein the medical device is an intravascular blood pump, and wherein the at least one of the second plurality of portions comprises a serial number portion, an alarm portion, a performance level portion, or a flow rate portion. ### Claim 11 (depends on 1) The method of claim 1, wherein modifying the one or more portions of the second plurality of portions comprises separating at least one of the second plurality of portions into two or more portions. ### Claim 12 (depends on 11) The method of claim 11, wherein the medical device is an intravascular blood pump, and wherein the at least one of the second plurality of portions comprises an alarm and serial number portion. ### Claim 13 (depends on 12) The method of claim 12, wherein the alarm and serial number portion is separated into a serial number portion and an alarm portion. ### Claim 14 (depends on 11) The method of claim 11, wherein the medical device is an intravascular blood pump, and wherein the at least one of the second plurality of portions comprises a flow rate portion. ### Claim 15 (depends on 14) The method of claim 14, wherein the flow rate portion is separated into a present flow rate portion, a maximum flow rate portion, and a minimum flow rate portion. ### Claim 16 (depends on 1) The method of claim 1, wherein a position of at least one of the modified portions within the second image is different than a position of a corresponding one of the second plurality of portions within the first image. ### Claim 17 A non-transitory computer readable storage medium having instructions stored thereon that, when executed by one or more processors, cause the one or more processors to: receive a first image, wherein the first image illustrates data from a medical device; mask a first plurality of portions of the first image, wherein the first image comprises the first plurality of portions and a second plurality of portions; modify one or more portions of the second plurality of portions by enlarging at least one of the second plurality of portions or separating at least one of the second plurality of portions into two or more portions; generate a second image, wherein the second image comprises the one or more modified portions; and extract, with an optical character recognition (OCR) unit, data from the second image. ### Claim 18 (depends on 17) The non-transitory computer readable storage medium of claim 17, wherein modifying the one or more portions of the second plurality of portions comprises enlarging at least one of the second plurality of portions. ### Claim 19 (depends on 17) The non-transitory computer readable storage medium of claim 17, wherein modifying the one or more portions of the second plurality of portions comprises separating at least one of the second plurality of portions into two or more portions. ### Claim 20 (depends on 17) The non-transitory computer readable storage medium of claim 17, wherein a position of at least one of the modified portions within the second image is different than a position of a corresponding one of the second plurality of portions within the first image.