Methods and systems for image processing to present data in augmented reality

A method comprising:

• identifying a unique identifier on a label of a prescription pill bottle or a prescription drug container using a live stream of images generated by a camera;
• requesting additional data from a pharmacy benefit manager using the unique identifier;
• displaying interactive portions and the additional data from the pharmacy benefit manager in an augmented reality foreground image that is displayed over the live stream of images generated by the camera such that the additional data is displayed adjacent to the prescription pill bottle or prescription drug container, the interactive portions configured to be displayed including (i) a request to refill a prescription drug, (ii) identification of a doctor that prescribed the prescription drug, and (iii) drug interaction data about the prescription drug;
• detecting a user selection of one or more of the interactive portions in the augmented reality foreground image;
• and
• implementing an action responsive to detecting the user selection, the action that is implemented including one or more of transmitting a request to refill the prescription drug, calling the doctor that previously prescribed the prescription drug, or directing the display to present the drug interaction data about the prescription drug,
• wherein the prescription drug is a first prescription drug, and the drug interaction data includes at least one of a negative interaction, a positive interaction, or a benign interaction between one or more of (a) the first prescription drug and a second prescription drug, (b) the first prescription drug and an over-the-counter drug, (c) the first prescription drug and a vitamin, (d) the first prescription drug and a medical herb, or (e) the first prescription drug and alcohol.

A system comprising:

• one or more processors communicatively coupled to a camera and a display, the one or more processors configured to:
• identify a prescription drug container in real-time images generated by the camera;
• de-warp at least one of the real-time images to identify a unique identifier on a label of the prescription drug container;
• and
• request additional data from a pharmacy benefit manager using the unique identifier;
• and
• an augmented reality subsystem communicatively coupled to the one or more processors, the augmented reality subsystem configured to:
• direct the display to present interactive portions and the additional data from the pharmacy benefit manager in an augmented reality foreground image that is displayed over the real-time images generated by the camera, the interactive portions and the additional data including (i) a request to refill a prescription drug, (ii) identification of a doctor that prescribed the prescription drug, and (iii) drug interaction data about the prescription drug;
• and
• responsive to detecting a user selection of one or more of the interactive portions in the augmented reality foreground image, implement an action that includes one or more of transmitting a request to refill the prescription drug, calling the doctor that previously prescribed the prescription drug, or directing the display to present the drug interaction data about the prescription drug,
• wherein the prescription drug is a first prescription drug, and the drug interaction data includes at least one of a negative interaction, a positive interaction, or a benign interaction between one or more of (a) the first prescription drug and a second prescription drug, (b) the first prescription drug and an over-the-counter drug, (c) the first prescription drug and a vitamin, (d) the first prescription drug and a medical herb, or (e) the first prescription drug and alcohol.