# US 8,571,888 B2 · Real-time image analysis for medical savings plans > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,571,888 B2 - Document ID: US8571888B2 - Status: Granted - Kind: B2 - Application number: 13/342,048 - Filed: 2012-01-01 - Published: 2012-09-13 - Granted: 2013-10-29 - Earliest claimed: 2011-03-08 - Assignees: Bank of America Corporation - Applicants: Matthew A. Calman; Erik Stephen Ross; Alfred Hamilton - Inventors: Matthew A. Calman; Erik Stephen Ross; Alfred Hamilton - Web page: https://patentgrep.com/patent/US8571888B2 ## CPC - G06Q 30/06: Buying, selling or leasing transactions - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract In general terms, embodiments of the present invention relate to methods, apparatuses, and computer program products for providing health or flexible spending account information in association with products identified in an augmented reality environment. In some embodiments, a method is provided that includes: (a) receiving information associated with an image, where the image was captured by a mobile device; (b) determining, based at least partially on the information associated with the image, that the image shows a product that qualifies for purchase under a medical savings plan; and (c) presenting, via the mobile device, information that indicates that the product qualifies for purchase under the medical savings plan. ## Claims ### Claim 1 A method implemented by a computing device, wherein the computing device determines whether a product qualifies under a medical savings plan, the method comprising: receiving information associated with an image of the product, wherein the image is part of a real-time video stream captured by a mobile device; determining, via a processor, based at least partially on the information associated with the image, if the image shows a product that qualifies for purchase under the medical savings plan, wherein determining if the image shows a product that qualifies for purchase under the medical savings plan comprises (i) identifying the product based at least partially on the information associated with the image and (ii) determining if the product qualifies for purchase under the medical savings plan by comparing information about the product to information about a known set of products that qualify for purchase under a medical savings plan; displaying the real-time video stream on a display of the mobile device; determining, via a processor, that the real-time video stream being displayed on the display of the mobile device shows the product; and based upon determining that the real-time video stream being displayed on the display of the mobile device shows the product, displaying on the display of the mobile device a graphical indication that the product qualifies for purchase under the medical savings plan, the graphical indication being superimposed over the real-time video stream being displayed on the display of the mobile device. ### Claim 2 (depends on 1) The method of claim 1, wherein determining if the image shows a product that qualifies for purchase under a medical savings plan comprises determining if the product qualifies for purchase under a health savings account or flexible spending account. ### Claim 3 (depends on 1) The method of claim 1, wherein receiving information associated with the image of the product comprises receiving an image of the product. ### Claim 4 (depends on 1) The method of claim 1, further comprising: displaying, on the display of the mobile device, a review of the product. ### Claim 5 (depends on 1) The method of claim 1, further comprising: displaying, on the display of the mobile device, a contraindication of the product. ### Claim 6 (depends on 1) The method of claim 1, further comprising: displaying, on the display of the mobile device, a recommended use of the product. ### Claim 7 (depends on 1) The method of claim 1, further comprising: displaying, on the display of the mobile device, an ingredient of the product. ### Claim 8 (depends on 1) The method of claim 1, further comprising: displaying, on the display of the mobile device, a price of the product. ### Claim 9 (depends on 1) The method of claim 1, further comprising: displaying, on the display of the mobile device, a link to a website where the product can be purchased. ### Claim 10 (depends on 1) The method of claim 1, further comprising: displaying, on the display of the mobile device, a balance of the medical savings plan. ### Claim 11 (depends on 1) The method of claim 1, wherein presenting, via the mobile device, the indication of whether the product qualifies for purchase under the medical savings plan comprises presenting an indication in the image proximate to the product shown in the image. ### Claim 12 (depends on 1) The method of claim 1, wherein presenting, via the mobile device, the indication of whether the product qualifies for purchase under the medical savings plan comprises presenting an indication that can be selected by a user of the mobile device to output information about the product. ### Claim 13 (depends on 1) The method of claim 1, wherein the presenting, via the mobile device, an indication of whether the product qualifies for purchase under the medical savings plan comprises notifying the mobile device that the product qualifies for purchase under the medical savings plan. ### Claim 14 An apparatus for determining whether a product qualifies under a medical savings plan, wherein the apparatus comprises: a communication device; and a processing device communicably coupled to the communication device, wherein the processing device is configured to: receive information associated with an image of the product, wherein the image is part of a real-time video stream captured by a mobile device; determine, based at least partially on the information associated with the image, if the image shows a product that qualifies for purchase under a medical savings plan, wherein determining if the image shows a product that qualifies for purchase under the medical savings plan comprises (i) identifying the product based at least partially on the information associated with the image and (ii) determining if the product qualifies for purchase under the medical savings plan by comparing information about the product to information about a known set of products that qualify for purchase under a medical savings plan; display the real-time video stream on a display of the mobile device; determine that the real-time video stream being displayed on the display of the mobile device shows the product; and based upon determining that the real-time video stream being displayed on the display of the mobile device shows the product, display on the display of the mobile device a graphical indication that the product qualifies for purchase under the medical savings plan, the graphical indication being superimposed over the real-time video stream being displayed on the display of the mobile device. ### Claim 15 (depends on 14) The apparatus of claim 14, wherein the medical savings plan comprises a health savings account or flexible spending account. ### Claim 16 (depends on 14) The apparatus of claim 14, wherein the information associated with the image of the product is an image of the product. ### Claim 17 (depends on 14) The apparatus of claim 14, wherein the processor is further configured to display, on the display of the mobile device, a review of the product. ### Claim 18 (depends on 14) The apparatus of claim 14, wherein the processor is further configured to display, on the display of the mobile device, a contraindication of the product. ### Claim 19 (depends on 14) The apparatus of claim 14, wherein the processor is further configured to display, on the display of the mobile device, a recommended use of the product. ### Claim 20 (depends on 14) The apparatus of claim 14, wherein the processor is further configured to display, on the display of the mobile device, information that identifies an ingredient of the product. ### Claim 21 (depends on 14) The apparatus of claim 14, wherein the processor is further configured to display, on the display of the mobile device, a price of the product. ### Claim 22 (depends on 14) The apparatus of claim 14, wherein the processor is further configured to display, on the display of the mobile device, a link to a website where the product can be purchased. ### Claim 23 (depends on 14) The apparatus of claim 14, wherein the processor is further configured to display, on the display of the mobile device, a balance of the medical savings plan. ### Claim 24 (depends on 14) The apparatus of claim 14, wherein the indication of whether the product qualifies for purchase under the medical savings plan comprises an indication that is presented in the image and proximate to the product shown in the image. ### Claim 25 (depends on 14) The apparatus of claim 14, wherein the indication of whether the product qualifies for purchase under the medical savings plan can be selected by a user of the mobile device to output information about the product. ### Claim 26 (depends on 14) The apparatus of claim 14, wherein the indication of whether the product qualifies for purchase under the medical savings comprises a notification that the product qualifies for purchase under the medical savings plan. ### Claim 27 A computer program product for determining whether a product qualifies under a medical savings plan, the computer program product comprising a non-transitory computer-readable medium, wherein the non-transitory computer-readable medium comprises computer executable program code stored therein, the computer-executable program code being configured to cause a processor to: receive information associated with an image of the product, wherein the image was part of a real-time video stream captured by a mobile device; determine, based at least partially on the information associated with the image, if the image shows a product that qualifies for purchase under a medical savings plan, wherein determining if the image shows a product that qualifies for purchase under the medical savings plan comprises (i) identifying the product based at least partially on the information associated with the image and (ii) determining if the product qualifies for purchase under the medical savings plan by comparing information about the product to information about a known set of products that qualify for purchase under a medical savings plan; display the real-time video stream on a display of the mobile device; determine that the real-time video stream being displayed on the display of the mobile device shows the product; and based upon determining that the real-time video stream being displayed on the display of the mobile device shows the product, display on the display of the mobile device a graphical indication that the product qualifies for purchase under the medical savings plan, the graphical indication being superimposed over the real-time video stream being displayed on the display of the mobile device. ### Claim 28 (depends on 27) The computer program product of claim 27, wherein determining if the image shows a product that qualifies for purchase under a medical savings plan comprises determining if the product qualifies for purchase under a health savings account or flexible spending account. ### Claim 29 (depends on 27) The computer program product of claim 27, wherein the information associated with an image of the product is an image of the product. ### Claim 30 (depends on 27) The computer program product of claim 27, wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a review of the product. ### Claim 31 (depends on 27) The computer program product of claim 27, wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a contraindication of the product. ### Claim 32 (depends on 27) The computer program product of claim 27, wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a recommended use of the product. ### Claim 33 (depends on 27) The computer program product of claim 27, wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, an ingredient of the product. ### Claim 34 (depends on 27) The computer program product of claim 27, wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a price of the product. ### Claim 35 (depends on 27) The computer program product of claim 27, wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a link to a website where the product can be purchased. ### Claim 36 (depends on 27) The computer program product of claim 27, wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a balance of the medical savings plan. ### Claim 37 (depends on 27) The computer program product of claim 27, wherein the presenting, via the mobile device, the indication of whether the product qualifies for purchase under the medical savings plan comprises presenting the indication in the image proximate to the product shown in the image. ### Claim 38 (depends on 27) The computer program product of claim 27, wherein the presenting, via the mobile device, the indication of whether the product qualifies for purchase under the medical savings plan comprises presenting an indication that can be selected by a user of the mobile device to output information about the product. ### Claim 39 (depends on 27) The computer program product of claim 27, wherein the presenting, via the mobile device, the indication of whether the product qualifies for purchase under the medical savings plan comprises notifying the mobile device that the product qualifies for purchase under the medical savings plan.