Augmented project lists with price information
AssigneeCapital One Services, LLC
InventorsAbdelkader M'Hamed Benkreira, Michael Mossoba, Salik Shah
Life of this patent
Estimating the term…
Abstract
In some embodiments, the present disclosure relates to a method for augmenting project lists with price information. The method can include: capturing an image using a camera of a user device; identifying a project list within the captured image; extracting, from the captured image, a list of items associated with the project list, the list of items represented as text; retrieving price information for one or more of the list items; and displaying, on the user device, an augmented image comprising the captured image and the price information.
Claims13
A method for augmenting project lists with price information, the method comprising:
- capturing an image using a camera of a user device;
- identifying a project list within the captured image using computer vision (CV), by:
- selecting a first machine learning (ML) model based on a project type associated with the project list;
- and
- applying the CV to the project list, wherein the CV comprises the selected first ML model;
- extracting from the captured image, using natural language processing (NLP), a list of items associated with the project list, the list of items represented as text, by:
- selecting a second machine learning (ML) model based on the project type associated with the project list;
- and
- applying the NLP to the project list, wherein the NLP comprises the selected second ML model;
- retrieving price information for one or more of the list items from a database or from one or more vendors using application programming interfaces (APIs);
- generating an augmented image comprising the captured image and the price information;
- and
- displaying the augmented image on the user device.
A server device comprising:
- one or more processors;
- an application programming interface (API) module configured for execution on the processors to receive requests from and send responses to a user device;
- an items module configured for execution the processors to:
- receive, from the user device via the API module, a list of items associated with a project list;
- retrieve, from a database, price information for the list of items from a database or from one or more vendors using application programming interfaces (APIs);
- and
- send the price information to the user device via the API module;
- wherein the user device is configured to:
- capture an image using a camera of the user device;
- identify the project list within the captured image using computer vision (CV), by:
- selecting a first machine learning (ML) model based on a project type associated with the project list;
- and
- applying the CV to the project list, wherein the CV comprises the selected first ML model;
- extract from the captured image, using natural language processing (NLP), the list of items associated with the project list, the list of items represented as text by:
- selecting a second machine learning (ML) model based on the project type associated with the project list;
- and
- applying the NLP to the project list, wherein the NLP comprises the selected second ML model;
- generate an augmented image comprising the captured image and the price information;
- and
- display the augmented image on the user device.
Dependencies are inferred from the claim text.