Template-based recognition of food product information
AssigneeInternational Business Machines Corporation
InventorsVarun Bhagwan, Justin Ormont, Heather Underwood
Life of this patent
Estimating the term…
Abstract
A method for template based recognition of food product information includes capturing an image of food product packaging and extracting an attribute from the image. The attribute is used to find a matching template in a template database. The matching template is then used to extract food product information from the image.
Claims20
A method for template based recognition of food product information comprises, with a processor:
- extracting an attribute from an image of food product packaging;
- finding, in a template database, a template matching the attribute;
- extracting, by referencing the matching template, food product information from the image;
- transforming the food product information according to user defined preferences;
- tracking a history of food product information imaged by the user to measure progress toward a health goal;
- and
- displaying the transformed information and the history of food product information to a user.
A system comprising:
- a template database comprising templates of food product packaging;
- a processor with memory to store instructions, the instructions executable by the processor to implement:
- a template matching module to match an image of a food product with a template in the template database;
- an analytics engine to extract information from the image according to the template;
- and
- a personal filter to manipulate the extracted information according to user preferences to produce personalized data, wherein the user defined preferences comprise at least one of:
- analyzing the data for user allergens, applying a nutrient content filter, calculating user-specific nutrient values, recording a history of user food consumption, searching for product recall notices, searching for product reviews, and presenting dietary reminders to the user;
- in which the personalized data is presented to a user on an electronic display device.
A computer program product for template based recognition of food product information, the computer program product comprising:
- a non-transitory computer readable storage device having computer readable program code embodied therewith, the computer readable program code comprising:
- computer readable program code configured to extract at least one attribute from an image of food product packaging;
- the computer readable program code configured to use the at least one attribute to identify a matching template in a template database;
- the computer readable program code configured to use the matching template to extract food product information from the image;
- the computer readable program code configured to transform the food product information according to user preferences and present the food product information to the user in a transformed condition;
- and
- update the template database by creating new templates from crowd-sourced data collected in response to determining that a predetermined number of users have not been able to find a template in the template database matching a given product label from food packaging.
Dependencies are inferred from the claim text.