System and method for retrieving and displaying supplemental information and pertinent data using augmented reality
Assigneesalesforce.com, inc.
InventorsSACHIN DESAI, EUGENE OKSMAN
Life of this patent
Estimating the term…
Abstract
Methods and systems are provided for displaying pertinent data, using augmented reality, to supplement information in images acquired by an imaging device of a mobile communication device. The images can be analyzed to find one or more matched objects, and recognition can be performed on the matched objects to recognize target components. It can be determined whether the recognized target components match one or more known patterns. Based on the known patterns pertinent data pertaining to the known patterns can be retrieved from one or more data sources, and displayed at a display using augmented reality to supplement information in the images acquired by the imaging device.
Claims20
A method, comprising:
- receiving images acquired by an imaging device of a mobile communication device;
- analyzing the images, at a processor, to find one or more matched objects;
- performing recognition on the matched objects, at the processor, to recognize target components;
- determining, at the processor, whether the recognized target components match one or more known patterns;
- retrieving, based on the known patterns, pertinent data pertaining to the known patterns from one or more data sources;
- and
- displaying, at a display using augmented reality, at least some of the pertinent data to supplement information in the images acquired by the imaging device.
A computing system, comprising:
- a network interface configured to communicate with one or more data sources;
- an imaging device configured to acquire images;
- a memory comprising computer-executable instructions;
- a processor configured to execute the computer-executable instructions to cause the processor to:
- analyze the images acquired by the imaging device to find one or more matched objects;
- perform recognition processing on the matched objects to recognize target components;
- determine whether the recognized target components match one or more known patterns;
- and retrieve, based on the known patterns, pertinent data pertaining to the known patterns from the one or more data sources;
- and
- a display configured to display a user interface that is configured to present, using augmented reality, at least some of the pertinent data to supplement information in the images acquired by the imaging device.
A system, comprising:
- one or more data sources comprising at least one of:
- a backend database;
- a backend server system;
- a cloud computing platform;
- targets identified by a search engine;
- and a social media platform or service;
- and
- a mobile communication device configured to communicate with the one or more data sources, the mobile communication device comprising:
- an imaging device configured to acquire images;
- a processor configured to:
- analyze the images acquired by the imaging device to find one or more matched objects;
- perform recognition processing on the matched objects to recognize target components;
- determine whether the recognized target components match one or more known patterns;
- and retrieve, based on the known patterns, pertinent data pertaining to the known patterns from the one or more data sources;
- and
- a display configured to display a user interface that is configured to present, using augmented reality, at least some of the pertinent data to supplement information in the images acquired by the imaging device.
Dependencies are inferred from the claim text.