Platform for recognising text using mobile devices with a built-in device video camera and automatically retrieving associated content based on the recognised text
OwnerJames Yoong-Siang Waninventor
Life of this patent
Estimating the term…
Abstract
A platform for recognising text using mobile devices with a built-in device video camera and automatically retrieving associated content based on the recognised text.
Claims18
A platform for recognising text using mobile devices with a built-in device video camera and automatically retrieving associated content based on the recognised text, the platform comprising:
- a database for storing machine-encoded text and associated content corresponding to the machine-encoded text;
- and
- a text detection engine for detecting the presence of text in a live video feed captured by the built-in device video camera in real-time, and converting the detected text into machine-encoded text in real-time;
- and
- a mobile application executed by the mobile device, the mobile application including:
- a display module for displaying the live video feed on a screen of the mobile device;
- and a content retrieval module for retrieving the associated content by querying the database based on the machine-encoded text converted by the text detection engine;
- wherein the retrieved associated content is superimposed in the form of Augmented Reality (AR) content on the live video feed in real-time using the display module, the AR content having user-selectable graphical user interface components that when selected by a user retrieves digital content remotely stored from the mobile device, and the detection and conversion by the text detection engine and the superimposition of the AR content is performed without user input to the mobile application.
A mobile application executed by a mobile device for recognising text using a built-in device video camera of the mobile device and automatically retrieving associated content based on the recognised text, the application comprising:
- a display module for displaying a live video feed captured by the built-in device video camera in real-time on a screen of the mobile device;
- and
- a content retrieval module for retrieving the associated content from a database for storing machine-encoded text and associated content corresponding to the machine-encoded text by querying the database based on the machine-encoded text converted by an text detection engine for detecting the presence of text in the live video feed captured and converting the detected text into machine-encoded text in real-time;
- wherein the retrieved associated content is superimposed in the form of Augmented Reality (AR) content on the live video feed in real-time using the display module, the AR content having user-selectable graphical user interface components that when selected by a user retrieves digital content remotely stored from the mobile device, and the detection and conversion by the text detection engine and the superimposition of the AR content is performed without user input to the mobile application.
A computer-implemented method for recognising text using a mobile device with a built-in device video camera and automatically retrieving associated content based on the recognised text, the method comprising:
- displaying a live video feed on a screen of the mobile device captured by the built-in device video camera of the mobile device in real-time;
- detecting the presence of text in the live video feed;
- converting the detected text into machine-encoded text;
- retrieving the associated content by querying a database for storing machine-encoded text and associated content corresponding to the machine-encoded text based on the converted machine-encoded text;
- and
- superimposing the retrieved associated content in the form of Augmented Reality (AR) content on the live video feed in real-time, the AR content having user-selectable graphical user interface components that when selected by a user retrieves digital content remotely stored from the mobile device;
- wherein the steps of detection, conversion and superimposition are performed without user input to the mobile application.
Dependencies are inferred from the claim text.