Interacting with data fields on a page using augmented reality
AssigneeInternational Business Machines Corporation
InventorsGregory R. Hintermeister, Jacob A. Kugel
Life of this patent
Estimating the term…
Abstract
Embodiments described herein provide approaches for interacting with data fields on a page using an augmented reality (AR) device. Specifically, a way for a user to interact with a page having preprinted content and a user's handwritten content within a real world scene using a display screen of the AR device is provided. An image capture unit of the AR device captures image data representing the page. A processing unit performs a page scan of the captured image data to determine a set of data fields located on the page. Context data for at least one data field within the page is received by the processing unit. Augmented reality content based on the context data is incorporated into the page when viewing the page through the display screen.
Claims20
A computer-implemented method for interacting with a page within a real world scene, comprising:
- receiving image data representing the page within the real world scene at an augmented reality device from an image capture unit, the image capture unit capturing the image data in a continuous capture mode in real time;
- performing a page scan of the captured image data representing the page;
- determining a set of data fields located on the page based on the page scan;
- locking an area of the scanned data designated by the user;
- performing a subsequent page scan, the subsequent page scan scanning only areas of the page that are not locked;
- receiving context information for at least one data field among the set of data fields located on the page at the augmented reality device, the context information transforming the at least one data field into a control that the user can interact with;
- and
- incorporating augmented reality content into the page while viewing the page through a display screen of the augmented reality device in the continuous capture mode, wherein the augmented reality content is based on the context information.
A computer system for interacting with a page within a real world scene, the computer system comprising:
- a memory medium comprising program instructions;
- a bus coupled to the memory medium;
- and
- a processor for executing the program instructions, the instructions causing the system to:
- receive image data representing the page within the real world scene at an augmented reality device from an image capture unit, the image capture unit capturing the image data in a continuous capture mode in real time;
- perform a page scan of the captured image data representing the page;
- lock an area of the scanned data designated by the user;
- perform a subsequent page scan, the subsequent page scan scanning only areas of the page that are not locked;
- determine a set of data fields located on the page based on the page scan;
- receive context information for at least one data field among the set of data fields located on the page at the augmented reality device, the context information transforming the at least one data field into a control that the user can interact with;
- and
- incorporate augmented reality content into the page while viewing the page through a display screen of the augmented reality device in the continuous capture mode, wherein the augmented reality content is based on the context information.
A computer program product for interacting with a page within a real world scene, the computer program product comprising a computer readable storage device, and program instructions stored on the computer readable storage device, to:
- receive image data representing the page within the real world scene at an augmented reality device from an image capture unit, the image capture unit capturing the image data in a continuous capture mode in real time;
- perform a page scan of the captured image data representing the page;
- lock an area of the scanned data designated by the user;
- perform a subsequent page scan, the subsequent page scan scanning only areas of the page that are not locked;
- determine a set of data fields located on the page based on the page scan;
- receive context information for at least one data field among the set of data fields located on the page at the augmented reality device, the context information transforming the at least one data field into a control that the user can interact with;
- and
- incorporate augmented reality content into the page while viewing the page through a display screen of the augmented reality device in the continuous capture mode, wherein the augmented reality content is based on the context information.
Dependencies are inferred from the claim text.