Method for performing and visualizing analytics operations over data using augmented reality
AssigneeOhio State Innovation Foundation
InventorsArnab Nandi, Codi Burley
Life of this patent
Estimating the term…
Abstract
The exemplified system and method facilitates process, grammar, and framework to perform analytics operations, and visualize the result of analytics operations using augmented reality. The exemplified system and method can be used, but is not limited to, for augmented reality presentations of physical objects as paper documents, digital or printed signage, posters, physical or digital displays, real-world objects, indoor and outdoor spaces, hardware device displays, vehicle dashboards, and other real-world scenes.
Claims19
A method of operating an augmented reality system, the method comprising:
- receiving, by a processor, a video stream from a video capture sensor;
- determining, by the processor, a plurality of structured data elements in one or more frames of the video stream by (i) detecting, by the processor, a table schema in the one or more frames of the video stream and (ii) extracting, by the processor, elements in a query space data representation of the table schema;
- presenting, by the processor, via a graphical user interface, a first visual output corresponding to the video stream and a second visual output having a plurality of augmented data elements associated with the determined plurality of structured data elements, wherein the second visual output includes the extracted elements in a corresponding presentation model;
- receiving, by the processor, a gesture input on an element of the query space data representation of the table schema;
- and
- performing, by the processor, a query in the query space data representation of the received gesture.
A system comprising:
- a video capture sensor;
- a display;
- a processor;
- and
- a memory having instructions stored thereon, wherein execution of the instructions cause the processor to:
- receive a video stream from the video capture sensor;
- determine a plurality of structured data elements in one or more frames of the video stream by (i) detecting a table schema in the one or more frames of the video stream and (ii) extracting elements in a query space data representation of the table schema;
- present, via a graphical user interface, on the display, a first visual output corresponding to the video stream and a second visual output having a plurality of augmented data elements associated with the determined plurality of structured data elements, wherein the second visual output includes the extracted elements in a corresponding presentation model;
- receive a gesture input on an element of the query space data representation of the table schema;
- and
- perform a query in the query space data representation of the received gesture.
A non-transitory computer readable medium comprising having instructions stored thereon, wherein execution of the instructions by a processor of a computing system cause the processor to:
- receive a video stream from a video capture sensor of the computing system;
- determine a plurality of structured data elements in one or more frames of the video stream by (i) detecting a table schema in the one or more frames of the video stream and (ii) extracting elements in a query space data representation of the table schema;
- present, via a graphical user interface, on a display of the computing system, a first visual output corresponding to the video stream and a second visual output having a plurality of augmented data elements associated with the determined plurality of structured data elements;
- receive a gesture input on an element of the query space data representation of the table schema;
- and
- perform a query in the query space data representation of the received gesture.
Dependencies are inferred from the claim text.