Back to results
US 10,504,231 B2Granted
Fiducial marker patterns, their automatic detection in images, and applications thereof
AssigneeMillennium Three Technologies, Inc.
InventorMark Fiala
Life of this patent
Estimating the term…
Abstract
Fiducial markers are printed patterns detected by algorithms in imagery from image sensors for applications such as automated processes and augmented reality graphics. The present invention sets forth extensions and improvements to detection technology to achieve improved performance, and discloses applications of fiducial markers including multi-camera systems, remote control devices, augmented reality applications for mobile devices, helmet tracking, and weather stations.
Claims27
A remote control and/or augmented reality system comprising:
- a) a mobile device with an outward facing video or still image capture, a display, a micro-computer, and optionally a network connection;
- b) fiducial marker patterns printed and mounted on objects or locations of interest,
- c) software, firmware, or hardware in said mobile device that can recognize said fiducial markers in imagery captured by a camera of said mobile device using a marker detection algorithm,
- d) services which are computer interfaces to some information or control functionality of interest to a user, such as databases which can be accessed from industrial automation systems,
- e) a server located either on a remote computer or within the same mobile device that provides files for use in creating a graphical interface widget for communication with said services,
- f) optionally a network that provides data communication capability between the server and one or more mobile devices, if the server is not inside the mobile device, for the purpose of communicating the widgets and, for applications such as industrial SCADA systems, optionally the services,
- g) wherein a requestor component in the mobile device requests widgets from the server according to a unique identifier of one or more fiducials detected in said camera's imagery, and
- h) wherein a drawing module inside the mobile device performs the task of drawing graphics of the widget on the display, and
- i) wherein HTML5 web page code using conventional HTML and SVG graphics elements and JavaScript are used for changing graphics and interactions such as Jquery ‘Ajax’.
6 more elements
A remote control and/or augmented reality system comprising:
- a) a mobile device with an outward facing video or still image capture, a display, a micro-computer, and optionally a network connection;
- b) fiducial marker patterns printed and mounted on objects or locations of interest,
- c) software, firmware, or hardware in said mobile device that can recognize said fiducial markers in imagery captured by a camera of said mobile device using a marker detection algorithm,
- d) services which are computer interfaces to some information or control functionality of interest to a user, such as databases which can be accessed from industrial automation systems,
- e) a server located either on a remote computer or within the same mobile device that provides files for use in creating a graphical interface widget for communication with said services,
- f) optionally a network that provides data communication capability between the server and one or more mobile devices, if the server is not inside the mobile device, for the purpose of communicating the widgets and, for applications such as industrial SCADA systems, optionally the services,
- g) wherein a requestor component in the mobile device to request widgets from the server according to a unique identifier of one or more fiducials detected in said camera's imagery, and
- h) wherein a drawing module inside the mobile device performs the task of drawing graphics of the widget on the display;
- wherein the server has a switchboard component with which said mobile devices communicates to receive the widget information and pass messages in both directions to a back end service as a function of a type and ID number of each fiducial marker detected, wherein the switchboard contains the mapping of what content to appear over which marker, and where this mapping is changeable by the user.
6 more elements
Dependencies are inferred from the claim text.