System, apparatus, and method for augmented reality glasses for end-user programming
AssigneeKoninklijke Philips Electronics N.V.
InventorMarkus Gerardus Leonardus Maria Van Doorn
Life of this patent
Estimating the term…
Abstract
A system, apparatus, and method is provided for augmented reality (AR) glasses (131) that enable an end-user programmer to visualize an Ambient Intelligence environment having a physical dimension such that virtual interaction mechanisms/patterns of the Ambient Intelligence environment are superimposed over real locations, surfaces, objects and devices. Further, the end-user can program virtual interaction mechanisms/patterns and superimpose them over corresponding real objects and devices in the Ambient Intelligence environment.
Claims16
An apparatus (131 140 150) for an end-user to program an Ambient Intelligence environment to include at least one programmable component, comprising:
- a pair of augmented reality (AR) glasses (131) having a see-through field-of-view (132) to visualize therein, for the end-user when wearing the AR glasses, the at least one programmable component proximate to a corresponding real world entity seen by the user in the see-through field-of-view;
- a user programming interface (600-900) that appears in the field-of-view (132) of the AR glasses (131) of the end-user wearing the AR glasses for the end-user to view, create and modify at least one program for the at least one programmable component;
- and
- at least one user input device (133-135 140 150) for a user to direct and react to the user programming interface (600-900) when it appears in the field-of-view (132).
A system for end-user programming of an Ambient Intelligence environment comprising:
- an augmented reality system (402-408) including:
- i. a pair of augment reality (AR) glasses (131 402) according to claim 11 that are worn by an end-use;
- and
- ii. a beat sequencing engine (300) to “read” programmable components of an Ambient Intelligence environment triggered by the end-user while wearing the AR glasses (131 402), wherein the triggered components are visualized in a field-of-view of the AR glasses (131 402) worn by the end-user,
- an authoring tool (502) to collect end-user input an interfaced to the AR system (402-408) for an end-user to “write” the programmable components and associated programs of the Ambient Intelligence environment using a user-interface displayed in the field-of-view of the AR glasses (131 402).
A method for an end-user in an Ambient Intelligence environment to program the Ambient Intelligence environment to include at least one programmable component, comprising:
- providing a pair of augmented reality (AR) glasses (131) having a see-through field-of-view (132);
- when an end-user wears the AR glasses in the Ambient Intelligence environment, visualizing in the field-of-view, the at least one programmable component proximate to a corresponding real world entity seen in the see-through field of view;
- displaying an end-user programming interface (600-900) in the field-of-view (132) that enables the end-user to “read” and “write” at least one program for the at least one programmable component having an “undo”/“debugging” mode;
- and
- providing at least one user input device (133-135 140 150) for the end-user to direct and react to the displayed end-user programming interface (600-900) when it appears in the field-of-view (132) to program the at least one programmable component.
Dependencies are inferred from the claim text.