US 2023/0410437 A1 · AR SYSTEM FOR PROVIDING INTERACTIVE EXPERIENCES IN SMART SPACES

Abstract

Interactive experiences are generated using an augmented reality (AR) system that leverages the native input and output capabilities of AR devices to generate immersive and interactive experiences in smart spaces that combine visually-represented programming logic, AR content, and IoT devices. The system connects IoT devices with each other in a native AR environment, provides virtual content and logic gates, scripts sequences and loops of actions, solves visibility issues for IoT devices that are far apart, and designs logic gates and flow circuits that best support user intentions when generating interactive experiences in smart spaces. The interactive experience is produced by generating a program of behaviors of selected IoT devices using logic gates and control circuits connected to the IoT devices in a visual programming interface of the AR device. Once completed, the program of behaviors is executed by a runtime module to control the IoT devices during the interactive experience.

Claims20

Dependent claims

A method of generating an interactive experience using an augmented reality (AR) device to interact with at least one Internet of Things (IoT) device, comprising:

receiving a selection of the at least one IoT device to be controlled by the AR device during the interactive experience;
providing an AR user interface widget or graphical representation for the selected at least one IoT device to the AR device as an overlay on a display of the AR device;
programming the interactive experience by generating a program of behaviors of the selected at least one IoT device using at least one of logic gates or control circuits connected to the selected at least one IoT device in a visual programming interface of the AR device, the logic gates and control circuits together specifying the behaviors to be performed by the IoT device in the visual programming interface;
and
executing the program of behaviors to selectively control the at least one IoT device during the interactive experience.

2 more elements

An augmented reality (AR) device that generates an interactive experience with at least one Internet of Things (IoT) device, comprising:

a display;
a user input device;
a runtime module that determines a type of AR user interface widget or graphical representation to render for the at least one IoT device on the display, that receives a selection of the at least one IoT device to be controlled during the interactive experience, and that provides the determined type of AR user interface widget or graphical representation for the selected at least one IoT device to the display as an overlay;
and
an experience generation user interface that provides a visual programming interface through which a user provides inputs via the user input device to program the interactive experience by generating a program of behaviors of the selected at least one IoT device using at least one of logic gates or control circuits connected to the selected at least one IoT device in the visual programming interface, the logic gates and control circuits together specifying the behaviors to be performed by the IoT device,
wherein the runtime module executes the program of behaviors to selectively control the at least one IoT device during the interactive experience programmed by the user.

3 more elements

Dependencies are inferred from the claim text.

Ar system for providing interactive experiences in smart spaces

Life of this patent

Ar system for providing interactive experiences in smart spaces

Life of this patent

Abstract

Claims20