Asynchronous brain computer interface in AR using steady-state motion visual evoked potential

A system comprising:

• a smart device;
• a rendering device;
• a wearable biosignal sensing device on a user;
• a processor;
• and
• a memory storing instructions that, when executed by the processor, configure the system to:
• receive one or more requested stimuli data from a user application on the smart device;
• receive at least one of sensor data and other context data, wherein the sensor data includes environmental stimuli from a surrounding environment and the other context data includes data that is un-sensed;
• transform at least a portion of the requested stimuli data, into modified stimuli, based at least in part on at least one of the sensor data and the other context data;
• present the modified stimuli and the environmental stimuli to the user with the rendering device configured to mix the modified stimuli and the environmental stimuli, thereby resulting in rendered stimuli;
• receive biosignals from the user, generated in response to the rendered stimuli, on the wearable biosignal sensing device;
• classify the received biosignals using a classifier based on the modified stimuli, resulting in a classified selection;
• and
• return the classified selection to the user application.

A method comprising:

• receiving one or more requested stimuli data from a user application on a smart device;
• receiving at least one of sensor data and other context data, wherein the sensor data includes environmental stimuli from a surrounding environment and the other context data includes data that is un-sensed;
• transforming at least a portion of the requested stimuli data, into modified stimuli, based at least in part on at least one of the sensor data and the other context data, wherein the modified stimuli include steady-state motion visually evoked potential stimuli;
• presenting the modified stimuli and the environmental stimuli to the user with a rendering device configured to mix the modified stimuli and the environmental stimuli, thereby resulting in rendered stimuli, wherein presenting the modified stimuli and the environmental stimuli to the user includes at least one of:
• rendering the modified stimuli and the environmental stimuli using at least one of a visual device, a haptic device, and an auditory device sensed by the user;
• and
• rendering the modified stimuli and the environmental stimuli on an augmented reality optical see-through (AR-OST) device associated with the smart device;
• receiving biosignals from the user, generated in response to the rendered stimuli, on a wearable biosignal sensing device;
• determining whether to send the biosignals to a classifier by using at least one of:
• the existence of an intentional control signal, wherein determination of the existence of the intentional control signal includes at least one of:
• detecting a manual intention override signal from the smart device;
• and
• determining, at least in part, from received biosignals that the user is intending to fixate on at least one of the rendered stimuli;
• and
• the absence of the intentional control signal;
• on condition the intentional control signal exists:
• sending the received biosignals, to the classifier;
• and
• on condition the intentional control signal is absent:
• continue receiving the received biosignals from the user;
• classifying the received biosignals using the classifier based on the modified stimuli, resulting in a classified selection;
• and
• returning the classified selection to the user application.