US 11,660,419 B2Granted

Systems, devices, and methods for generating and manipulating objects in a virtual reality or multi-sensory environment to maintain a positive state of a user

AssigneePsyber, Inc.

InventorPrahlad Krishnan

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems, devices, and methods described herein relate to multi-sensory presentation devices, including virtual reality (VR) devices, visual display devices, sound devices, haptic devices, and other forms of presentation devices, that are configured to present sensory elements, including visual and/or audio scenes, to a user. In some embodiments, one or more sensors including electroencephalography (EEG) sensors and a photoplethysmography (PPG) sensors, e.g., included in a brain-computer interface, can measure physiological data of a user to monitor a state of the user during the presentation of the visual and/or audio scenes. Such systems, devices, and methods can adapt one or more visual and/or audio scenes based on user physiological data, e.g., to control or manage the state of the user.

Claims30

Dependent claims

An apparatus, comprising:

a virtual reality (VR) device configured to present at least one of a visual, olfactory, gustatory, auditory, or haptic signal to a user;
a set of sensors configured to measure user data, the set of sensors including at least an electroencephalography (EEG) sensor and a photoplethysmography (PPG) sensor;
a memory;
and
a processor operatively coupled to the virtual reality device, the set of sensors, and the memory, the processor configured to:
present, using the VR device, a plurality of sets of objects to the user according to a sequence by:
presenting, using the VR device, a first set of objects of the plurality of sets of objects to the user, the first set of objects including visual, olfactory, gustatory, auditory, or haptic elements;
instructing the user to engage in an activity for increasing focus or relaxation for the user;
after the user has been instructed to engage in the activity, iteratively performing until a score indicative of a state of the user satisfies a metric:
measuring, using the set of sensors, the user data including at least EEG data and heart rate variability (HRV) data;
determining, using a model trained to measure the state of the user, and based on the user data, the score of the user;
and
in response to the score of the user being above a threshold, modifying, using the VR device, the presentation of the first set of objects such that the first set of objects form or follow a pattern or presenting, using the VR device, an additional object;
in response to the score of the user satisfying the metric, presenting, using the VR device, a second set of objects of the plurality of sets of objects to the user;
and
presenting each set of objects of the plurality of sets of objects subsequent to the first and second sets of objects in the sequence in response to the score of the user satisfying the metric after a set of objects of the plurality of sets of objects immediately preceding each set of objects of the plurality of set of objects in the sequence is presented.

13 more elements

An apparatus, comprising:

a virtual reality (VR) device configured to present at least one of a visual, olfactory, gustatory, auditory, or haptic signal to a user;
one or more electroencephalography (EEG) sensors configured to measure EEG data of the user;
a memory;
and
a processor operatively coupled to the virtual reality device, the one or more EEG sensors, and the memory, the processor configured to:
present, using the VR device, a plurality of sets of objects to the user according to a sequence by:
presenting, using the VR device, a first set of objects of the plurality of sets of objects to the user, the first set of objects including visual, olfactory, gustatory, auditory, or haptic elements;
instructing the user to engage in an activity for increasing focus or relaxation for the user;
after the user has been instructed to engage in the activity, iteratively performing until a score indicative of a state of the user satisfies a metric:
measuring, using the one or more EEG sensors, the EEG data;
determining, using a model trained to measure the state of the user, and based on the EEG data, the score of the user;
and
in response to the score of the user being above a threshold, modifying, using the VR device, the presentation of the first set of objects such that the first set of objects form or follow a pattern or presenting, using the VR device, an additional object;
in response to the score of the user satisfying the metric, presenting, using the VR device, a second set of objects of the plurality of sets of objects to the user;
and
presenting each set of objects of the plurality of sets of objects subsequent to the first and second sets of objects in the sequence in response to the score of the user satisfying the metric after a set of objects of the plurality of sets of objects immediately preceding each set of objects of the plurality of set of objects in the sequence is presented.

13 more elements

An apparatus, comprising:

a virtual reality (VR) device configured to present at least one of a visual, olfactory, gustatory, auditory, or haptic signal to a user;
a set of sensors configured to measure user data, the set of sensors including at least an electroencephalography (EEG) sensor and a photoplethysmography (PPG) sensor;
a memory;
and
a processor operatively coupled to the virtual reality device, the set of sensors, and the memory, the processor configured to:
present, during a calibration phase, a set of environmental stimulations considered to be calming to the user interspersed with periods of no environmental stimulation;
measure first user data during the calibration phase;
adapt, using the first user data measured during the calibration phase, a generic model trained using data other than the first user data to measure states of users to be a user-specific model for measuring a state of the user;
present, after the calibration phase, and using the VR device, a scene including a first set of objects to the user, the first set of objects including visual, olfactory, gustatory, auditory, or haptic elements;
instruct the user to engage in an activity for increasing focus or relaxation for the user;
after the user has been instructed to engage in the activity, iteratively perform until a score indicative of a state of the user satisfies a metric:
measuring, using the set of sensors, second user data of the user, the second user data including at least EEG data and heart rate variability (HRV) data;
determining, using the user-specific model, and based on the second user data, the score of the user;
and
in response to the score of the user being above a threshold, modifying, using the VR device, the presentation of the first set of objects such that the first set of objects form or follow a pattern or presenting, using the VR device, an additional object;
and
in response to the score of the user satisfying the metric, present, using the VR device, a second set of objects to the user.

14 more elements

An apparatus, comprising:

a virtual reality (VR) device configured to present at least one of a visual, olfactory, gustatory, auditory, or haptic signal to a user;
one or more electroencephalography (EEG) sensors configured to measure EEG data of the user;
a memory;
and
a processor operatively coupled to the virtual reality device, the one or more EEG sensors, and the memory, the processor configured to:
present, during a calibration phase, a set of environmental stimulations considered to be calming to the user interspersed with periods of no environmental stimulation;
measure first EEG data during the calibration phase;
adapt, using the first EEG data measured during the calibration phase, a generic model trained using data other than the first EEG data to measure states of users to be a user-specific model for measuring a state of the user;
present, after the calibration phase, and using the VR device, a scene including a first set of objects to the user, the first set of objects including visual, olfactory, gustatory, auditory, or haptic elements;
instruct the user to engage in an activity for increasing focus or relaxation for the user;
after the user has been instructed to engage in the activity, iteratively perform until a score indicative of a state of the user satisfies a metric:
measuring, using the one or more EEG sensors, second EEG data;
determining, using the user-specific model, and based on the second EEG data, the score of the user;
and
in response to the score of the user being above a threshold, modifying, using the VR device, the presentation of the first set of objects such that the first set of objects form or follow a pattern or presenting, using the VR device, an additional object;
and
in response to the score of the user satisfying the metric, present, using the VR device, a second set of objects to the user.

14 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/866,430Filed 15 Jul 2022 · us provisional application
Priority: 16 Jul 2021
Published: US 2023/0012960 A119 Jan 2023
Granted: 30 May 2023
Term ends: Not estimatedThe source records don’t support an estimate.

Classification32 codes

A61M 21/02
Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or…: for…
A61B 5/02055
Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition:…
A61B 5/02405
Measuring pulse rate or heart rate: determining heart rate variability
A61B 5/02416
Measuring pulse rate or heart rate: using photoplethysmograph signals, e.g. generated by infrared radiation

Family

Application63/222,873Us provisional application · filed 16 Jul 2021
Application63/225,152Us provisional application · filed 23 Jul 2021
Application63/245,625Us provisional application · filed 17 Sep 2021
US 2023/0012960 A1Pre-grant publication · published 19 Jan 2023
US 11,660,419 B2This patent

From the US filing history. Foreign family members aren’t listed.