# US 10,311,645 B1 · Methods and systems for treating autism

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,311,645 B1
- Document ID: US10311645B1
- Status: Granted
- Kind: B1
- Application number: 15/782,216
- Filed: 2017-10-12
- Granted: 2019-06-04
- Earliest claimed: 2016-10-14
- Assignees: Floreo, Inc.
- Applicants: Floreo, Inc.
- Inventors: Vijay Ravindran; Vibha Sazawal; Ali Moeeny; Rita Solorzano; Sinan Turnacioglu
- Web page: https://patentgrep.com/patent/US10311645B1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- A61B 5/163: {by tracking eye movement, gaze, or pupil change}
- A61B 5/168: {Evaluating attention deficit, hyperactivity}
- A61B 5/4848: {Monitoring or testing the effects of treatment, e.g. of medication}
- A61B 5/742: {using visual displays (displays for heart-related electrical signals, e.g. ECG, A61B5/339)}
- A61M 21/00: Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61N 1/36025: {for treating a mental or cerebral condition}
- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- A61H 39/007: {Stimulation by mechanical vibrations, e.g. ultrasonic}
- A61M 2021/0022: {by the tactile sense, e.g. vibrations}
- A61M 2021/0027: {by the hearing sense}
- A61M 2021/005: {images, e.g. video}
- A61M 2205/3306: Optical measuring means
- A61M 2205/332: Force measuring means
- A61M 2205/3368: Temperature
- A61M 2205/3375: Acoustical, e.g. ultrasonic, measuring means
- A61M 2205/507: Head Mounted Displays [HMD]
- G01N 2800/28: Neurological disorders
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06V 20/20: in augmented reality scenes
- G06V 40/174: {Facial expression recognition}
- G06V 40/193: {Preprocessing; Feature extraction}
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A61M: DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY (introducing media into or onto the bodies of animals A61D7/00; means for inserting tampons A61F13/26; devices for administering food or medicines orally A61J; containers for collecting, storing or administering blood or medical fluids A61J1/05); DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY (surgery A61B; chemical aspects of surgical articles A61L); DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR {(Electrotherapy, e.g. producing anaesthesia by the use of alternating or intermittent currents A61N1/36021)}
- A61N: ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY (measurement of bioelectric currents A61B; surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body A61B18/00; anaesthetic apparatus in general A61M; incandescent lamps H01K; infrared radiators for heating H05B)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A61H: PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY (electrotherapy, magnetotherapy, radiation therapy or ultrasound therapy A61N)
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method for treating autism is provided. The method includes presenting to affected subjects therapeutic content in the form of images or video in a virtual or augmented reality system and monitoring in real time the behaviors and responses of the subject to the therapy. The virtual or augmented reality system may further include audio, and the monitoring of the therapy may be achieved using one or more tracking sensors, such as a camera.

## Claims

### Claim 1

A method for treating or supplementing treatment of a subject with mental or developmental conditions, comprising:
(a) placing the subject in a virtual world using a virtual or augmented reality device that provides visual, auditory, or haptic stimulation;
(b) presenting one or more images or video of the subject's virtual or augmented reality experience on a display external to the virtual or augmented reality device, wherein the one or more images or video of the subject's virtual or augmented reality experience correspond to one or more images or video presented to the subject in the virtual world;
(c) generating, via one or more sensors operatively coupled to the virtual or augmented reality device, sensory data of the subject in response to the visual, auditory, or haptic stimulation, wherein the sensory data is indicative of the subject's progress toward one or more therapeutic goals; and
(d) evaluating at least the subject's virtual or augmented reality experience presented on the display and the sensory data to determine the subject's progress toward the one or more therapeutic goals.

### Claim 2 (depends on 1)

The method of claim 1, wherein the subject is capable of interacting with the virtual world using eye movement, head movement, or one or more controllers attached to a body and/or limb of the subject.

### Claim 3 (depends on 1)

The method of claim 1, wherein the subject is capable of interacting with a therapist, parent, or peer to progress toward the one or more therapeutic goals.

### Claim 4 (depends on 3)

The method of claim 3, further comprising prescribing the one or more therapeutic goals to the subject.

### Claim 5 (depends on 3)

The method of claim 3, wherein the therapist, parent, or peer is located remote from the subject.

### Claim 6 (depends on 3)

The method of claim 3, wherein the visual, auditory, or haptic stimulation is provided by the therapist, parent or peer.

### Claim 7 (depends on 1)

The method of claim 1, wherein the method is performed without direct supervision of the subject.

### Claim 8

A method for treating a subject for autism, wherein the subject is or is suspected of being autistic, comprising:
(a) selecting, from a plurality of learning modules, a learning module based at least in part on one or more therapeutic goals for the subject, wherein each of the plurality of learning modules is associated with a respective set of one or more therapeutic goals, and wherein the learning module is configured to present one or more images or video to the subject in a virtual or augmented reality experience;
(b) presenting the virtual or augmented reality experience to the subject using a virtual or augmented reality system, wherein the virtual or augmented reality system comprises a first display screen for presenting the one or more images or video to the subject;
(c) generating, via one or more sensors operatively coupled to the virtual or augmented reality system, sensory data of the subject in response to the one or more images or video, wherein the sensory data is indicative of the subject's progress toward the one or more therapeutic goals; and
(d) evaluating at least the sensory data to determine the subject's progress toward the one or more therapeutic goals.

### Claim 9 (depends on 8)

The method of claim 8, wherein the subject is further presented with audio using the virtual or augmented reality system.

### Claim 10 (depends on 8)

The method of claim 8, wherein the one or more sensors comprise at least one of a group consisting of cameras, microphones, motion sensors, heat sensors, inertial sensors, and touch sensors.

### Claim 11 (depends on 8)

The method of claim 8, wherein the subject is capable of interacting with the one or more images or video using eye movement, head movement, or one or more controllers attached to a body and/or limb of the subject.

### Claim 12 (depends on 8)

The method of claim 8, wherein the subject is capable of interacting with a therapist, parent, or peer to progress toward the one or more therapeutic goals.

### Claim 13 (depends on 12)

The method of claim 12, wherein the therapist, parent, or peer is located remote from the subject.

### Claim 14 (depends on 12)

The method of claim 12, wherein the one or more images or video is presented by the therapist, parent or peer.

### Claim 15 (depends on 8)

The method of claim 8, wherein the evaluating comprises comparing the sensory data to expected data for the one or more therapeutic goals.