# US 2023/0068531 A1 · Methods and Systems to Facilitate Silent Communication

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0068531 A1
- Document ID: US20230068531A1
- Status: Published application
- Kind: A1
- Application number: 17/796,884
- Filed: 2021-02-05
- Published: 2023-03-02
- Earliest claimed: 2020-02-07
- Assignees: Georgia Tech Research Corporation
- Applicants: Georgia Tech Research Corporation
- Inventors: Caitlyn Seim; Thad Eugene Starner
- Web page: https://patentgrep.com/patent/US20230068531A1

## CPC

- G09B 21/00: Teaching, or communicating with, the blind, deaf or mute (audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B)
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G09B 19/00: Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26)
- G09B 21/003: {using tactile presentation of the information, e.g. Braille displays}
- G10L 21/00: Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility (G10L19/00 takes precedence)
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An exemplary embodiment of the present disclosure provides a method of communication, the method comprising receiving a signal from a subject, wherein the signal represents activity in a brain of the subject associated with one or more spatiotemporal movements of one or more portions of the subject's body, correlating the signal to a portion of a coded language system and outputting the portion of the coded language system.

## Claims

### Claim 1

A comprising:
correlating one or more signals representative of activities in a brain of a subject associated with one or more spatiotemporal movements of one or more portions of the body of the subject to one or more portions of a coded language system.

### Claim 2 (depends on 1)

The method of claim 1 further comprising:
receiving one or more of the signals; and
outputting one or more of the portions of the coded language system.

### Claim 3 (depends on 2)

The method of claim 2 further comprising demonstrating to the subject one or more of the spatiotemporal movements associated with one or more of the portions of the coded language system.

### Claim 4 (depends on 3)

The method of claim 3, wherein demonstrating comprises applying one or more stimuli to the subject; and
wherein one or more of the stimuli is selected from the group consisting of auditory stimuli, visual stimuli, tactile stimuli, gustatory stimuli, olfactory stimuli, and any combinations thereof.

### Claim 5 (depends on 4)

The method of claim 4, wherein at least one of the one or more stimuli comprises a tactile stimulation of one or more of the portions of the body of the subject.

### Claim 6 (depends on 5)

The method of claim 5, wherein one of more of the portions of the body of the subject is selected from the group consisting of an organ, a muscle, a tendon, a joint, a bone, skin, cartilage, and any combinations thereof.

### Claim 7 (depends on 5)

The method of claim 5, wherein one of more of the portions of the body of the subject is selected from the group consisting of an eye, an ear, a mandible, a temple, a tongue, teeth, a buccal, a shoulder, a bicep, an elbow, a hand, a wrist, a finger, a fingernail, an abdominal, a buttocks, a thigh, a knee, an ankle, a foot, an ankle bone, a toe, a toenail, and any combinations thereof.

### Claim 8 (depends on 5)

The method of claim 5, wherein the tactile stimulation is selected from the group consisting of temporally separated tactile stimuli, vibrational tactile stimulation, electrical tactile stimulation, and any combinations thereof.

### Claim 9

(canceled)

### Claim 10 (depends on 5)

The method of claim 5, wherein the tactile stimulation comprises electrical tactile stimulation selected from the group consisting of electrical muscle stimulation, transcutaneous electrical nerve stimulation, functional electrical stimulation, neuromuscular electrical stimulation, Russian electrical stimulation, and any combinations thereof.

### Claim 11 (depends on 1)

The method of claim 1, wherein one or more of the spatiotemporal movements is selected from the group consisting of executed actions, attempted actions, imagined actions, and any combinations thereof.

### Claim 12 (depends on 1)

The method of claim 1, wherein the coded language system comprises text.

### Claim 13

(canceled)

### Claim 14 (depends on 12)

The method of claim 12, wherein the text is associated to a chorded system.

### Claim 15 (depends on 14)

The method of claim 14, wherein the chorded system comprises less than N-points; and
wherein N is less than 27.

### Claim at position 16

-22. (canceled)

### Claim 23 (depends on 14)

The method of claim 14, wherein the chorded system is selected from the group consisting of Braille, CyKey, SiWriter, GKOS, EkaPad, FrogPad, Decatxt, Twiddler, ASETNIOP, stenotype, velotype, Microwriter, and any combinations thereof.

### Claim at position 18

-27. (canceled)

### Claim 28 (depends on 2)

The method of claim 2, wherein one or more of the signals is received at a non-invasive receiver.

### Claim 29 (depends on 28)

The method of claim 28, wherein the non-invasive receiver is selected from the group consisting of a brain-computer interface, a functional magnetic resonance imaging (fMRI) system, a functional near infrared (fNIR) imaging system, a positron emission tomography (PET) imaging system, an electroencephalogram (EEG) system, a transcranial magnetic stimulation (TMS) system, and any combinations thereof.

### Claim at position 21

-34. (canceled)

### Claim 35 (depends on 2)

The method of claim 2, wherein one or more of the signals is received by an invasive receiver.

### Claim 36 (depends on 35)

The method of claim 35, wherein the invasive receiver is selected from the group consisting of an implanted electrode, a multielectrode array, a group of electrodes, and any combinations thereof.

### Claim 37 (depends on 1)

The method of claim 1, wherein one or more of the signals is indicative of a blood oxygenation level-dependent (BOLD) response in the subject.

### Claim 38 (depends on 1)

The method of claim 1 further comprising:
receiving one or more of the signals at a receiver selected from the group consisting of a non-invasive receiver, an invasive receive, and any combinations thereof;
outputting one or more of the portions of the coded language system into text associated to a chorded system; and
demonstrating to the subject one or more of the spatiotemporal movements associated with one or more of the portions of the coded language system;
wherein the non-invasive receiver is selected from the group consisting of a brain-computer interface, a functional magnetic resonance imaging (fMRI) system, a functional near infrared (fNIR) imaging system, a positron emission tomography (PET) imaging system, an electroencephalogram (EEG) system, a transcranial magnetic stimulation (TMS) system, and any combinations thereof;
wherein the invasive receiver is selected from the group consisting of an implanted electrode, a multielectrode array, a group of electrodes, and any combinations thereof;
wherein demonstrating comprises applying one or more stimuli to the subject selected from the group consisting of auditory stimuli, visual stimuli, tactile stimuli, gustatory stimuli, olfactory stimuli, and any combinations thereof;
wherein one or more of the spatiotemporal movements is selected from the group consisting of executed actions, attempted actions, imagined actions, and any combinations thereof; and
wherein the chorded system is selected from the group consisting of Braille, CyKey, SiWriter, GKOS, EkaPad, FrogPad, Decatxt, Twiddler, ASETNIOP, stenotype, velotype, Microwriter, and any combinations thereof.

### Claim 39 (depends on 1)

The method of claim 1 further comprising outputting the portion of the coded language system into speech.

### Claim 40

A communication system comprising:
a receiver configured to receive a signal from a subject, wherein the signal represents activity in a brain of the subject associated with one or more spatiotemporal movements of one or more portions of the body of the subject and is indicative of a blood oxygenation level-dependent (BOLD) response in the subject; and
a controller configured to correlate the signal to a portion of a coded language system;
wherein one or more of the spatiotemporal movements is selected from the group consisting of executed actions, imagined actions, and any combinations thereof.

### Claim 41 (depends on 40)

The system of claim 40, further comprising actuators configured to stimulate the portions of the body of the subject.

### Claim 42 (depends on 41)

The system of claim 41, wherein one or more of the actuators is selected from the group consisting of a vibration motor, an electrode, a speaker, a bone-conduction device, and any combinations thereof.

### Claim 43 (depends on 41)

The system of claim 41, wherein at least one of actuators is positioned on or within a wearable device configured to stimulate one or more of the portions of the body of the subject.

### Claim at position 31

-45. (canceled)

### Claim 46 (depends on 40)

The system of claim 40, wherein the receiver is selected from the group consisting of a non-invasive receiver, an invasive receiver, and any combinations thereof;
wherein the non-invasive receiver is selected from the group consisting of a brain computer interface, an MRI system, an NIR system, a PET system, an EEG system, a TMS system, and any combinations thereof; and
wherein the invasive receiver is selected from the group consisting of an implanted electrode, a multielectrode array, a group of electrodes, and any combinations thereof.

### Claim at position 33

-51. (canceled)

### Claim 52 (depends on 40)

The system of claim 40, wherein the portion of the coded language system comprises text.

### Claim 53

(canceled)

### Claim 54 (depends on 52)

The system of claim 52, wherein the text is associated to a chorded system.

### Claim at position 37

-63. (canceled)

### Claim 64 (depends on 40)

The system of claim 40, wherein the controller is further configured to convert the portion of the coded language system into text or speech.

### Claim 65

A method of screening a subject for invasive receiver compatibility, the method comprising:
demonstrating to a subject one or more spatiotemporal movements associated with a portion of a coded language system, wherein the demonstrating comprises applying one or more stimuli to the subject;
receiving a signal from the subject, wherein the signal represents activity in a brain of the subject associated with the one or more spatiotemporal movements; and
correlating the signal to a portion of the coded language system.

### Claim 66 (depends on 28)

The method of claim 28 further comprising silently and non-visually communicating portions of the coded language system at over 50 bits per minute (bpm).

### Claim 67 (depends on 28)

The method of claim 28 further comprising silently and non-visually communicating portions of the coded language system at over 100 bits per minute (bpm).
