# US 10,406,376 B2 · Multi-factor control of ear stimulation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,406,376 B2
- Document ID: US10406376B2
- Status: Granted
- Kind: B2
- Application number: 15/340,217
- Filed: 2016-11-01
- Published: 2017-04-27
- Granted: 2019-09-10
- Earliest claimed: 2015-03-27
- Assignees: eQuility LLC
- Applicants: Elwha LLC
- Inventors: Eleanor V. Goodall; Roderick A. Hyde; Muriel Y. Ishikawa; Jordin T. Kare; Melanie K. Kitzan; Eric C. Leuthardt; Mark A. Malamud; Stephen L. Malaska; Nathan P. Myhrvold; Brittany Scheid; Katherine E. Sharadin; Elizabeth A. Sweeney; Clarence T. Tegreene; Charles Whitmer; Lowell L. Wood, Jr.; Victoria Y. H. Wood
- Web page: https://patentgrep.com/patent/US10406376B2

## CPC

- A61N 2/006: {for magnetic stimulation of nerve tissue}
- A61B 5/00: Measuring for diagnostic purposes (radiation diagnosis A61B6/00; diagnosis by ultrasonic, sonic or infrasonic waves A61B8/00); Identification of persons
- A61B 5/12: Audiometering
- A61B 5/4005: {for evaluating the sensory system (A61B5/12, A61B5/4058 take precedence)}
- A61B 5/6816: {Ear lobe}
- A61B 5/6898: {Portable consumer electronic devices, e.g. music players, telephones, tablet computers}
- A61N 1/0456: {Specially adapted for transcutaneous electrical nerve stimulation [TENS]}
- A61N 1/0472: {Structure-related aspects}
- A61N 1/36031: {using physiological parameters for adjustment}
- A61N 1/36036: {of the outer, middle or inner ear}
- A61N 1/37247: {User interfaces, e.g. input or presentation means}
- A61N 2/002: {in combination with another treatment}
- A61N 2/02: using magnetic fields produced by coils, including single turn loops or electromagnets (A61N2/12 takes precedence)
- A61N 5/0622: {Optical stimulation for exciting neural tissue}
- A61N 7/00: Ultrasound therapy (lithotripsy A61B17/22, A61B17/225; massage using supersonic vibration A61H23/00 {; using ultrasound for introducing media into the body A61M37/0092})
- G06T 7/00: Image analysis
- A61B 5/4094: {Diagnosing or monitoring seizure diseases, e.g. epilepsy}
- A61B 5/4806: {Sleep evaluation (A61B5/4821 takes precedence; devices for inducing sleep A61M21/02)}
- A61N 1/0484: {Garment electrodes worn by the patient}
- A61N 1/36021: {for treatment of pain}
- A61N 1/36025: {for treating a mental or cerebral condition}
- A61N 2005/0647: {the applicator adapted to be worn on the head}
- A63F 13/212: using sensors worn by the player, e.g. for measuring heart beat or leg activity
- A63F 13/424: involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
- G06V 40/15: {Biometric patterns based on physiological signals, e.g. heartbeat, blood flow}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- A61N: ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY (measurement of bioelectric currents A61B; surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body A61B18/00; anaesthetic apparatus in general A61M; incandescent lamps H01K; infrared radiators for heating H05B)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and related methods for controlling an ear stimulation device with a personal computing device are described. Multiple factors, including a mood of the user, a user control input, and a secondary factor input are used in controlling the ear stimulation device. Secondary factors include, a variety of factors relating to or influencing the state of the user, including but not limited to, environmental conditions, sleep, diet, or various activities of the user. User inputs can be open-ended or selected from a menu, for example. In an aspect, a correlation module correlates mood of the user to other factors, and control of stimulation is based thereon. In various aspects, the system is also responsive to inputs from sensors or computing networks. In an aspect, the earpiece delivers an audio output such as music from an audio player.

## Claims

### Claim 1

A computer program product comprising:
a non-transitory signal-bearing medium bearing:
one or more audio delivery instructions for controlling delivery of an audio signal from an audio signal source to an audio earpiece via an audio output of a personal computing device, the audio earpiece having operably coupled thereto an ear stimulation device configured to stimulate a nerve innervating a pinna of an ear of the user;
one or more mood assessment instructions for
receiving mood-related input from the user via a first input structure operably coupled to the personal computing device; and
assessing a mood of the user based at least in part upon the mood-related input;
one or more secondary factor input instructions for receiving at least one input relating to at least one secondary factor relating to the user via a second input structure operably coupled to the personal computing device;
one or more user control instructions for receiving via a third input structure of the personal computing device, at least one user control input for controlling at least one user-controllable stimulation parameter of the ear stimulation device;
one or more stimulator control instructions for determining at least one stimulus control parameter based on at least one of the mood of the user, the at least one secondary factor, and the at least one user control input; and
one or more controller interface instructions for communicating the at least one stimulus control parameter to a stimulator controller adapted to control the ear stimulation device responsive to the at least one stimulus control parameter.

### Claim 2 (depends on 1)

The computer program product of claim 1, wherein the one or more stimulator control instructions include one or more instructions for coordinating delivery of the audio signal with delivery of at least one stimulus with the ear stimulation device.

### Claim 3 (depends on 1)

The computer program product of claim 1, wherein the first input structure of the personal computing device includes a touch screen, a keyboard, or a microphone.

### Claim 4 (depends on 1)

The computer program product of claim 1, wherein the secondary input structure of the personal computing device includes at least one of a touch screen, a keyboard, a microphone, a device interface, a data input, a USB port, a wireless interface, a serial port, or a parallel port.

### Claim 5 (depends on 1)

The computer program product of claim 1, including one or more recommendation delivery instructions for presenting a recommendation to the user.

### Claim 6 (depends on 5)

The computer program product of claim 5, wherein the one or more recommendation delivery instructions include one or more instructions for generating the recommendation.

### Claim 7 (depends on 5)

The computer program product of claim 5, wherein the one or more recommendation delivery instructions include one or more instructions for receiving at least one of a recommendation from a medical care provider, a recommendation from an insurance company, a recommendation from a service provider, a recommendation from an advisor, a recommendation from a computation-based system, a recommendation from a social media source, a recommendation via a computing network, a recommendation based on patients similar to the user, or information regarding whether the user has accepted or rejected the recommendation.

### Claim 8 (depends on 5)

The computer program product of claim 5, wherein the one or more recommendation delivery instructions include one or more instructions for generating the recommendation based on at least one of information regarding a response of the user to a past treatment regimen, information obtained via social media, information regarding at least one preference of at least one social media contact of the user, information regarding at least one preference of at least one peer of the user, information regarding at least one preference of at least one role model of the user, information from an insurance company, information from a service provider, a predicted response of the user to a treatment regimen, or at least one correlation between the mood of the user and at least one of the at least one secondary factor or the at least one stimulus control parameter.

### Claim 9 (depends on 5)

The computer program product of claim 5, wherein the one or more recommendation delivery instructions include one or more instructions for presenting to the user at least one of a recommendation for a configuration of a neural stimulus or a recommendation for a secondary stimulus to be delivered in association with the neural stimulus.

### Claim 10 (depends on 1)

The computer program product of claim 1, including one or more physiological data instructions for receiving at least one physiological data signal including at least one physiological parameter of the user.

### Claim 11 (depends on 10)

The computer program product of claim 10, wherein the one or more physiological data instructions include one or more instructions for receiving the at least one physiological data signal from at least one of a blood pressure sensor, a heart rate sensor, a chemical sensor, a biosensor, a pH sensor, a blood oxygen sensor, a galvanic skin response sensor, an EEG sensor, an EMG sensor, an ECG sensor, a wearable item, an eye tracking system, an acoustic sensor, a motion sensor, a force transducer, or an activity sensor.

### Claim 12 (depends on 10)

The computer program product of claim 10, wherein the one or more physiological data instructions include one or more instructions for receiving the at least one physiological data signal from at least one of at least one sensor, at least one computing network, or at least one remote sensing system.

### Claim 13 (depends on 1)

The computer program product of claim 1, wherein the one or more user control instructions include one or more instructions for receiving user input for controlling at least one of stimulus pulse amplitude, stimulus pulse duration, stimulus frequency, stimulus pulse pattern, or stimulus pulse envelope.

### Claim 14 (depends on 1)

The computer program product of claim 1, including one or more external control instructions for receiving an external control input for controlling at least one externally controllable stimulation parameter of the ear stimulation device.

### Claim 15 (depends on 14)

The computer program product of claim 14, wherein the at least one externally controllable stimulation parameter includes at least one of stimulus pulse amplitude, stimulus pulse duration, stimulus frequency, stimulus pulse pattern, or stimulus pulse envelope.

### Claim 16 (depends on 14)

The computer program product of claim 14, wherein the one or more external control instructions include one or more instructions for receiving the external control input via a computing network or a communication network, receiving the external control input from an external party or entity, or receiving the external control input from a medical care provider.

### Claim 17 (depends on 1)

The computer program product of claim 1, including at least one of one or more correlation instructions for determining at least one correlation between the mood of the user and at least one of the at least one secondary factor and the at least one stimulus control parameter; or one or morel data transfer instructions for providing data relating to the user to an external party or entity.

### Claim 18 (depends on 1)

The computer program product of claim 1, wherein the audio signal source includes at least one of an audio player application, a web radio application, a radio receiver, a telephone receiver, or a hearing aid.

### Claim 19 (depends on 1)

The computer program product of claim 1, wherein the one or more mood assessment instructions includes at least one of one or more ecological momentary assessment instructions, one or more activity assessment instructions, or one or more image processing instructions for determining a mood of the user based on image analysis of an image of the user detected with a user-facing camera of the personal computing device.

### Claim 20 (depends on 1)

The computer program product of claim 1, wherein the one or more secondary factor input instructions include one or more instructions for receiving at least one of an input from the user, an input from a sensor, or an input via a computing network.

### Claim 21 (depends on 1)

The computer program product of claim 1, wherein the one or more secondary factor input instructions include one or more instructions for receiving at least one of an input relating to an environmental condition of the user, an input relating to a sleep pattern of the user, an input relating to a medical history of the user, an input relating to an activity of the user, an input relating to a diet of the user, or an input relating to an appetite of the user.

### Claim 22 (depends on 1)

The computer program product of claim 1, wherein the one or more secondary factor input instructions include one or more instructions for receiving at least one open ended comment from the user or to provide a drop down menu of selectable items and receive from the user a selection from the drop down menu.

### Claim 23 (depends on 17)

The computer program product of claim 17, wherein the one or more data transfer instructions include one or more instructions for providing the data to the external party or entity via at least one of a computing network or a communication network.

### Claim 24 (depends on 1)

The computer program product of claim 1, wherein the one or more stimulator control instructions include one or more instructions for determining the at least one stimulus control parameter by overriding the at least one user control input for controlling the at least one user-controllable stimulation parameter based on a medical-care provider control input; overriding a medical-care provider control input based on the at least one user control input for controlling the at least one user-controllable stimulation parameter; overriding the at least one user control input for controlling the at least one user-controllable stimulation parameter based on a computing system-generated stimulus control parameter; or overriding a computing system-generated stimulus control parameter based on the at least one user control input for controlling the at least one user-controllable stimulation parameter.

### Claim 25 (depends on 1)

The computer program product of claim 1, wherein the one or more stimulator control instructions include one or more instructions for determining the at least one stimulus control parameter to provide an initial setting of the ear stimulation device based on the at least one user-controllable stimulation parameter or to update a setting of the ear stimulation device based on the at least one user-controllable stimulation parameter.

### Claim 26

A method of controlling an ear stimulation device with a personal computing device, comprising:
receiving an audio signal at the personal computing device from an audio signal source;
delivering the audio signal to an audio earpiece worn by a user via an audio output of the personal computing device, the audio earpiece having operably coupled thereto an ear stimulation device configured to stimulate a nerve innervating a pinna of an ear of the user;
receiving, via a first input structure operably coupled to the personal computing device, a mood-related input from the user;
assessing a mood of the user based at least in part upon the mood-related input;
receiving, via a second input structure operably coupled to the personal computing device, at least one input relating to at least one secondary factor relating to the user;
receiving, via a third input structure operably coupled to the personal computing device, at least one user control input for controlling at least one user-controllable stimulation parameter of the ear stimulation device;
determining at least one stimulus control parameter based on at least one of the mood of the user, the at least one secondary factor, and the at least one user control input; and
communicating at least one stimulus control parameter to a stimulator controller, the stimulator controller adapted to control the ear stimulation device responsive to the at least one stimulus control parameter.

### Claim 27 (depends on 26)

The method of claim 26, including coordinating delivery of the audio signal with delivery of at least one stimulus with the ear stimulation device.

### Claim 28 (depends on 26)

The method of claim 26, including presenting a recommendation to the user.

### Claim 29 (depends on 28)

The method of claim 28, including receiving the recommendation from at least one of an external party, an external entity, an insurance company, a service provider, an advisor, a computation-based system, a social media source, or a computing network.

### Claim 30 (depends on 28)

The method of claim 28, including at least one of delivering the recommendation based on patients similar to the user; generating the recommendation; providing the recommendation to an external party or entity; or receiving information regarding whether the user has accepted or rejected the recommendation.

### Claim 31 (depends on 28)

The method of claim 28, including at least one of generating the recommendation module based at least in part on at least one correlation between the mood of the user and at least one of the at least one secondary factor or the at least one stimulus control parameter; generating the recommendation based on at least one of information regarding a response of the user to a past treatment regimen, information obtained via social media, information regarding at least one preference of at least one social media contact of the user, information regarding at least one preference of at least one peer of the user, information regarding at least one preference of at least one role model of the user, information from an insurance company, or information from a service provider; generating the recommendation with a computation-based system; or generating the recommendation based on a predicted response of the user to a treatment regimen.

### Claim 32 (depends on 28)

The method of claim 28, wherein presenting the recommendation includes at least one of presenting the recommendation for a configuration of a neural stimulus or presenting a recommendation for a secondary stimulus to be delivered in association with the neural stimulus.

### Claim 33 (depends on 26)

The method of claim 26, including receiving at least one physiological data signal including at least one physiological parameter of the user.

### Claim 34 (depends on 33)

The method of claim 33, wherein receiving the at least one physiological data signal includes at least one of
receiving the at least one physiological data signal from a sensor;
receiving the at least one physiological data signal from a sensor located on the audio earpiece operably coupled to the ear stimulation device;
receiving the at least one physiological data signal from a sensor located on a second audio earpiece located on a second ear of the user, wherein the audio earpiece having the ear stimulation device operably coupled thereto is a first audio earpiece worn on a first ear of the user;
receiving the at least one physiological data signal from at least one computing network;
receiving the at least one physiological data signal from at least one remote sensing system; or
receiving the at least one physiological data signal from at least one of a blood pressure sensor, a heart rate sensor, a chemical sensor, a biosensor, a pH sensor, a blood oxygen sensor, a galvanic skin response sensor, an EEG sensor, an EMG sensor, an ECG sensor, a wearable item, an eye tracking system, an acoustic sensor, a motion sensor, a force transducer, or an activity sensor.

### Claim 35 (depends on 26)

The method of claim 26, wherein receiving the at least one user control input for controlling the at least one user-controllable stimulation parameter includes receiving at least one user input for controlling at least one of stimulus pulse amplitude, stimulus pulse duration, stimulus frequency, stimulus pulse pattern, or stimulus pulse envelope.

### Claim 36 (depends on 26)

The method of claim 26, wherein receiving the audio signal at the personal computing device from the audio signal source includes at least one of receiving the audio signal from an audio player application, receiving the audio signal from a web radio application, receiving the audio signal from a radio receiver, receiving the audio signal from a telephone receiver, or receiving the audio signal from a hearing aid.

### Claim 37 (depends on 26)

The method of claim 26, wherein receiving the mood-related input includes at least one of receiving user input via a user interface device or; receiving an image of the user with a user-facing camera of the personal computing device and determining a mood of the user based on image analysis of the image of the user with image processing software; or receiving at least one input via a touch screen, a keyboard, or a microphone.

### Claim 38 (depends on 26)

The method of claim 26, wherein receiving the mood-related input includes receiving mood-related input relating to at least one of depression, stress, or emotion.

### Claim 39 (depends on 26)

The method of claim 26, wherein receiving the at least one input relating to the at least one secondary factor includes at least one of receiving at least one input via at least one of a touch screen, a keyboard, a microphone, a device interface, a data input, a USB port, a wireless interface, a serial port, or a parallel port; receiving at least one input from the user; receiving at least one input from a sensor; receiving at least one input via a computing network; receiving at least one input relating to an environmental condition of the user; receiving at least one input relating to a sleep pattern of the user; receiving at least one input relating to an activity of the user; receiving at least one input relating to a diet of the user; receiving at least one input relating to an appetite of the user; receiving at least one open ended comment from the user; or providing a drop down menu of selectable items and receiving from the user a selection from the drop down menu.

### Claim 40 (depends on 26)

The method of claim 26, including at least one of determining at least one correlation between the mood of the user and at least one of the at least one secondary factor and the at least one stimulus control parameter; receiving an external control input for controlling at least one externally controllable stimulation parameter of the ear stimulation device; or providing data relating to the user to an external party or entity.

### Claim 41 (depends on 26)

The method of claim 26, including receiving an external control input for controlling at least one externally controllable stimulation parameter of the ear stimulation device; wherein receiving the external control input includes at least one of receiving the external control input via a computing network; receiving the external control input via a communication network; receiving the external control input from an external party or entity; or receiving the external control input from a medical care provider.

### Claim 42 (depends on 26)

The method of claim 26, including providing data relating to the user to an external party or entity, wherein providing the data to the external party or entity includes at least one of providing the data via a computing network, providing the data via a communication network, or providing the data to a medical care provider.

### Claim 43 (depends on 26)

The method of claim 26, wherein determining the at least one stimulus control parameter includes at least one of overriding the at least one user control input for controlling the at least one user-controllable stimulation parameter based on a medical-care provider control input; overriding a medical-care provider control input based on the at least one user control input for controlling the at least one user-controllable stimulation parameter; overriding the at least one user control input for controlling the at least one user-controllable stimulation parameter based on a computing system-generated stimulus control parameter; overriding a computing system-generated stimulus control parameter based on the at least one user control input for controlling the at least one user-controllable stimulation parameter; determining an initial setting of the ear stimulation device based on the at least one user-controllable stimulation parameter; or updating a setting of the ear stimulation device based on the at least one user-controllable stimulation parameter.
