# US 10,369,323 B2 · Sonification of biometric data, state-songs generation, biological simulation modelling, and artificial intelligence

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,369,323 B2
- Document ID: US10369323B2
- Status: Granted
- Kind: B2
- Application number: 15/642,691
- Filed: 2017-07-06
- Published: 2017-11-16
- Granted: 2019-08-06
- Earliest claimed: 2016-01-15
- Applicants: Robert Mitchell Joseph
- Inventors: Robert Mitchell Joseph
- Web page: https://patentgrep.com/patent/US10369323B2

## CPC

- A61M 21/00: Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61B 5/486: {Biofeedback (using electroencephalography [EEG] A61B5/375)}
- A61M 21/02: for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia (for massage A61H; electrotherapy A61N, e.g. applying alternating or intermittent electric currents for producing anaesthesia A61N1/36021)
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/50: for simulation or modelling of medical disorders
- A61M 2021/0027: {by the hearing sense}
- A61M: DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY (introducing media into or onto the bodies of animals A61D7/00; means for inserting tampons A61F13/26; devices for administering food or medicines orally A61J; containers for collecting, storing or administering blood or medical fluids A61J1/05); DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY (surgery A61B; chemical aspects of surgical articles A61L); DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR {(Electrotherapy, e.g. producing anaesthesia by the use of alternating or intermittent currents A61N1/36021)}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

Embodiments are generally directed to methods, systems and devices for generating and playing back a personalized state song representing a target state of a user. In one scenario, a computer system accesses biometric data corresponding to various bodily systems of a user. The computer system encodes the biometric data into data structures that are configured for modeling using an algorithm that is specific to the user. The computer system models the encoded biometric data to identify specified patterns in the encoded biometric data, and these identified patterns are used to generate a personalized algorithm that corresponds with the identified patterns unique to the user. The computer system then synthesizes a state song using the personalized algorithm, which represents a specific biometric state for one of the bodily systems, and plays back the state song to the user to induce the user to the specific biometric state.

## Claims

### Claim 1

A method, implemented at a computer system that includes at least one processor, for generating and playing back a personalized state song representing a target state of a user, the method comprising:
accessing one or more portions of biometric data corresponding to one or more bodily systems of the user;
encoding the one or more portions of biometric data into data structures that are configured for modeling using an algorithm that is specific to the user;
modeling the encoded biometric data to identify one or more specified patterns, found in rhythmic recurrences of at least one of frequencies and amplitudes, or repeated highs and lows, in the encoded biometric data, the identified patterns being used to generate a personalized algorithm that corresponds with the identified patterns unique to the user, the personalized algorithm comprising lines of sound which sonify the encoded biometric data;
synthesizing a state song using the personalized algorithm, the state song representing a specific biometric state for at least one of the bodily systems, using the lines of sound to create endogenous music; and
playing back the state song to the user to induce the user to the specific biometric state.

### Claim 2 (depends on 1)

The method of claim 1, wherein modeling the encoded biometric data further comprises:
identifying one or more relationships between different types of biometric data;
wherein generating the personalized algorithm implements as input the identified relationships between the different types of biometric data.

### Claim 3 (depends on 2)

The method of claim 2, wherein the different types of biometric data are received from specialized biomedical devices.

### Claim 4 (depends on 1)

The method of claim 1, wherein the encoding is performed at a transcoding engine that includes an encoding layer configured to encode the biometric data into musical elements by mapping the biometric data according to at least one of sampling rate, filters, reverb or compression.

### Claim 5 (depends on 4)

The method of claim 4, wherein a default mapping is established for each type of biometric data.

### Claim 6 (depends on 1)

The method of claim 1, wherein the encoding is performed at a transcoding engine that includes an encoding layer configured to encode the biometric data into musical elements by mapping different types of the biometric data to different instruments or sounds.

### Claim 7 (depends on 6)

The method of claim 6, wherein an artificial intelligence engine is implemented to learn musical patterns that make music acoustically desirable, and wherein the learned musical patterns are used when mapping different types of biometric data to the instruments or sounds.

### Claim 8 (depends on 1)

The method of claim 1, wherein the state song is played back to the user in reaction to the user reaching a specified, undesirable biometric state.

### Claim 9 (depends on 1)

The method of claim 1, wherein the state song is played back to the user proactively to prevent the user from reaching a specified, undesirable biometric state.

### Claim 10 (depends on 1)

The method of claim 1, further comprising rendering a graph that is an isomorphic representation of the one or more portions of biometric data to create a digital twin of the user.

### Claim 11

A computer system, comprising:
one or more processors;
system memory;
a data accessing module configured to access one or more portions of biometric data representing operations of one or more bodily systems of a user;
an encoding layer configured to encode the one or more portions of biometric data, wherein encoding prepares the data for modeling at a modeling layer;
the modeling layer configured to identify one or more specified patterns, found in rhythmic recurrences of at least one of frequencies and amplitudes, or repeated highs and lows, in the encoded biometric data, wherein the identified patterns are used to generate a personalized algorithm that corresponds with the identified patterns unique to the user, the personalized algorithm comprising lines of sound which sonify the encoded biometric data;
a synthesis layer that uses the personalized algorithm to synthesize a state song representing a specific biometric state for at least one of the bodily systems, using the lines of sound to create endogenous music; and
a playback module that plays the synthesized state song back to the user to induce the user to the specific biometric state.

### Claim 12 (depends on 11)

The computer system of claim 11, wherein identifying specified patterns in the encoded biometric data further comprises identifying noise in the biometric data.

### Claim 13 (depends on 11)

The computer system of claim 11, further comprising a filtering layer that is configured to filter at least a portion of identified noise in the biometric data.

### Claim 14 (depends on 11)

The computer system of claim 11, further comprising an artificial intelligence layer configured to examine one or more existing songs and provide one or more musical elements as input to the synthesis layer indicating how the state song is to be generated.

### Claim 15 (depends on 11)

The computer system of claim 11, further comprising a sharing layer configured to provide the synthesized state song to one or more other users.

### Claim 16 (depends on 11)

The computer system of claim 11, further comprising a graphical user interface (GUI) that allows users to specify how biometric data from different biological systems is to be mapped to, instruments, or sounds.

### Claim 17

A method, implemented at a computer system that includes at least one processor, for controlling state dependent behaviors of a user, the method comprising:
obtaining biometric data from one or more data capture devices placed in contact with the user, the biometric data comprising different types of biometric data;
associating at least some of the obtained biometric data with a plurality of specified instruments or sounds, each instrument or sound being mapped to a different type of biometric data;
compiling at least some of the instruments or sounds into a composition or song of endogenous music arranged to represent a targeted state; and
providing the composition or song back to the user to induce the user to the targeted state.

### Claim 18 (depends on 17)

The method of claim 17, wherein endogenous music is combined with exogenous music.

### Claim 19 (depends on 17)

The method of claim 17, further comprising providing one or more genre filters for the obtained biometric data.

### Claim 20 (depends on 17)

The method of claim 17, wherein the biometric data is moved to a service oriented architecture (SOA) that provides one or more services including distributed processing and distributed storage.
