# US 11,439,896 B2 · Mental and physical challenge through recalling and inputting a sequence of touch inputs and/or sound inputs

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,439,896 B2
- Document ID: US11439896B2
- Status: Granted
- Kind: B2
- Application number: 16/404,754
- Filed: 2019-05-07
- Published: 2020-11-12
- Granted: 2022-09-13
- Earliest claimed: 2019-05-07
- Applicants: Dennis Fountaine
- Inventors: Dennis Fountaine
- Web page: https://patentgrep.com/patent/US11439896B2

## CPC

- A63F 13/212: using sensors worn by the player, e.g. for measuring heart beat or leg activity
- A63F 13/214: for locating contacts on a surface, e.g. floor mats or touch pads
- A63F 13/215: comprising means for detecting acoustic signals, e.g. using a microphone
- A63F 13/235: using a wireless connection, e.g. infrared or piconet
- A63F 13/245: specially adapted to a particular type of game, e.g. steering wheels
- A63F 13/352: involving special game server arrangements, e.g. regional servers connected to a national server or a plurality of servers managing partitions of the game world
- A63F 13/424: involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
- A63F 13/46: Computing the game score
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/08: Speech classification or search
- A63F 2300/1081: Input via voice recognition
- G10L 15/00: Speech recognition (G10L17/00 takes precedence)
- G10L 2015/088: {Word spotting}
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Disclosed are a method, a device, a system, and/or a manufacture of a mental and physical challenge through recalling and inputting a sequence of touch inputs and/or sound inputs. In one embodiment, a device for engaging a user in a mental and/or physical challenge includes a platform capable of laying substantially flat on a surface, two or more touch sensors attached to the platform for receiving a touch input from the user, two or more visual indicators of the platform, a speaker for providing a sound indicator, and a microphone for receiving a sound input from the user. A computer memory includes a sequence data specifying a set of inputs, a sequence indication routine for generating an input indication of the sequence data, and a comparison routine for comparing the sequence data to the input data to provide a score and/or a rank. The challenge may be set to music.

## Claims

### Claim 1

A system for engaging a user in a mental and/or physical challenge, the system comprising:
an input platform comprising:
a platform,
two or more touch sensors attached to the platform for receiving a touch input from the user,
two or more visual indicators at least one of attached to and attachable to the platform, at least one of the two or more visual indicators associated with at least one of the two or more touch sensors,
a processor of the input platform,
a computer memory of the input platform,
a network interface controller of the input platform, and
a mobile device comprising:
a display,
a processor of the mobile device,
a computer memory of the mobile device, comprising:
a sequence data comprising data specifying at least one of an order of an input, a timing of the input, and a duration of the input;
a sequence indication routine comprising computer readable instructions that when executed at least one of generate an input indication of at least a portion of the sequence data on the display of the mobile device and transmits a sequence indication data to the input platform to generate the input indication to the user on at least one of the two or more visual indicators of the input platform,
a sequence initiation routine comprising computer readable instructions that when executed generates an input data comprising a touch input data received from one or more of the two or more touch sensors of the input platform,
a comparison routine comprising computer readable instructions that when executed compares the sequence data to the input data to determine a match, and
a termination condition comprising data specifying one or more conditions under which the comparison routine terminates, and
a challenge server comprising:
a processor of the challenge server,
a sequence database comprising the sequence data,
a score database, and
a memory of the challenge server comprising computer readable instructions that when executed on the processor of the challenge server:
transmit the sequence data to the mobile device; and
receive at least one of a score and rating based on the match determined by the comparison of the sequence data to the input data, and
a voice controlled device, comprising:
a processor of the voice controlled device,
a network interface controller of the voice controlled device,
a speaker,
a microphone,
a memory of the voice controlled device comprising computer readable instructions that when executed on the processor of the voice controlled device:
generate a sound input data, where the sound input data further comprises a sound input received from the microphone; and
transmit the sound input data to the mobile device,
wherein the input data further comprises the sound input data, and
a voice server comprising:
a processor of the voice server,
a memory of the voice server comprising computer readable instructions that when executed on the processor of the voice server:
receive the sound input from the voice controlled device, and
a speech recognition engine comprising computer readable instructions that when executed on the processor of the voice server determine a word from the sound input received from the voice controlled device, and
a network communicatively coupling the input platform, the mobile device, the voice controlled device, the voice server, and the challenge server.

### Claim 2 (depends on 1)

The system of claim 1, wherein the mobile device further comprising:
a sequence creation routine comprising computer readable instructions that when executed on the processor of the mobile device at least one of records a user sequence data that is an instance of the sequence data based on the input data of the user, and
a share module for at least one of uploading the user sequence data to at least one of a server computer and a computing device of a different user.

### Claim 3 (depends on 2)

The system of claim 2, wherein the challenge server further comprising:
a user content database comprising the user sequence data.

### Claim 4 (depends on 3)

The system of claim 3, further comprising:
a proximity beacon attachable to the user and communicatively coupled to the touch input of the input platform.

### Claim 5 (depends on 4)

The system of claim 4, wherein the sequence initiation routine further comprising computer readable instructions that when executed:
generate a visual indication of the touch input, and
generate a sound indication of the sound input,
wherein at least one of the two or more visual indicators is a light at least one of within at least one of the two or more the touch sensors and proximately associated with the at least one of the two or more touch sensors, and the computer memory of the mobile device further comprising computer readable instructions that when executed illuminate the light,
wherein the proximity beacon attachable to an extremity of the user is at least one of an input glove and an input sock,
wherein the input data is associated with the score based on at least one of the order of the input, the timing of the input, and the duration of the input,
wherein at least one of the order, the timing, and the duration is set to a music,
wherein the sequence data receivable over at least one of the network interface controller of the mobile device and the network interface controller of the voice controlled device, and
wherein the sound indication is the word.

### Claim 6

A system for engaging a user in a mental and/or physical challenge, the system comprising:
an input platform comprising:
a platform,
two or more touch sensors attached to the platform for receiving a touch input from the user,
two or more visual indicators at least one of attached to and attachable to the platform, at least one of the two or more visual indicators associated with at least one of the two or more touch sensors,
a processor of the input platform,
a computer memory of the input platform,
a network interface controller of the input platform, and
a voice controlled device comprising:
a speaker
a microphone
a processor of the voice controlled device,
a computer memory of the voice controlled device storing a voice application, the voice application comprising:
a sequence data comprising data specifying at least one of an order of an input, a timing of the input, and a duration of the input;
a sequence indication routine comprising computer readable instructions that when executed on the processor of the voice controlled device at least one of generate an input indication of at least a portion of the sequence data on the speaker of the voice controlled device and transmit a sequence indication data to the input platform to generate the input indication to the user on at least one of the two or more visual indicators of the input platform,
a sequence initiation routine comprising computer readable instructions that when executed on the processor of the voice controlled device generate an input data comprising a touch input data received from one or more of the two or more touch sensors of the input platform,
a comparison routine comprising computer readable instructions that when executed on the processor of the voice controlled device compare the sequence data to the input data to determine a match, and
a voice server comprising:
a processor of the voice server,
a memory of the voice server comprising computer readable instructions that when executed on the processor of the voice server:
receive a sound input from the voice controlled device, and
a speech recognition engine comprising computer readable instructions that when executed on the processor of the voice server determine a word from the sound input received from the voice controlled device,
wherein the voice controlled device further comprises a network interface controller of the voice controlled device, and
a network communicatively coupling the input platform, the voice controlled device, and the voice server.

### Claim 7 (depends on 6)

The system of claim 6, further comprising:
the voice controlled device further comprising:
a sequence creation routine comprising computer readable instructions that when executed on the processor of the voice controlled device at least one of records a user sequence data that is an instance of the sequence data based on the input data of the user.

### Claim 8 (depends on 7)

The system of claim 7, further comprising:
a challenge server comprising:
a processor of the challenge server,
a sequence database comprising the sequence data,
a score database, and
a memory of the challenge server comprising computer readable instructions that when executed on the processor of the challenge server:
transmit the sequence data to the voice controlled device; and
receive at least one of a score and rating based on the match determined by the comparison of the sequence data to the input data, and
a proximity beacon attachable to the user and communicatively coupled to the touch input of the input platform.

### Claim 9 (depends on 8)

The system of claim 8, further comprising:
the voice controlled device further comprising:
a share module for at least one of uploading the user sequence data to at least one of a server computer and a computing device of a different user.

### Claim 10 (depends on 9)

The system of claim 9, further comprising:
the challenge server further comprising:
a user content database comprising the user sequence data, and
the sequence initiation routine further comprising computer readable instructions that when executed:
generate a visual indication of the touch input; and
generate a sound indication of the sound input.

### Claim 11 (depends on 10)

The system of claim 10,
wherein at least one of the two or more visual indicators is a light at least one of within at least one of the two or more the touch sensors and proximately associated with the at least one of the two or more touch sensors, and the computer memory of the voice controlled device further comprising computer readable instructions that when executed on the processor of the voice controlled device illuminate the light,
wherein the proximity beacon attachable to an extremity of the user is at least one of an input glove and an input sock,
wherein the input data is associated with the score based on at least one of the order of the input, the timing of the input, and the duration of the input,
wherein at least one of the order, the timing, and the duration is set to a music,
wherein the sequence data receivable over at least one of the network interface controller of the voice controlled device and the network interface controller of the voice controlled device, and
wherein the sound indication is the word.