# US 11,298,551 B2 · Spherical input and output methods and devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,298,551 B2
- Document ID: US11298551B2
- Status: Granted
- Kind: B2
- Application number: 16/991,032
- Filed: 2020-08-12
- Published: 2020-11-26
- Granted: 2022-04-12
- Earliest claimed: 2016-12-30
- Applicants: iOSphere Labs
- Inventors: Jason F Heath
- Web page: https://patentgrep.com/patent/US11298551B2

## CPC

- A61N 1/37247: {User interfaces, e.g. input or presentation means}
- A63B 43/004: {electrically conductive, e.g. for automatic arbitration}
- A63B 71/0622: {Visual, audio or audio-visual systems for entertaining, instructing or motivating the user}
- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- G06F 1/16: Constructional details or arrangements
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/02: Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F 3/0202: {Constructional details or processes of manufacture of the input device}
- G06F 3/0219: {Special purpose keyboards}
- G06F 3/0414: {using force sensing means to determine a position}
- G06F 3/044: by capacitive means
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G09B 5/06: with both visual and audible presentation of the material to be studied
- G09B 15/00: Teaching music (metronomes G04F5/02)
- G10H 1/0008: {Associated control or indicating means}
- G10H 1/0551: {using variable capacitors}
- G10H 1/344: {Structural association with individual keys (electrically operated wind-actuated organs G10B3/22)}
- A63B 2071/0625: {Emitting sound, noise or music}
- A63B 2220/30: Speed
- A63B 2220/56: Pressure
- G10H 1/32: Constructional details
- G10H 2220/116: for graphical editing of sound parameters or waveforms, e.g. by graphical interactive control of timbre, partials or envelope
- G10H 2220/155: User input interfaces for electrophonic musical instruments
- G10H 2220/391: Angle sensing for musical purposes, using data from a gyroscope, gyrometer or other angular velocity or angular movement sensing device
- G10H 2220/395: Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing
- G10H 2240/211: Wireless transmission, e.g. of music parameters or control data by radio, infrared or ultrasound
- G16H 20/70: relating to mental therapies, e.g. psychological therapy or autogenous training
- A61N: ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY (measurement of bioelectric currents A61B; surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body A61B18/00; anaesthetic apparatus in general A61M; incandescent lamps H01K; infrared radiators for heating H05B)
- A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

Described herein are embodiments of sensorized spherical input and output devices, systems, and methods for capturing gestural input from a user's physical interactions with a spherical device, including tossing, bouncing and spinning. In one embodiment, the spherical input and output device includes force sensors in a configuration to capture a variety of user gestures with the sphere. A microprocessor receives sensor input and transmits the sensor data to receiving devices which include computer software to translate the sensor signals to audio output, visual output, or various functions on receiving devices. Embodiments of the invention include the integration of inertial measurement units (IMUs), which may include a combination of accelerometers, gyroscopes and magnetometers to capture complex user gestures involving motion, direction and spin of the sensorized sphere in three dimensional space.

## Claims

### Claim 1

A method of generating musical outputs from a spherical input and output device, comprising the steps of:
tossing said device against a surface of an object to generate a return movement; activating a sensor embedded under a compressive material of said device to generate a force signal corresponding to the impact of said device against said surface;
activating an inertial measurement unit sensor to generate an inertial measurement unit signal corresponding to the acceleration, velocity or spin of said return movement;
processing said force signal to generate force data;
processing said inertial measurement unit signal to generate inertial measurement data;
transmitting said force data and said inertial measurement data to a receiving device electrically coupled to the spherical input and output device;
translating said force data and said inertial measurement unit data to generate a musical output corresponding to the force and one of acceleration, velocity or rotation of the return movement.

### Claim 2 (depends on 1)

The method of claim 1 wherein force data and Inertial Measurement Unit data is translated into a data output in the format of at least one of Musical Instrument Digital Interface (MIDI) data or OSC (Open Sound Control) data.

### Claim 3 (depends on 1)

The method of claim 1, further including an algorithm for translating the force data to generate an audio output, wherein the intensity of the audio output is based on the amplitude of the force signal.

### Claim 4 (depends on 1)

The method of claim 1, further including an algorithm for translating the rotation of said device to generate audio output modified by at least one of sample playback speed, filter sweeps, frequency, or panning.

### Claim 5 (depends on 1)

The method of claim 1, further including an algorithm for translating combinations of Inertial Measurement Unit data, including data representing an altitude of said device or other calculations of position, orientation, or movement in three-dimensional space of said device into modifications of said musical output based at least one of timbre, tone, rhythm, melody, frequency, or pitch.

### Claim 6 (depends on 1)

The method of claim 1, further including an algorithm for translating a temporal interval between successive impacts of said device against said surface wherein the musical output is timed for playback from a set of pre-determined options based on a series of temporal interval thresholds.

### Claim 7 (depends on 1)

The method of claim 1, further including an algorithm for translating said force data to generate a lighting effect on said device based on the intensity of impact of said device against said surface.

### Claim 8 (depends on 1)

The method of claim 1, further including an algorithm for processing the intensity of said force signal to generate force data that is further translated into a lighting output wherein colors of said lighting output based on the intensity of impact of said device against said surface.

### Claim 9

A spherical input and output device for capturing a return movement from tossing said device against a surface, said device comprising:
a compressive outer shell for absorbing the force of said device against said surface;
a protected inner core with a power source for powering electrical components comprising:
a sensor for capturing a force of impact of said device against said surface to generate force signals;
an inertial measurement unit sensor for measuring the return movement of said device to generate inertial measurement signals corresponding to acceleration, velocity or spherical rotation of said device;
a microprocessor for processing force signals and inertial measurement signals for generating force data and inertial measurement unit data;
a transceiver for transmitting force data and inertial measurement unit data to a receiving device electrically coupled to the spherical input and output device,
said receiving device comprising:
an algorithm for translating said force data and said inertial measurement unit data to generate a musical output corresponding to the force and one of acceleration, velocity or spin of the return movement.

### Claim 10 (depends on 9)

The device of claim 9 wherein said device includes an outer protective material made of at least one of rubber, silicone, plastic, glass, wood, fabric, or a synthetic polymer.

### Claim 11 (depends on 10)

The device of claim 10 wherein the inner core of said device is protected, and suspended through symmetrical distribution of weight in the center of the device.

### Claim 12 (depends on 10)

The device of claim 10 wherein the outer shell of said device is constructed of a synthetic polymer or a combination synthetic polymers to facilitate the return movement of the device.

### Claim 13 (depends on 10)

The device of claim 10 which includes at least one video camera embedded on the outer shell.

### Claim 14 (depends on 10)

The device of claim 10 wherein the outer shell of said device is constructed of a series of individual panels arranged in such a way as to form a spherical shaped covering.

### Claim 15 (depends on 10)

The device of claim 10 further comprising at least one Light Emitting Diode (LED) or other light emitting elements.

### Claim 16 (depends on 10)

The device of claim 10 further comprising at least one haptic motor to provide the user with tactile feedback.

### Claim 17 (depends on 10)

The device of claim 10 further comprising at least one video display screen on the outer shell of said device.

### Claim 18 (depends on 10)

The device of claim 10 wherein the outer shell is constructed of a transparent or translucent material optimized for light diffusion through the outer shell.

### Claim 19 (depends on 10)

The device of claim 10 further comprising a tactile matrix sensor array on said outer shell optimized to detect touch and impact on the surface of said device, such that a user can hold or grip the device from any direction and their fingertips will land on at least one tactile element of said tactile matrix.