# US 2025/0140222 A1 · Gesture-based audio synthesizer controller

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0140222 A1
- Document ID: US20250140222A1
- Status: Published application
- Kind: A1
- Application number: 18/686,641
- Filed: 2022-08-25
- Published: 2025-05-01
- Earliest claimed: 2021-08-27
- Applicants: Little People Big Noise Limited
- Inventors: Kelcey Robert Swain
- Web page: https://patentgrep.com/patent/US20250140222A1

## CPC

- G10H 1/0008: {Associated control or indicating means}
- G01C 21/16: by integrating acceleration or speed, i.e. inertial navigation
- G10H 7/002: {using a common processing for different operations or calculations, and a set of microinstructions, e.g. programs, to control the sequence thereof}
- G10H 7/04: in which amplitudes are read at varying rates, e.g. according to pitch
- G10H 2220/185: Stick input, e.g. drumsticks with position or contact sensors
- G10H 2220/365: Bow control in general, i.e. sensors or transducers on a bow; Input interface or controlling process for emulating a bow, bowing action or generating bowing parameters, e.g. for appropriately controlling a specialised sound synthesiser
- G10H 2220/391: Angle sensing for musical purposes, using data from a gyroscope, gyrometer or other angular velocity or angular movement sensing device
- G10H 2220/395: Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing
- G10H 2220/401: 3D sensing, i.e. three-dimensional (x, y, z) position or movement sensing
- G10H 2250/101: Filter coefficient update; Adaptive filters, i.e. with filter coefficient calculation in real time
- G10H 2250/435: Gensound percussion, i.e. generating or synthesising the sound of a percussion instrument; Control of specific aspects of percussion sounds, e.g. harmonics, under the influence of hitting force, hitting position, settings or striking instruments such as mallet, drumstick, brush or hand
- G10H 2250/471: General musical sound synthesis principles, i.e. sound category-independent synthesis methods
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)

## Abstract

A method of generating audio synthesizer control signals, the method comprising: receiving at a processing component, from a multi-dimensional orientation sensor of a controller device, inputs denoting sensed changes in orientation of the control device in first and second angular dimensions; processing the inputs to generate audio synthesizer control signals; and outputting the audio synthesizer control signals to an audio synthesizer; wherein the audio synthesizer control signals cause a first audible characteristic of the audio signal to be varied responsive to changes in orientation in the first angular dimension, and a second audible characteristic of the audio signal to be varied responsive to changes in orientation of the control device in the second angular dimension.

## Claims

### Claim 1

A method of generating audio synthesizer control signals, the method comprising:
receiving at a processing component, from a multi-dimensional orientation sensor of a controller device, inputs denoting sensed changes in orientation of the control device in first and second angular dimensions;
processing the inputs to generate audio synthesizer control signals; and
outputting the audio synthesizer control signals to an audio synthesizer;
wherein the audio synthesizer control signals cause a first audible characteristic of the audio signal to be varied as a function of absolute orientation of the control device as measured in the first angular dimension, and
a second audible characteristic of the audio signal to be varied responsive to changes in orientation of the control device as a function of speed of the control device measured across the first and second angular dimensions.

### Claim 2

(canceled)

### Claim 3

(canceled)

### Claim 4 (depends on 1)

The method of claim 1, wherein the second audible characteristic comprises an amplitude of the audio signal, the amplitude increasing with increases in the speed.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first angular dimension is a pitch dimension and the second angular dimension is a yaw dimension.

### Claim 6 (depends on 1)

The method of claim 1, wherein the audio synthesizer control signals cause the first audible characteristic to be varied as a function of absolute orientation of the control device as measured in the first angular dimension.

### Claim 7 (depends on 6)

The method of claim 6, wherein the first angular dimension is a pitch dimension and the second angular dimension is a yaw dimension, and wherein the absolute orientation is a pitch angle above or below a horizontal plane lying perpendicular to the direction of gravity.

### Claim 8 (depends on 7)

The method of claim 7, wherein the first audible characteristic is varied as a quantized function of the pitch angle.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first audible characteristic comprises a frequency of the audio signal.

### Claim 10

(canceled)

### Claim 11 (depends on 1)

The method of claim 1, wherein the inputs denote sensed changes in orientation of the control device in a third angular dimension, and the audio synthesizer control signals cause a third audible characteristic of the audio signal to be varied responsive to changes in orientation of the control device in the third angular dimension.

### Claim 12

(canceled)

### Claim 13 (depends on 11)

The method of claim 11, wherein the third angular dimension is a rotational dimension, such that the third audible characteristic is varied by rotating the control device about a longitudinal axis of the control device.

### Claim 14 (depends on 13)

The method of claim 13, wherein the third audible characteristic is varied as a function of roll angle.

### Claim 15 (depends on 1)

The method of claim 1, wherein the audio synthesizer generates the audio signal via granular synthesis applied to an audio sample based on a time position within the audio sample, wherein changes in the orientation of the control device in the first angular dimension cause the time position within the audio sample to be changed.

### Claim 16 (depends on 15)

The method of claim 15, wherein the audio synthesizer control signals cause the first audible characteristic to be varied as a function of absolute orientation of the control device as measured in the first angular dimension and the time position within the audio sample is varied as a function of the absolute orientation of the control device as measured in the first angular dimension.

### Claim 17 (depends on 15)

The method of claim 15, further comprising:
receiving an audio sample from an audio capture device of the control device;
providing the audio sample to the audio synthesizer for generating the audio signal via said granular synthesis.

### Claim 18 (depends on 1)

The method of claim 1, wherein the inputs comprise accelerometer, magnetometer and gyroscope readings, and the method comprises:
applying a Kalman or non-Kalman filter to the inputs, in order to measure the orientation changes in the first and second angular dimensions.

### Claim 19

A method of generating audio synthesizer control signals, the method comprising:
receiving at a processing component, from an orientation sensor of a controller device, inputs denoting sensed angular velocity of the control device in at least one angular dimension;
processing the inputs to detect a strike action, as a peak in said angular velocity above a strike threshold; and
in response to detecting the hit action, outputting a percussion control signal to an audio synthesiser to cause the audio synthesiser to output an audio signal.

### Claim 20 (depends on 19)

The method of claim 19, wherein the orientation sensor comprises a gyroscope and the hit action is detected from raw angular velocity measurements provided by the gyroscope.

### Claim 21 (depends on 19)

The method of claim 19, wherein the hit action is detected from a current measurement angular velocity and two preceding measurements only.

### Claim 22 (depends on 19)

The method of claim 19, wherein a sign of the peak is used to determine a sound selection parameter, whereby strike actions in different directions trigger different sounds.

### Claim 23 (depends on 22)

The method of claim 22, wherein the gyroscope measures pitch and yaw angular velocity, wherein:
a positive peak in yaw angular velocity above a first strike threshold triggers a first sound,
a negative peak in yaw angular velocity below a second strike threshold triggers a second sound,
a positive peak in pitch angular velocity above the first or a third strike threshold triggers a third sound, and
a negative peak in pitch angular velocity above the second or a fourth strike threshold triggers a fourth sound.

### Claim 24

(canceled)

### Claim 25

(canceled)

### Claim 26

An audio synthesizer control device for generating audio synthesizer control signals, the audio synthesizer control device comprising:
an elongated body comprising a handle portion lying along a longitudinal axis of the elongated body and an arm portion extending outwardly from the handle portion along the longitudinal axis, the elongated body supporting:
a multi-dimensional orientation sensor, located in or on in the arm portion, and configured to sense changes in orientation of the audio synthesizer control device in multiple angular dimensions; and
a computer coupled to the multi-dimensional orientation sensor and configured to process inputs from the multi-dimensional orientation sensor, and generate audio synthesizer control signals for controlling multiple audio signal characteristics based on sensed changes in orientation in the multiple angular dimensions.
