# US 2020/0272264 A1 · Step sequencer for a virtual instrument

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0272264 A1
- Document ID: US20200272264A1
- Status: Published application
- Kind: A1
- Application number: 16/775,012
- Filed: 2020-01-28
- Published: 2020-08-27
- Earliest claimed: 2017-09-29
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Joshua W. Decker; Robert W. Baker
- Web page: https://patentgrep.com/patent/US20200272264A1

## CPC

- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/0487: using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G10H 1/0008: {Associated control or indicating means}
- G10H 1/0016: {Means for indicating which keys, frets or strings are to be actuated, e.g. using lights or leds}
- G10H 1/0066: {using a MIDI interface}
- G10H 1/0083: {using wireless transmission, e.g. radio, light, infrared}
- G10H 1/34: Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments
- G10H 1/40: Rhythm
- G10H 1/42: comprising tone forming circuits
- G10H 2220/096: using a touch screen
- G10H 2220/101: for graphical creation, edition or control of musical data or parameters
- G10H 2220/106: using icons, e.g. selecting, moving or linking icons, on-screen symbols, screen regions or segments representing musical elements or parameters
- G10H 2240/056: MIDI or other note-oriented file format
- G10H 2250/641: Waveform sampler, i.e. music samplers; Sampled music loop processing, wherein a loop is a sample of a performance that has been edited to repeat seamlessly without clicks or artifacts
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE

## Abstract

A method of operating a UI for controlling a virtual musical instrument implemented can include receiving an input corresponding to a selection of a cell within a particular array of cells arranged in a sequential arrangement within a cell matrix, each array of the cell matrix assigned to MIDI notes associated with audio sample data stored in a computer-readable medium that, when triggered, causes the audio sample data to output corresponding audio, and each cell within its particular array of the cell matrix, in response to being selected for playback and upon being triggered to begin playback, causes the audio sample data corresponding to the cell's particular array to be played. The method further includes determining that the input's duration is above a threshold time and expanding a size of an array containing the selected cell and adjusting the adjustable parameter of the selected cell based on the input.

## Claims

### Claim 1

A user interface (UI) on a display, the UI comprising:
a matrix of user-selectable cells,
wherein in response to a particular cell of the matrix of user-selectable cells receiving a first type of adjustment input, the adjustable parameter of the particular cell of the array is adjustable according to a first level of precision, and
wherein in response to the particular cell of the matrix of user-selectable cells receiving a second type of the adjustment input, a displayed size of the particular cell is increased and the adjustable parameter of the particular cell is adjustable according to a second level of precision.

### Claim 2 (depends on 1)

The UI of claim 1 wherein the first type of the adjustment input corresponds to a selection of a location within the particular cell, and
wherein the second type of the adjustment input corresponds to a selection-and-maintained hold of a location within the particular cell for a threshold time.

### Claim 3 (depends on 1)

The UI of claim 1 wherein each cell of the matrix of user-selectable cells is associated with an adjustable parameter that changes in response to the adjustment input.

### Claim 4 (depends on 1)

The UI of claim 1 wherein in response to a particular cell of an array having received a first type of the adjustment input when the displayed size of the array is already increased, the adjustable parameter of the particular cell of the array is adjustable according to the second level of precision.

### Claim 5 (depends on 1)

The UI of claim 1 wherein the second level of precision is a higher precision than the first level of precision.

### Claim 6 (depends on 1)

The UI of claim 1 wherein the first and second levels of precision correspond to a number of available settings for the adjustable parameter.

### Claim 7

A method of operating a UI comprising:
receiving an input corresponding to a selection of a cell within a particular array of cells of a cell matrix;
determining a duration of the received input;
in response to determining that the input's duration is below a threshold time:
adjusting an adjustable parameter of the selected cell based on the input, and
in response to determining that the input's duration is at or above a threshold time:
expanding a size of the selected cell and adjusting the adjustable parameter of the selected cell based on the input.

### Claim 8 (depends on 7)

The method of claim 7 wherein the input is a detected touch on the display.

### Claim 9 (depends on 7)

The method of claim 7 wherein the array containing the selected cell is also expanded in size in response to determining that the input's duration is at or above a threshold time.

### Claim 10 (depends on 7)

The method of claim 7 further comprising:
in response to determining that the input's duration is below a threshold time and the corresponding array containing the selected cell is already expanded:
adjusting the adjustable parameter of the selected cell based on the input.

### Claim 11 (depends on 7)

The method of claim 7 wherein the array, when expanded in size, includes a higher number of selectable levels for the adjustable parameter than when the array is not expanded in size.

### Claim 12

A system comprising:
one or more processors; and
one or more non-transitory computer-readable storage mediums containing instructions to cause the one or more processors to perform operations including:
receiving an input corresponding to a selection of a cell within a particular array of cells of a cell matrix
determining a duration of the received input;
in response to determining that the input's duration is below a threshold time:
adjusting an adjustable parameter of the selected cell based on the input; and
in response to determining that the input's duration is at or above a threshold time:
expanding a size of the selected cell and adjusting the adjustable parameter of the selected cell based on the input.

### Claim 13 (depends on 12)

The system of claim 12 wherein the input is a detected touch on a touch-sensitive display.

### Claim 14 (depends on 12)

The system of claim 12 wherein the array containing the selected cell is also expanded in size in response to determining that the input's duration is at or above a threshold time.

### Claim 15 (depends on 12)

The system of claim 12 wherein the one or more non-transitory computer-readable storage mediums further contain instructions to cause the one or more processors to perform operations including:
in response to determining that the input's duration is below a threshold time and the corresponding array containing the selected cell is already expanded:
adjusting the adjustable parameter of the selected cell based on the input.

### Claim 16 (depends on 12)

The system of claim 12 wherein the array, when expanded in size, includes a higher number of selectable levels for the adjustable parameter than when the array is not expanded in size.

### Claim 17

A non-transitory computer-program product tangibly embodied in a machine-readable non-transitory storage medium including instructions to cause a processor to:
receive an input corresponding to a selection of a cell within a particular array of cells of a cell matrix;
determine a duration of the received input;
in response to determining that the input's duration is below a threshold time:
adjust an adjustable parameter of the selected cell based on the input; and
in response to determining that the input's duration is at or above a threshold time:
expand a size of the selected cell and adjusting the adjustable parameter of the selected cell based on the input.

### Claim 18 (depends on 17)

The computer-program product of claim 17 wherein the input is a detected touch on a touch-sensitive display.

### Claim 19 (depends on 17)

The computer-program product of claim 17 wherein the array containing the selected cell is also expanded in size in response to determining that the input's duration is at or above a threshold time.

### Claim 20 (depends on 17)

The computer-program product of claim 17 wherein the machine-readable non-transitory storage medium further includes instructions to cause a processor to:
in response to determining that the input's duration is below a threshold time and the corresponding array containing the selected cell is already expanded:
adjust the adjustable parameter of the selected cell based on the input.
