# US 2013/0239781 A1 · Musical instrument, method and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0239781 A1
- Document ID: US20130239781A1
- Status: Published application
- Kind: A1
- Application number: 13/768,889
- Filed: 2013-02-15
- Published: 2013-09-19
- Earliest claimed: 2012-03-16
- Assignees: Casio Computer Co., Ltd.
- Applicants: Casio Computer Co., Ltd.
- Inventors: Yuki YOSHIHAMA
- Web page: https://patentgrep.com/patent/US20130239781A1

## CPC

- G10H 7/00: Instruments in which the tones are synthesised from a data store, e.g. computer organs
- G10H 1/0008: {Associated control or indicating means}
- G10H 2220/455: Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
- G10H 2230/281: Spint drum assembly, i.e. mimicking two or more drums or drumpads assembled on a common structure, e.g. drum kit
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE

## Abstract

A musical instrument includes memory that stores layout information defining regions arranged on a predetermined virtual plane, and a position sensor that detects the position coordinates on the virtual plane of a music playing member that can be held by a player. First, it is determined whether the position coordinates of the music playing member belong to a region arranged on the virtual plane based on the layout information, at a timing at which a specific music playing operations is made. Herein, in a case of having determined as belonging to a region, the generation of sound of a musical note corresponding to this region is instructed, in a case of having determined as not belonging to a region, the layout information stored in the memory is modified in order to modify this region so as to include the position coordinates of the music playing member.

## Claims

### Claim 1

A musical instrument, comprising:
a position sensor that detects position coordinates on a virtual plane of a music playing member that can be held by a player;
a determination unit that determines, based on layout information defining a region arranged on a predetermined virtual plane, whether position coordinates of the music playing member belong to a region arranged on the virtual plane, at a timing at which a specific music playing operation is made by way of the music playing member;
a sound generation instruction unit that, in a case of the determination unit having determined as belonging to the region, instructs sound generation of a musical note corresponding to the region; and
a modification unit that, in a case of the determination unit having determined as not belonging to the region, modifies the layout information in order to modify the region so as to include the position coordinates of the music playing member.

### Claim 2 (depends on 1)

The musical instrument according to claim 1, wherein the position sensor is an image-capturing device that captures an image in which the virtual plane is a captured image plane and the music playing member is a subject, and that detects the position coordinates of the music playing member on the captured image plane.

### Claim 3 (depends on 1)

The musical instrument according to claim 1, wherein the layout information defines a position of the region on the virtual plane and a size of the region, and the modification unit modifies the layout information so as to modify at least one of the position and the size of the region.

### Claim 4 (depends on 1)

The musical instrument according to claim 1,
wherein the layout information defines each of a plurality of regions arranged on the virtual plane,
wherein the musical instrument further comprises a region designating unit that sequentially designates, among the plurality of regions, a region to which the position coordinates of the music playing member should belong at every timing at which a specific music playing operation is made by way of the music playing member, and
wherein the determination unit determines whether the position coordinates of the music playing member belong to any of the plurality of regions arranged based on the layout information, at a timing at which a specific music playing operation is made by way of the music playing member.

### Claim 5

A method for a musical instrument having a position sensor that detects position coordinates of a music playing member that can be held by a player on a virtual plane, the method comprising the steps of:
determining whether, at a timing at which a specific music playing operation is made by way of a music playing member, the position coordinates of the music playing member belong to a region arranged on the virtual plane based on layout information defining regions arranged on a predetermined virtual plane;
instructing, in a case of determining as belonging to the region, generation of sound of a musical note corresponding to the region; and
modifying, in a case of determined as not belonging to the region, the layout information in order to modify the region so as to include the position coordinates of the music playing member.

### Claim 6 (depends on 5)

The method according to claim 5, wherein the position sensor is an image-capturing device that captures an image in which the virtual plane is a captured image plane and the music playing member is a subject, and that detects the position coordinates of the music playing member on the captured image plane.

### Claim 7 (depends on 5)

The method according to claim 5, wherein the layout information defines a position of the region on the virtual plane and a size of the region, and the layout information is modified so as to modify at least one of the position and the size of the region.

### Claim 8 (depends on 5)

The method according to claim 5,
wherein the layout information defines each of a plurality of regions arranged on the virtual plane,
wherein the method further comprises the steps of: sequentially designating, among the plurality of regions, a region to which the position coordinates of the music playing member should belong at every timing at which a specific music playing operation is made by way of the music playing member; and
determining whether the position coordinates of the music playing member belong to any of the plurality of regions arranged based on the layout information, at a timing at which a specific music playing operation is made by way of the music playing member.

### Claim 9

A computer readable recording medium used in a musical instrument having a position sensor that detects position coordinates of a music playing member that can be held by a player on a virtual plane, the recording medium encoded with a program that enables the computer to execute the steps of:
determining whether, at a timing at which a specific music playing operation is made by way of a music playing member, the position coordinates of the music playing member belong to a region arranged on the virtual plane based on layout information defining regions arranged on a predetermined virtual plane;
instructing, in a case of determining in the step of determining as belonging to the region, generation of sound of a musical note corresponding to the region; and
modifying, in a case of determined in the step of determining as not belonging to the region, the layout information in order to modify the region so as to include the position coordinates of the music playing member.

### Claim 10 (depends on 9)

The recording medium according to claim 9, wherein the position sensor is an image-capturing device that captures an image in which the virtual plane is a captured image plane and the music playing member is a subject, and that detects the position coordinates of the music playing member on the captured image plane.

### Claim 11 (depends on 9)

The recording medium according to claim 9, wherein the layout information defines a position of the region on the virtual plane and a size of the region, and the layout information is modified so as to modify at least one of the position and the size of the region in the step of modifying.

### Claim 12 (depends on 9)

The recording medium according to claim 9,
wherein the layout information defines each of a plurality of regions arranged on the virtual plane,
wherein the program further enables the computer to execute the steps of: sequentially designating, among the plurality of regions, a region to which the position coordinates of the music playing member should belong at every timing at which a specific music playing operation is made by way of the music playing member, and
wherein the step of determining includes determining whether the position coordinates of the music playing member belong to any of the plurality of regions arranged based on the layout information, at a timing at which a specific music playing operation is made by way of the music playing member.
