# US 2013/0239783 A1 · Musical instrument, method of controlling musical instrument, and program recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0239783 A1
- Document ID: US20130239783A1
- Status: Published application
- Kind: A1
- Application number: 13/794,317
- Filed: 2013-03-11
- Published: 2013-09-19
- Earliest claimed: 2012-03-14
- Assignees: Casio Computer Co., Ltd.
- Applicants: Casio Computer Co., Ltd.
- Inventors: Yuji TABATA; Ryutaro HAYASHI
- Web page: https://patentgrep.com/patent/US20130239783A1

## CPC

- G10H 1/0008: {Associated control or indicating means}
- G10H 2220/455: Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
- G10H 2230/015: PDA [personal digital assistant] or palmtop computing devices used for musical purposes, e.g. portable music players, tablet computers, e-readers or smart phones in which mobile telephony functions need not be used
- G10H 2230/281: Spint drum assembly, i.e. mimicking two or more drums or drumpads assembled on a common structure, e.g. drum kit
- G10H 2240/211: Wireless transmission, e.g. of music parameters or control data by radio, infrared or ultrasound
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE

## Abstract

A CPU (31) of a musical instrument (1) calculates distances between central positions of a plurality of virtual pads (81) and a position of a marker unit (15), by making adjustment such that a distance is shorter as a size associated with the virtual pad (81) is larger. The CPU 31 identifies a virtual pad (81) corresponding to the shortest distance among the distances calculated, as a virtual pad (81) for outputting sound. The CPU (31) identifies a tone corresponding to the virtual pad (81) for outputting sound by referring to set layout information.

## Claims

### Claim 1

A musical instrument, comprising:
a musical performance member that is operated by a performer;
an operation detection unit that detects a predetermined operation performed by the musical performance member;
an image capturing unit that captures an image including the musical performance member;
a position detection unit that detects a position of the musical performance member on a plane of the image captured;
a storage unit that stores layout information including a representing position and a size of a virtual musical instrument, for each of a plurality of virtual musical instruments provided on the plane of the image captured;
a distance calculation unit that calculates distances between a position detected by the position detection unit and respective representing positions of the virtual musical instruments, based on corresponding sizes of the virtual musical instruments, when the operation detection unit detects the predetermined operation;
a musical instrument identification unit that identifies a virtual musical instrument corresponding to the shortest distance among the distances calculated by the distance calculation unit; and
a sound generation instruction unit that instructs generation of musical sound corresponding to the virtual musical instrument identified by the musical instrument identification unit.

### Claim 2 (depends on 1)

The musical instrument according to claim 1, wherein the distance calculation unit makes adjustment such that the distance to be calculated is shorter as the corresponding size of the virtual musical instrument is larger.

### Claim 3 (depends on 1)

The musical instrument according to claim 1, wherein the sound generation instruction unit instructs generation of musical sound of a tone that is determined based on the virtual musical instrument identified by the musical instrument identification unit and on the shortest distance.

### Claim 4 (depends on 2)

The musical instrument according to claim 2, wherein the sound generation instruction unit instructs generation of musical sound of a tone that is determined based on the virtual musical instrument identified by the musical instrument identification unit and on the shortest distance.

### Claim 5 (depends on 1)

The musical instrument according to claim 1, wherein the musical instrument identification unit identifies a corresponding virtual musical instrument when the shortest distance among distances calculated by the distance calculation unit is less than a predetermined threshold value.

### Claim 6 (depends on 2)

The musical instrument according to claim 2, wherein the musical instrument identification unit identifies a corresponding virtual musical instrument when the shortest distance among distances calculated by the distance calculation unit is less than a predetermined threshold value.

### Claim 7 (depends on 3)

The musical instrument according to claim 3, wherein the musical instrument identification unit identifies a corresponding virtual musical instrument when the shortest distance among distances calculated by the distance calculation unit is less than a predetermined threshold value.

### Claim 8 (depends on 4)

The musical instrument according to claim 4, wherein the musical instrument identification unit identifies a corresponding virtual musical instrument when the shortest distance among distances calculated by the distance calculation unit is less than a predetermined threshold value.

### Claim 9 (depends on 5)

The musical instrument according to claim 5, further comprising a threshold value setting unit that sets the predetermined threshold value.

### Claim 10 (depends on 6)

The musical instrument according to claim 6, further comprising a threshold value setting unit that sets the predetermined threshold value.

### Claim 11 (depends on 7)

The musical instrument according to claim 7, further comprising a threshold value setting unit that sets the predetermined threshold value.

### Claim 12 (depends on 8)

The musical instrument according to claim 8, further comprising a threshold value setting unit that sets the predetermined threshold value.

### Claim 13 (depends on 1)

The musical instrument according to claim 1, further comprising a representing position setting unit that sets a representing position of each of the virtual musical instruments.

### Claim 14

A non-transitory computer-readable recording medium having stored thereon a program for controlling a control unit of a musical instrument that includes: a musical performance member that is operated by a performer and for which a predetermined operation thereof is detected; an image capturing unit that captures an image including the musical performance member, and detects a position of the musical performance member on a plane of the image captured; and a storage unit that includes layout information including a representing position and a size of a virtual musical instrument, for each of a plurality of virtual musical instruments provided on the plane of the image captured, and wherein the program controls the control unit to execute functions of:
a distance calculating step of calculating distances between respective representing positions of the plurality of virtual musical instruments and a position of the musical performance member detected, based on a corresponding size of each of the virtual musical instruments, when a predetermined operation performed by the musical performance member is detected;
a musical instrument identifying step of identifying a virtual musical instrument corresponding to the shortest distance among distances calculated in the distance calculating step; and
a sound generation instructing step of instructing generation of musical sound corresponding to the virtual musical instrument identified.

### Claim 15

A method of controlling a musical instrument that includes: a musical performance member that is operated by a performer and for which a predetermined operation thereof is detected; an image capturing unit that captures an image including the musical performance member, and detects a position of the musical performance member on a plane of the image captured; and a storage unit that includes layout information including a representing position and a size of a virtual musical instrument, for each of a plurality of virtual musical instruments provided on the plane of the image captured, the method comprising:
a distance calculating step of calculating distances between respective representing positions of the plurality of virtual musical instruments and a position of the musical performance member detected, based on a corresponding size of each of the virtual musical instruments, when a predetermined operation performed by the musical performance member is detected;
a musical instrument identifying step of identifying a virtual musical instrument corresponding to the shortest distance among the distances calculated in the distance calculating step; and
a sound generation instructing step of instructing generation of musical sound corresponding to the virtual musical instrument identified.
