# US 2019/0244539 A1 · Piano system and method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244539 A1
- Document ID: US20190244539A1
- Status: Published application
- Kind: A1
- Application number: 16/384,176
- Filed: 2019-04-15
- Published: 2019-08-08
- Earliest claimed: 2017-01-25
- Assignees: Sunland Information Technology Co., Ltd.
- Applicants: Sunland Information Technology Co., Ltd.
- Inventors: Bin YAN; Min ZHOU; Xiaolu LIU
- Web page: https://patentgrep.com/patent/US20190244539A1

## CPC

- G09B 15/02: Boards or like means for providing an indication of notes
- G09B 5/06: with both visual and audible presentation of the material to be studied
- G10C 3/00: Details or accessories
- G10C 3/26: Pedals or pedal mechanisms (G10C3/14 takes precedence); Manually operated sound modification means
- G10H 1/00: Details of electrophonic musical instruments
- G10H 1/0008: {Associated control or indicating means}
- G10H 1/368: {displaying animated or moving pictures synchronized with the music or audio part}
- G06F 16/245: Query processing
- G10G 1/00: Means for the representation of music
- G10H 2210/061: for extraction of musical phrases, isolation of musically relevant segments, e.g. musical thumbnail generation, or for temporal structure analysis of a musical piece, e.g. determination of the movement sequence of a musical work
- G10H 2220/015: Musical staff, tablature or score displays, e.g. for score reading during a performance
- G10H 2220/096: using a touch screen
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G10C: PIANOS, HARPSICHORDS, SPINETS OR SIMILAR STRINGED MUSICAL INSTRUMENTS WITH ONE OR MORE KEYBOARDS (automatic musical instruments G10F)
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10G: REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS (music stands A47B; non-musical aspects of musical toy instruments A63H5/00; metronomes G04F5/02; teaching music G09B15/00)

## Abstract

The present disclosure relates to a method and system for providing tutorial functions. The method may include obtaining a piece of music selected by a user; determining a display mode that configures one or more display categories and a layout of the one or more display categories on a user interface; obtaining one or more content items corresponding to the one or more display categories, respectively, the one or more content items being associated with the piece of music; and generating an instruction to display the one or more content items on the user interface according to the layout.

## Claims

### Claim 1

A method implemented on a digital instrument having at least one processor and at least one computer-readable storage medium, comprising:
obtaining a piece of music selected by a user;
determining a display mode that configures one or more display categories and a layout of the one or more display categories on a user interface;
obtaining one or more content items corresponding to the one or more display categories, respectively, the one or more content items being associated with the piece of music; and
generating an instruction to display the one or more content items on the user interface according to the layout.

### Claim 2 (depends on 1)

The method of claim 1, wherein the one or more display categories include at least one of characters, images, videos, or animations.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
obtaining a plurality of historical records associated with the user including one or more historical pieces of music selected by the user, one or more historical content items associated with the one or more historical pieces of music, and one or more historical display modes associated with playing the one or more historical pieces of music; and
determining the display mode based on the plurality of historical records associated with the user and the piece of music selected by the user.

### Claim 4 (depends on 3)

The method of claim 3, wherein determining the display mode further comprises training the plurality of historical records using a deep learning model.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
determining one or more transitions within the piece of music;
partitioning the piece of music to two or more phases separated by the one or more transitions;
for each of the two or more phases,
determining a phasic display mode; and
generating a phasic instruction that causes one or more phasic content items to be displayed on the user interface according to the phasic display mode.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
for each of the two or more phases,
configuring one or more phasic display categories and a phasic layout of the one or more phasic display categories on the user interface for the phasic display mode; and
obtaining the one or more phasic content items corresponding to the one or more phasic display categories, respectively, the one or more phasic content items being associated with a corresponding phasic piece of music.

### Claim 7

(canceled)

### Claim 8

A piano system, comprising:
a keyboard hosting a plurality of keys operable to a user;
a display adjacent to the keyboard;
at least one computer-readable storage medium including a set of instructions for presenting contents to the user; and
at least one processor in communication with the at least one computer-readable storage medium, wherein when executing the instructions, the at least one processor is directed to:
obtain a piece of music selected by the user;
obtain a display mode that configures one or more display categories and a layout of the one or more display categories on a user interface;
obtain one or more content items corresponding to the one or more display categories, respectively, the one or more content items being associated with the piece of music; and
generate an instruction to display the one or more content items on the user interface according to the layout.

### Claim 9 (depends on 8)

The piano system of claim 8, wherein the one or more displayed categories include at least one of characters, images, videos, or animations.

### Claim 10 (depends on 8)

The piano system of claim 8, wherein the at least one processor is further configured to:
obtain a plurality of historical records associated with the user including one or more historical pieces of music selected by the user, one or more historical content items associated with the one or more historical pieces of music, and one or more historical display modes associated with the one or more historical pieces of music; and
determine the display mode based on the plurality of historical records associated with the user and the piece of music selected by the user.

### Claim 11 (depends on 10)

The system of claim 10, wherein to determine the display mode, the at least one processor is further configured to train the plurality of historical records using a deep learning model.

### Claim 12 (depends on 8)

The piano system of claim 8, wherein the display has a high definition format.

### Claim 13 (depends on 8)

The piano system of claim 8, further comprising a switch configured to switch the piano system between at least two working modes.

### Claim 14 (depends on 13)

The piano system of claim 13, wherein the at least two working modes include a tutorial mode in which the display is configured to present one or more tutorials that instruct the user to practice the plurality of keys.

### Claim 15 (depends on 14)

The piano system of claim 14, further comprising at least one sensor, wherein the at least one sensor is configured to record information related to interactions between the user and the plurality of keys, the at least one sensor including at least one of an image sensor, an audio sensor, a pressure sensor, a speed sensor, an accelerometer, or a mechanical sensor.

### Claim 16

(canceled)

### Claim 17 (depends on 15)

The piano system of claim 15, wherein the at least one processor is further configured to determine a feedback to the user based on the recorded information.

### Claim 18 (depends on 13)

The piano system of claim 13, wherein the at least two working modes include a presenting mode in which the display is configured to present the one or more content items to the user.

### Claim 19 (depends on 8)

The piano system of claim 8, wherein the at least one processor is further configured to:
determine one or more transitions within the selected piece of music;
partition the piece of music to two or more phases separated by the one or more transitions;
for each of the two or more phases,
determine a phasic display mode; and
generate a phasic instruction that causes one or more phasic content items displaying on the user interface according to the phasic display mode.

### Claim 20 (depends on 19)

The system of claim 19, wherein the at least one processor is further configured to:
for each of the two or more phases,
configure one or more phasic display categories and a phasic layout of the one or more phasic display categories on the user interface for the phasic display mode; and
obtain the one or more phasic content items corresponding to the one or more phasic display categories, respectively, the one or more phasic content items being associated with a corresponding phasic piece of music.

### Claim 21 (depends on 19)

The system of claim 19, wherein the at least one processor is further configured to execute the instruction to cause the one or more content items displaying on the user interface according to the layout.

### Claim 22

A non-transitory computer readable medium embodying a computer program product, the computer program product comprising instructions configured to cause a computing system to:
obtain a piece of music selected by a user;
determine a display mode that configures one or more display categories and a layout of the one or more display categories on a user interface;
obtain one or more content items corresponding to the one or more display categories, respectively, the one or more content items being associated with the piece of music; and
generate an instruction to display the one or more content items on the user interface according to the layout.

### Claim at position 23

23-28. (canceled)
