# US 2023/0274658 A2 · Method and apparatus for an adaptive and interactive teaching of playing a musical instrument > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0274658 A2 - Document ID: US20230274658A2 - Status: Published application - Kind: A2 - Application number: 17/467,228 - Filed: 2021-09-05 - Published: 2023-08-31 - Earliest claimed: 2020-12-02 - Assignees: Joytunes Ltd. - Applicants: Joytunes Ltd. - Inventors: Eran Aharonson; Yuval Kaminka; Saggi Messer; Or Gafni; Anatoli Tsinovoy - Web page: https://patentgrep.com/patent/US20230274658A2 ## CPC - G09B 15/023: {Electrically operated} - G10G 1/04: Transposing; Transcribing - G09B 15/00: Teaching music (metronomes G04F5/02) - G10G 1/00: Means for the representation of music - G10G 3/04: using electrical means - H04R 1/406: {microphones} - H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)} - H04R 2499/15: Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops - H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - G10G: REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS (music stands A47B; non-musical aspects of musical toy instruments A63H5/00; metronomes G04F5/02; teaching music G09B15/00) - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - H04S: STEREOPHONIC SYSTEMS ## Abstract Embodiments of systems and methods pertain to providing a session of music learning to a user, comprising: setting a sound capturing configuration relating to at least one microphone of a computerized device; providing the user with musical notations to be executed through the user for generating user-generated sound; capturing, through the at least one microphone, sound which includes user-generated sound produced by the user to produce user-generated sound data; processing the user-generated sound data; and determining, based on the processing of the user-generated sound data, whether a sound capturing configuration is to be adapted or not. ## Claims ### Claim 1 A method for providing a session of music learning to a user, comprising: setting a sound capturing configuration relating to at least one microphone of a computerized device; providing the user with musical notations to be executed through the user for generating user-generated sound; capturing, through the at least one microphone, sound which includes user-generated sound produced by the user to produce user-generated sound data; processing the captured sound data; and determining, based on the processing of the captured sound data, whether a sound capturing configuration is to be adapted or not. ### Claim 2 A system configured to provide a music learning session, comprising; a memory for storing data and executable instructions; and a processor that is configured to execute the execution instructions to result in the following: setting a sound capturing configuration relating to at least one microphone of a computerized device; providing the user with musical notations to be executed through the user for generating user-generated sound; capturing, through the at least one microphone, sound which includes user-generated sound produced by the user to produce user-generated sound data; processing the user-generated sound data; and determining, based on the processing of the user-generated sound data, whether the sound capturing configuration is to be adapted or not. ### Claim 3 (depends on 2) The system of claim 2, further comprising: adapting the sound capturing configuration based on the user-generated sound data. ### Claim 4 (depends on 2) The system of claim 2, wherein a sound capturing configuration pertains to a configuration of at least one microphone. ### Claim 5 (depends on 2) The system of claim 2, wherein a sound capturing configuration pertains to a selection of one or more microphones of a plurality of microphones. ### Claim 6 (depends on 5) The system of claim 5, wherein the captured sound further includes an audio playback. ### Claim 7 (depends on 6) The system of claim 6, further comprising recognizing the user-generated sound from the captured sound. ### Claim 8 (depends on 6) The system of claim 6, further comprising adapting the sound capturing configuration to improve the recognition of the user-generated sound from the captured sound also comprising the audio playback. ### Claim 9 (depends on 2) The system of claim 2, further comprising determining, based on the user-generated sound data, whether an audio playback configuration is to be adapted to improve recognizing of the user-generated sound and, when required, adapting, based on the user-generated sound data, the audio playback configuration to improve recognizing of the user-generated sound. ### Claim 10 (depends on 2) The system of claim 2, further comprising transcribing the user-generated sound into corresponding notation. ### Claim 11 A system configured to provide a session of music learning to a user, comprising: a memory for storing data and executable instructions; and a processor that is configured to execute the execution instructions to result in the following: obtaining a sound capturing and playback configuration; setting a first parameter of the at least one speaker or the at least one microphone in accordance with the initial configuration; displaying to the user musical notations based on which the user produces user-generated sound; playing background music (BGM) of a piece selected by the user through the at least one speaker configured in accordance with the initial configuration; capturing, through the at least one microphone, composite sound including the user-generated sound and one of the following: the BGM, environmental noise, or both; processing the captured composite sound to recognize the user-generated sound; and determining, based on the processing, whether the sound capturing and/or playback configuration is to be adapted to improve recognizing the user-generated sound. ### Claim 12 (depends on 11) The system of claim 11, further comprising adapting, based on the recognized user-generated sound, the sound capturing and/or playback configuration to improve recognizing the user-generated sound. ### Claim 13 (depends on 12) The system of claim 12, wherein the adapting of the sound capturing and/or playback configuration includes setting a microphone and/or audio playback configuration, and/or selecting at least one speaker of a plurality of speakers and/or selecting at least one microphone of a plurality of microphones. ### Claim 14 (depends on 11) The system of claim 11, further comprising seizing displaying to the user musical notations when a stopping criterion is met. ### Claim 15 (depends on 11) The system of claim 11, wherein recognizing the user-generated sound comprises determining a sound quality of the captured composite sound comprising the BGM and the user-generated sound. ### Claim 16 (depends on 11) The system of claim 11, further comprising: determining a level of correspondence between user-generated sound and the displayed musical notations ### Claim 17 (depends on 16) The system of claim 16, wherein the user experience is determined based on the level of correspondence. ### Claim 18 (depends on 11) The system of claim 11, further comprising: capturing through the at least one microphone, user-generated sound produced by at least one other user in a collaborative playing setting; and providing, through the at least one speaker, an audio output relating to the user-generated sound produced by the at least one other user such that the composite sound additionally includes user-generated sound produced by the at least one other users. ### Claim 19 (depends on 18) The system of claim 18, wherein the processing of the composite sound is performed to recognize the user-generated sound of a selected user. ### Claim 20 (depends on 19) The system of claim 19, wherein the processing comprises suppressing the role of the at least one other user in the captured composite sound to recognize the user-generated sound of the selected user.