# US 10,319,352 B2 · Notation for gesture-based composition > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,319,352 B2 - Document ID: US10319352B2 - Status: Granted - Kind: B2 - Application number: 15/582,120 - Filed: 2017-04-28 - Published: 2018-11-01 - Granted: 2019-06-11 - Earliest claimed: 2017-04-28 - Assignees: Intel Corporation - Applicants: Intel Corporation - Inventors: Swarnendu Kar; Dipika Jain; Yingxi A Lin; Saurin Shah - Web page: https://patentgrep.com/patent/US10319352B2 ## CPC - G10H 1/0008: {Associated control or indicating means} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06V 40/107: {Static hand or arm} - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - G10G 1/00: Means for the representation of music - G10H 1/18: Selecting circuits - G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves} - G10H 2220/201: for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument - G10H 2220/321: Garment sensors, i.e. musical control means with trigger surfaces or joint angle sensors, worn as a garment by the player, e.g. bracelet, intelligent clothing - G10H 2220/326: Control glove or other hand or palm-attached control device - G10H 2240/161: Memory and use thereof, in electrophonic musical instruments, e.g. memory map - G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G10G: REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS (music stands A47B; non-musical aspects of musical toy instruments A63H5/00; metronomes G04F5/02; teaching music G09B15/00) ## Abstract Various systems and methods for air gesture-based composition and instruction systems are described herein. A composition system for composing gesture-based performances may receive an indication of an air gesture performed by a user; reference a mapping of air gestures to air gesture notations to identify an air gesture notation corresponding to the air gesture; and store an indication of the air gesture notation in a memory of the computerized composition system. Another system used for instruction may present a plurality of air gesture notations in a musical arrangement; receive an indication of an air gesture performed by a user; reference a mapping of air gestures to air gesture notations to identify an air gesture notation corresponding to the air gesture; and guide the user through the musical arrangement by sequentially highlighting the air gesture notations in the musical arrangement based on the mapping of air gestures to air gesture notations. ## Claims ### Claim 1 A computerized composition system for composing gesture-based performances, the system comprising: a processor subsystem; and memory including instructions, which when executed by the processor subsystem, cause the processor subsystem to: receive an indication of an air gesture performed by a user; reference a mapping of air gestures to air gesture notations to identify an air gesture notation corresponding to the air gesture; and store an indication of the air gesture notation in a memory of the computerized composition system, wherein the air gesture notation comprises a circle with a shaded portion, the shaded portion indicating a directionality of the air gesture, or the air gesture comprises a non-equilateral triangle indicating a directionality of the air gesture. ### Claim 2 (depends on 1) The system of claim 1, wherein to receive the indication of the air gesture, the processor subsystem is to receive sensor data via a sensor interface circuit, from a sensor worn by the user. ### Claim 3 (depends on 2) The system of claim 2, wherein the sensor is integrated into a bracelet, a glove, an anklet, or a shoe. ### Claim 4 (depends on 2) The system of claim 2, wherein the indication of the air gesture is provided by a gesture detection processor. ### Claim 5 (depends on 1) The system of claim 1, wherein to receive the indication of the air gesture, the processor subsystem is to receive image data from a camera observing the user. ### Claim 6 (depends on 1) The system of claim 1, wherein the shaded portion indicates a palm tap air gesture. ### Claim 7 (depends on 1) The system of claim 1, wherein the non-equilateral triangle indicates a knife tap air gesture. ### Claim 8 (depends on 1) The system of claim 1, wherein the air gesture notation comprises a modifier that alters the air gesture notation. ### Claim 9 A method for composing gesture-based performances, the method comprising: receiving, at a computerized composition system, an indication of an air gesture performed by a user; referencing a mapping of air gestures to air gesture notations to identify an air gesture notation corresponding to the air gesture; and storing an indication of the air gesture notation in a memory of the computerized composition system, wherein the air gesture notation comprises a modifier that alters the air gesture notation, and wherein the modifier comprises a hat symbol oriented over the air gesture notation, the hat symbol indicating that performance of a second air gesture is performed simultaneously with the air gesture. ### Claim 10 (depends on 9) The method of claim 9, wherein the hat symbol indicates that the user perform a foot gesture as the second air gesture. ### Claim 11 (depends on 9) The method of claim 9, wherein the hat symbol indicates that a musical note is modified from the air gesture notation without the hat symbol. ### Claim 12 (depends on 11) The method of claim 11, wherein the musical note is modified with a sharp. ### Claim 13 (depends on 9) The method of claim 9, wherein the air gesture notation indicates a handedness of the air gesture. ### Claim 14 (depends on 13) The method of claim 13, wherein the air gesture notation is in a first color for a right hand performance of the air gesture, and the air gesture notation is in a second color for a left hand performance of the air gesture, the first and second colors being different colors. ### Claim 15 (depends on 13) The method of claim 13, wherein the air gesture notation is presented on a plurality of staffs, the plurality of staffs including a first staff for right hand air gesture notations, and a second staff for left hand air gesture notations. ### Claim 16 (depends on 9) The method of claim 9, further comprising presenting a plurality of air gesture notations in a musical arrangement. ### Claim 17 (depends on 16) The method of claim 16, wherein presenting the plurality of air gesture notations comprises presenting the plurality of air gesture notations on a musical staff. ### Claim 18 (depends on 16) The method of claim 16, wherein presenting the plurality of air gesture notations comprises presenting the plurality of air gesture notations without a musical staff. ### Claim 19 (depends on 16) The method of claim 16, wherein presenting the plurality of air gesture notations comprises presenting a first set of the plurality of air gesture notations and a second set of the plurality of air gesture notations, the first set indicating musical arrangement and the second set indicating dance choreography, the first and second set of air gesture notations coordinated in time. ### Claim 20 At least one non-transitory machine-readable medium including instructions for composing gesture-based performances, which when executed by a computerized composition system, cause the computerized composition system to: receive an indication of an air gesture performed by a user; reference a mapping of air gestures to air gesture notations to identify an air gesture notation corresponding to the air gesture; and store an indication of the air gesture notation in a memory of the computerized composition system, wherein the air gesture notation comprises a modifier that alters the air gesture notation, and wherein the modifier comprises a hat symbol oriented over the air gesture notation, the hat symbol indicating that performance of a second air gesture is performed simultaneously with the air gesture. ### Claim 21 (depends on 20) The at least one non-transitory machine-readable medium of claim 20, further comprising instructions to present a plurality of air gesture notations in a musical arrangement.