Systems and methods for shapelet decomposition based gesture recognition using radar

A system, comprising:

• one or more data storage devices operatively coupled to one or more hardware processors and configured to store instructions configured for execution via the one or more hardware processors to:
• obtain, using a radar system, a plurality of time domain signals reflected by a subject performing one or more activities, wherein the subject refers to a living being including a human or an animal or a bird;
• identify, one or more gesture windows in the plurality of obtained time domain signals, by applying one or more signal properties on the plurality of obtained time domain signals to detect a no motion region and a motion region in the plurality of obtained time domain signals, wherein width of each gesture window is indicative of a time duration in which a gesture is performed, wherein applying the one or more signal properties comprises determining an average energy for the plurality of obtained time domain signals to identify a region where the average energy is minimum as the no motion region;
• obtain, using a spectrogram, one or more shapelets of one or more gestures captured from the one or more gesture windows;
• create a dictionary of basic shapelets of one or more motion patterns of a plurality of gestures comprised in the one or more activities performed by the subject;
• decompose, using the created dictionary of basic shapelets, the one or more shapelets to obtain a plurality of sub-shapelets of the one or more gestures captured from the one or more gesture windows, wherein each sub-shapelet is representative of a specific motion pattern of each of the one or more gestures captured from the one or more gesture windows;
• apply, at least one of (i) a positive or (ii) negative time delay to each of the plurality of sub-shapelets of the one or more gestures to obtain a plurality of composite shapelets for the one or more gestures, wherein the plurality of composite shapelets for the one or more gestures are obtained by superimposing the positive and the negative time delays of each of the plurality of sub-shapelets, and wherein the positive and the negative time delay is provided to each of the plurality of sub-shapelets based on a displacement and a time pattern of the one or more gestures;
• and
• perform, a mapping of each of the plurality of composite shapelets with a plurality of trained shapelets stored in a system database to recognize the plurality of gestures comprised in the one or more activities being performed by the subject, wherein each of the plurality of composite shapelet is converted into a 2-dimensional or 3-dimensional vector and mapping is performed to recognize a new gesture performed by the subject.

A computer program product comprising a non-transitory computer readable medium having a computer readable program embodied therein, wherein the computer readable program, when executed on a computing device, causes the computing device to:

• obtain, using a radar system, a plurality of time domain signals reflected by a subject performing one or more activities, wherein the subject refers to a living being including a human or an animal or a bird;
• identify, one or more gesture windows in the plurality of obtained time domain signals, by applying one or more signal properties on the plurality of obtained time domain signals to detect a no motion region and a motion region in the plurality of obtained time domain signals, wherein width of each gesture window is indicative of a time duration in which a gesture is performed, wherein applying the one or more signal properties comprises determining an average energy for the plurality of obtained time domain signals to identify a region where the average energy is minimum as the no motion region;
• obtain, using a spectrogram, one or more shapelets of one or more gestures captured from the one or more gesture windows;
• create a dictionary of basic shapelets of one or more motion patterns of a plurality of gestures comprised in the one or more activities performed by the subject;
• decompose, using the created dictionary of basic shapelets, the one or more shapelets to obtain a plurality of sub-shapelets of the one or more gestures captured from the one or more gesture windows, wherein each sub-shapelet is representative of a specific motion pattern of each of the one or more gestures captured from the one or more gesture windows;
• apply, at least one of (i) a positive or (ii) negative time delay to each of the plurality of sub-shapelets of the one or more gestures to obtain a plurality of composite shapelets for the one or more gestures, wherein the plurality of composite shapelets for the one or more gestures are obtained by superimposing positive and the negative time delays of each of the plurality of sub-shapelets, and wherein the positive and the negative time delay is provided to each of the plurality of sub-shapelets based on a displacement and a time pattern of the one or more gestures;
• and
• perform, a mapping of each of the plurality of composite shapelets with a plurality of trained shapelets stored in a system database to recognize the plurality of gestures comprised in the one or more activities being performed by the subject, wherein each of the plurality of composite shapelet is converted into a 2-dimensional or 3-dimensional vector and mapping is performed to recognize a new gesture performed by the subject.