Radar-Based Gesture Classification Using a Variational Auto-Encoder Neural Network
AssigneeInfineon Technologies AG
InventorsAvik Santra, Souvik Hazra, Thomas Reinhold Stadelmayer
Life of this patent
Estimating the term…
Abstract
In an embodiment, a method includes: obtaining one or more positional time spectrograms of a radar measurement of a scene comprising an object; and based on the one or more positional time spectrograms and based on a feature embedding of a variational auto-encoder neural network, predicting a gesture class of a gesture performed by the object.
Claims20
A method comprising:
- obtaining one or more positional time spectrograms of a radar measurement of a scene comprising an object;
- and
- based on the one or more positional time spectrograms and based on a feature embedding of a variational auto-encoder neural network, predicting a gesture class of a gesture performed by the object.
A method for training a variational auto-encoder neural network for predicting a gesture class of a gesture performed by an object of a scene, the gesture class being selected from a plurality of gesture classes, the method comprising:
- obtaining multiple training sets of one or more training positional time spectrograms (of a radar measurement of the scene comprising the object, each one of the multiple training sets being associated with a respective ground-truth label indicative of the respective gesture class;
- and
- training the variational auto-encoder neural network based on the multiple training sets and the associated ground-truth labels.
A radar system comprising:
- a millimeter-wave radar sensor configured to transmit radar signals towards a scene, receive reflected radar signals from the scene, and generate radar measurement data based on the reflected radar signals;
- and
- a processor configured to:
- generate one or more positional time spectrograms based on the radar measurement data, and
- based on the one or more positional time spectrograms and based on a feature embedding of a variational auto-encoder neural network, predict a gesture class of a gesture performed by an object in the scene.
Dependencies are inferred from the claim text.