Artificial reality based dj system, method and computer program implementing a scratching operation or a playback control operation

A system for processing audio data, comprising:

• an audio input unit for receiving audio data representing a piece of music;
• an audio processing unit for processing the audio data;
• an audio output unit for playing the audio data;
• a gesture detecting apparatus for touchless detection of hand gestures of a user's hand;
• wherein the gesture detecting apparatus is configured to detect a transport gesture of a user, wherein the transport gesture comprises the following sequence:
• positioning the hand within a tolerance zone around a first virtual transport controller position which is a predetermined position in an area around the user;
• gripping a virtual transport controller,
• dragging the virtual transport controller, while holding the gripping posture, from the first virtual transport controller position to a second virtual transport controller position;
• releasing the gripping posture;
• and
• wherein the audio processing unit is configured to carry out a playback setting operation based on a transport gesture detected by the gesture detecting apparatus, the playback setting operation comprising at least one of the following operations:
• starting playback of the audio data;
• stopping playback of the audio data;
• setting a playback position for playback of the audio data;
• selecting a piece of music from among a plurality of pieces of music;
• and
• operating the audio input unit to receive audio data representing the selected piece of music.

A method comprising the steps of providing audio data representing a piece of music;

• processing the audio data;
• playing the audio data;
• detecting, by a touchless user interface, a hand position, which is a position in space of a hand of a user, and detecting, by the touchless user interface, a turntable approach gesture when the hand position enters a first tolerance zone around a virtual turntable position, which is a predetermined position in space in an area around the user;
• providing a gesture scratch mode, wherein, when the gesture scratch mode is activated, the method carries out a scratching operation, the scratching operation including at least one of setting a playback direction of the audio data depending on a direction of movement of the hand, and setting a playback rate of the audio data depending on a movement velocity of the hand;
• and
• wherein the gesture scratch mode is activated upon touchless detection of the turntable approach gesture by the gesture detecting apparatus.

A method comprising the steps of:

• providing audio data representing a piece of music;
• processing the audio data;
• playing the audio data;
• detecting a transport gesture of a user by a touchless user interface, wherein the gesture comprises the following sequence of gestures:
• positioning a hand within a third tolerance zone around a first virtual transport controller position which is a predetermined position in an area around the user;
• gripping a virtual transport controller;
• dragging the virtual transport controller, while holding the gripping posture, from the first virtual transport controller position to a second virtual transport controller position;
• releasing the gripping posture;
• and
• carrying out a playback setting operation based on a detected transport gesture, the playback setting operation comprising at least one of the following operations:
• starting playback of the audio data;
• stopping playback of the audio data;
• setting a playback position for playback of the audio data;
• selecting a piece of music from among a plurality of pieces of music;
• and
• operating an audio input unit to receive audio data representing the selected piece of music.

A non-transitory computer-readable medium embodying program code that, when executed by one or more processors, causes the processors to perform operations comprising:

• providing audio data representing a piece of music;
• processing the audio data;
• playing the audio data;
• detecting, by a touchless user interface, a hand position, which is a position in space of a hand of a user, and detecting, by the touchless user interface, a turntable approach gesture when the hand position enters a first tolerance zone around a virtual turntable position, which is a predetermined position in space in an area around the user;
• providing a gesture scratch mode, wherein, when the gesture scratch mode is activated, the operations further include scratching operation, the scratching operation including at least one of setting a playback direction of the audio data depending on a direction of movement of the hand, and setting a playback rate of the audio data depending on a movement velocity of the hand;
• and
• wherein the gesture scratch mode is activated upon touchless detection of the turntable approach gesture by the gesture detecting apparatus.