Back to results
US 12,710,826 B2Granted
Artificial reality based system, method, and computer program for modifying audio data based on gesture detection
AssigneeAlgoriddim GmbH
InventorsKariem Morsy, Federico Tessmann
Life of this patent
Estimating the term…
Abstract
The present invention provides a system for processing audio data, comprising an audio input unit for receiving input data, the input data being audio data representing a piece of music, an audio processing unit for processing the input data to obtain output data, an audio output unit for playing the output data, and a gesture detecting unit for detecting a gesture of a hand of a user, wherein the audio processing unit is connected to the gesture detecting unit and the audio output unit such as to modify processing of the input data depending on the gesture detected by the gesture detecting unit, while continuing playback of the output data.
Claims18
A system for processing audio data, comprising:
- an audio input unit for receiving input data, the input data being audio data representing a piece of music;
- an audio processing unit for processing the input data to obtain output data;
- an audio output unit for playing the output data;
- a gesture detecting unit for detecting a grip-rotate gesture of a hand of a user;
- wherein the grip-rotate gesture comprises a sequence of:
- a gripping action, which corresponds to gripping a rod-shaped virtual grip, wherein the virtual grip has a longitudinal axis defining a gripping axis, and a rotating gesture, which corresponds to rotating the virtual grip by a rotational angle about a rotational axis, said rotational axis being substantially orthogonal to the gripping axis;
- wherein the audio processing unit is connected to the gesture detecting unit and the audio output unit such as to modify processing of the input data depending on the rotational angle detected by the gesture detecting unit, while continuing playback of the output data;
- and
- an artificial reality apparatus adapted to provide visual input for a user to create an artificial reality environment, wherein the artificial reality apparatus is adapted to display the rod-shaped virtual grip at a predetermined virtual grip position in space within an area around the user, wherein the rod-shaped virtual grip has a longitudinal rod portion defining, along its longitudinal axis, the gripping axis of the virtual grip, wherein the longitudinal rod portion is displayed as having dimensions according to at least one of:
- a length of the rod portion is between about 0.04 m and about 0.60 m;
- a width of the rod portion is smaller than 0.12 m;
- and
- a length-to-width ratio of the rod portion is larger than 1.5.
10 more elements
A method comprising the steps of:
- receiving input data which are audio data representing a piece of music;
- processing the input data to obtain output data;
- playing the output data;
- detecting, by using a gesture detecting unit, a grip-rotate gesture of a hand of a user, wherein the grip-rotate gesture comprises a sequence of:
- detecting a gripping action, which corresponds to gripping a rod-shaped virtual grip,
- displaying the rod-shaped virtual grip at a predetermined virtual grip position in space within an area around the user, wherein the rod-shaped virtual grip has a longitudinal rod portion defining, along its longitudinal axis, a gripping axis of the virtual grip, wherein the longitudinal rod portion is displayed as having dimensions according to at least one of:
- a length of the rod portion is between about 0.04 m and about 0.60 m;
- a width of the rod portion is smaller than 0.12 m;
- and
- a length-to-width ratio of the rod portion is larger than 1.5;
- and
- a rotating gesture, which corresponds to rotating the virtual grip by a rotational angle about a rotational axis, said rotational axis being substantially orthogonal to the gripping axis;
- and
- modifying processing of the input data depending on the rotational angle detected by the gesture detecting unit, while continuing playback of the output data.
11 more elements
A non-transitory computer-readable medium embodying program code that, when executed by one or more processors, causes the processors to perform operations comprising:
- receiving input data which are audio data representing a piece of music;
- processing the input data to obtain output data;
- playing the output data;
- detecting, by using a gesture detecting unit, a grip-rotate gesture of a hand of a user, wherein the grip-rotate gesture comprises a sequence of:
- detecting a gripping action, which corresponds to gripping a rod-shaped virtual grip,
- displaying the rod-shaped virtual grip at a predetermined virtual grip position in space within an area around the user, wherein the rod-shaped virtual grip has a longitudinal rod portion defining, along its longitudinal axis, a gripping axis;
- and
- a rotating gesture, which corresponds to rotating the rod-shaped virtual grip by a rotational angle about a rotational axis, said rotational axis being substantially orthogonal to the gripping axis of the virtual grip, wherein the longitudinal rod portion is displayed as having dimensions according to at least one of:
- a length of the rod portion is between about 0.04 m and about 0.60 m;
- a width of the rod portion is smaller than 0.12 m;
- and
- a length-to-width ratio of the rod portion is larger than 1.5;
- and
- modifying processing of the input data depending on the rotational angle detected by the gesture detecting unit, while continuing playback of the output data.
11 more elements
Dependencies are inferred from the claim text.