Accessible audio intent visualization for interactive environments
AssigneeSony Interactive Entertainment Inc.
InventorsRajeev Gupta, Mark Jacobus Breugelmans, Carl Pryke, Lloyd Preston Stemple
Life of this patent
Estimating the term…
Abstract
An audio visualisation method includes: generating for output a virtual environment comprising at least a first virtual sound source, classifying an intended effect on a user of a sound to be output by the at least first virtual sound source, outputting the sound, and producing a visual element for view by the user that has a visual property selected to correspond to the classified intended effect.
Claims17
A method, comprising:
- generating a virtual environment comprising a virtual sound source;
- prior to outputting a sound, classifying an intended effect on a user of the sound that is to be output to the user, the sound corresponding to the virtual sound source, a class of the intended effect being selected from (i) understanding, (ii) awareness, (iii) emotion, and (iv) physiological response, wherein classifying the intended effect on the user comprises analyzing metadata associated with the sound and metadata associated with the virtual sound source;
- selecting, according to a consistent visual grammar, a type of visual element based on the classified intended effect, the type of visual element being selected from a color, an icon, a word, or a shape;
- outputting the sound;
- and
- producing a visual element of the selected type of visual element for view by the user that has at least one visual property selected to correspond to the classified intended effect, the at least one visual property including one or more of brightness, saturation, shape, and scale.
A non-transitory, computer-readable storage medium having stored thereon computer executable instructions adapted to cause a computer system to perform a method comprising:
- generating a virtual environment comprising a virtual sound source;
- prior to outputting a sound, classifying an intended effect on a user of the sound that is to be output to the user, the sound corresponding to the virtual sound source, a class of the intended effect being selected from (i) understanding, (ii) awareness, (iii) emotion, and (iv) physiological response, wherein classifying the intended effect on the user comprises analyzing metadata associated with the sound and metadata associated with the virtual sound source;
- selecting, according to a consistent visual grammar, a type of visual element based on the classified intended effect, the type of visual element being selected from a color, an icon, a word, or a shape;
- outputting the sound;
- and
- producing a visual element of the selected type of visual element for view by the user that has at least one visual property selected to correspond to the classified intended effect, the at least one visual property including one or more of brightness, saturation, shape, and scale.
An apparatus, comprising:
- one or more processors;
- one or more computer-readable storage media storing instructions which, when executed by the one or more processors, cause the apparatus to perform operations comprising:
- generating a virtual environment comprising a virtual sound source;
- prior to outputting a sound, classifying an intended effect on a user of the sound that is to be output to the user, the sound corresponding to the virtual sound source, a class of the intended effect being selected from (i) understanding, (ii) awareness, (iii) emotion, and (iv) physiological response, wherein classifying the intended effect on the user comprises analyzing metadata associated with the sound and metadata associated with the virtual sound source;
- selecting, according to a consistent visual grammar, a type of visual element based on the classified intended effect, the type of visual element being selected from a color, an icon, a word, or a shape;
- outputting the sound;
- and
- producing a visual element of the selected type of visual element for view by the user that has at least one visual property selected to correspond to the classified intended effect, the at least one visual property including one or more of brightness, saturation, shape, and scale.
Dependencies are inferred from the claim text.