System for converting images into sound spectrum
OwnerAndrea VITALETTI, Augusto GRENGAinventors
Life of this patent
Estimating the term…
Abstract
Disclosed is a system for the real-time acquisition, analysis, and conversion of the visual spectrum of shapes, images, colors, and signs into sound spectrum, which is usable in various communicative contexts, such as in the field of interactive videogames, computer science, neuroscience and neuroimaging in the medical field, visual arts, social arts, but also in the pedagogical field, characterized in that it includes a hardware component for the analog optical acquisition of the still or dynamic images present on a transparent flat surface of the hardware component, and a software component for processing the acquired images and converting their visual spectrum into sound spectrum.
Claims13
A system for the real-time acquisition, analysis, and conversion of the visual spectrum of shapes, images, colors, and signs into sound spectrum, which is usable in various communicative contexts, the system comprising a hardware component for the analog optical acquisition of the images either moved or drawn on a transparent flat surface of said hardware component, and a software component for processing the acquired images and converting the visual spectrum thereof into sound spectrum;
- wherein the hardware component comprises a chamber, the upper base of which substantially consists of a transparent material plate and on the lower base of which an image acquisition device is accommodated, facing the transparent plate and configured to frame the transparent plate completely;
- wherein the side walls are provided with lighting means configured to ensure a correct illumination of the inner surface of the transparent plate which forms a working space, as well as a homogeneous diffusion of the light in the upper part of the chamber itself which ensures uniformity of illumination without shadows or reflections with respect to the lens of the acquisition device, so as not to create areas which are too bright or too in shade and distort the image acquisition;
- and wherein the software component is configured to detect every RGB value of each pixel acquired by the acquisition device, and process and convert the values detected in order to associate, with each of the acquired pixels, three values consisting of, respectively:
- a sound frequency value, given by the sum of the R, G and B values converted into the auditory frequency range;
- a sound intensity value, corresponding to the saturation value from the HSL array, wherein said saturation value, and thus said sound intensity value, is correlated to the space occupied by said images either moved or drawn on the flat transparent surface of the hardware component;
- a sound duration value, corresponding to the brightness value from the HSL array, wherein said brightness value, and thus said sound duration value, is correlated to the time it took to move or draw said images on the flat transparent surface of the hardware component;
- wherein said three values correspond to a specific sound associated with a specific acquired pixel.
A method for the real-time acquisition, analysis, and conversion of the visual spectrum of shapes, images, colors and signs into sound spectrum, which is usable in various communicative contexts, the method including using a system comprising at least one hardware module, comprising image acquisition means, and a software module, wherein said modules are functionally connected to acquire the visual spectrum of the images and process the visual spectrum to convert the visual spectrum into a sound spectrum according to the following steps:
- acquiring the image which is moved or drawn on a working surface by the image acquisition means by means of an optical device with detection of the pixels of said image;
- processing the acquired image pixels by the software module to detect each RGB value of each acquired pixel;
- processing and converting the detected RGB values into HSL values in order to associate, with each of the acquired pixels, three values consisting of, respectively:
- a sound frequency value, given by the sum of the R, G and B values converted into the auditory frequency range;
- a sound intensity value, corresponding to the saturation value from the HSL array, and a sound duration value, corresponding to the brightness value from the HSL array,
- wherein:
- said saturation value, and thus said sound intensity value, is correlated to the space occupied by said images either moved or drawn on the flat transparent surface of the hardware component;
- and
- said brightness value, and thus said sound duration value, is correlated to the time it took to move or draw said images on the flat transparent surface of the hardware component.
Dependencies are inferred from the claim text.