Method and system of an acoustic scene analyzer for body sounds
AssigneeAventuSoft, LLC
InventorsKevin Jones, Garima Srivastava
Life of this patent
Estimating the term…
Abstract
A system and method for visualizing auditory scene analysis by way of a portable device is provided. In one embodiment, the method steps include capturing multiple sounds from a sensor array of microphones connected to the portable device, performing auditory scene analysis on detected body sounds in accordance with a psychoacoustic representation of body organ functions, and rendering to a display of the portable device a visualization of auditory scene auscultation of the body sounds, including user input functionality for separated sound source tracks, sound source identifier tracks, and sound source location trajectories.
Claims20
A portable device for visualizing auditory scene auscultation of body sounds, the portable device comprising:
- A visual display with user input;
- a sensor array of microphones to capture body sounds;
- a processor coupled to the visual display and the sensor array configured to:
- perform auditory scene analysis in accordance with a psychoacoustic interpretation of the captured body sounds;
- render to the display a visualization of auditory scene auscultation of the body sounds, including:
- separated sound source tracks;
- sound source identifier tracks;
- and sound source location trajectories,
- a speaker coupled to the processor to play the separated sound source tracks responsive to user input;
- and
- a power supply to provide power to electronic components of the portable device.
A method for visualizing auditory scene auscultation of body sounds by way of a portable device, the method comprising the steps of:
- capturing body sounds from a sensor array detecting both vibrations from infrasound and acoustically transmitted audible sound connected to the portable device;
- performing auditory scene analysis on the captured body sounds in accordance with a psychoacoustic representation of body organ functions;
- rendering to a display of the portable device a visualization of auditory scene auscultation of the body sounds, including:
- separated sound source tracks, sound source identifier tracks;
- and sound source location trajectories.
A portable device for visualizing auscultation of body sounds, the portable device comprising:
- a visual display with user input;
- a sensor array of microphones to capture body sounds comprising vibrations from infrasound and acoustically transmitted audible sound;
- a processor coupled to the visual display and the sensor array programmed with sequential order of processing:
- a first software module to extract features from an auditory scene analysis based on psychoacoustic characteristics of the body sounds;
- a second software module to identify unique sources of the body sounds from the features;
- a third software module to estimate masking patterns of each identified sound source based on sound generation characteristics of the sound sources;
- a fourth software module to perform sound source separation based on the identified unique sound sources, masking patterns, and extracted features;
- a fifth software module to localize sound sources and generate a location for identified sound sources;
- and
- a sixth software module to track the location of the identified sound sources,
- wherein the processor determines if the sensor array is in non-body contact or body contact and compensates accordingly during psychoacoustic interpretation of the captured body sounds, and renders to the display a visualization of auditory scene auscultation of the body sounds.
Dependencies are inferred from the claim text.