Digital camera system for acoustic modeling
AssigneeAcoustic Knowledge, LLC
InventorsCharles A. G. Boyle, Caleb J. Madsen
Life of this patent
Estimating the term…
Abstract
A digital camera with audio, visual and motion analysis includes a digital processor, an input processing system, and one or more imaging sensors, sound sensors, and motion sensors. In a non-limiting embodiment, the input processing system including non-transitory computer readable media including code segments, executable by the digital processor, for real-time audio, visual and motion analysis to develop a digital model of an ambient environment of the digital camera from data derived from the imaging sensor(s), sound sensor(s) and motion sensor(s).
Claims7
A digital camera system for acoustic modeling comprising:
- a camera body;
- a lens supported by the camera body;
- an imaging sensor supported by the camera body in alignment with the lens;
- a sound sensor supported by the camera body;
- an input processing system supported by the camera body including
- (a) a system bus;
- (b) a digital processor coupled to the bus;
- (c) a sound sensor subsystem coupling an output of the sound sensor to the bus;
- (d) a high precision clock, separate from a system clock, coupled to the sound sensor subsystem;
- and
- (e) non-transitory digital memory coupled to the bus including code segments, executable by the digital processor, for real-time audio analysis to develop a digital model of an ambient environment of the digital camera including the synthesis of both motion signals and imaging signals from data derived from the sound sensor subsystem, wherein the code segments include:
- code segments to collect raw image data from an imaging sensor of a digital camera;
- code segments to collect raw sound data from a sound sensor of the digital camera;
- code segments to derive metadata including the synthesis of both motion signals and imaging signals from the raw image data and the raw sound data;
- code segments to process the metadata and the raw sound data to develop a model of the ambient environment of the digital camera based upon the raw sound data by implementing at least one of a Structure from Motion (SfM) process and a Simultaneous Localization And Mapping (SLAM) process.
Dependencies are inferred from the claim text.