Digital camera with audio, visual and motion analysis
AssigneeAcoustic Knowledge, LLC
InventorsCharles A. G. Boyle, Caleb J. Madsen
Life of this patent
Estimating the term…
Abstract
A digital camera with audio, visual and motion analysis includes a digital processor, an input processing system, and one or more imaging sensors, sound sensors, and motion sensors. In a non-limiting embodiment, the input processing system including non-transitory computer readable media including code segments, executable by the digital processor, for real-time audio, visual and motion analysis to develop a digital model of an ambient environment of the digital camera from data derived from the imaging sensor(s), sound sensor(s) and motion sensor(s).
Claims25
A digital camera with audio, visual and motion analysis comprising:
- a camera body;
- a lens supported by the camera body;
- an imaging sensor supported by the camera body in alignment with the lens;
- a sound sensor supported by the camera body;
- an input processing system supported by the camera body including
- (a) a system bus;
- (b) a digital processor coupled to the bus;
- (c) a sound sensor subsystem coupling an output of the sound sensor to the bus;
- (d) a high precision clock, separate from a system clock, to provide synchronous clock signals to the sound sensor subsystem;
- and
- (e) non-transitory digital memory coupled to the bus including code segments, executable by the digital processor, for real-time audio, visual and motion analysis to develop a digital model of an ambient environment of the digital camera from data derived from the sound sensor subsystem.
A method for modeling an ambient environment with a digital camera comprising:
- collecting raw image input data from an imaging sensor of a digital camera;
- collecting raw sound data from a sound sensor of the digital camera;
- deriving metadata including the synthesis of both motion signals and imaging signals from the raw image data and the raw sound data;
- and
- processing the metadata and the raw sound data to develop a model of the ambient environment of the digital camera by an implementation of at least one of a Structure from Motion (SfM) process and a Simultaneous Localization And Mapping (SLAM) process.
A method for providing augmented reality with a digital camera comprising:
- scanning an ambient environment with a digital camera including a sound sensor;
- developing a model of the ambient environment with a digital processor of the digital camera that includes physical objects and their properties from data derived from the sound sensor;
- and
- developing augmented reality (AR) to overlay the ambient environment.
A non-transitory computer readable medium comprising code segments executable on a digital processor of a digital camera for:
- scanning an ambient environment with a digital camera including a sound sensor;
- developing a model of the ambient environment with a digital processor of the digital camera that includes physical objects and their properties from data derived from the sound sensor;
- and
- developing augmented reality (AR) to overlay the ambient environment.
Dependencies are inferred from the claim text.