Digital camera system with acoustic modeling
AssigneeAcoustic Knowledge, LLC
InventorsCharles A. G. BOYLE, Caleb J. MADSEN
Life of this patent
Estimating the term…
Abstract
A digital camera with audio, visual and motion analysis includes a digital processor, an input processing system, and one or more imaging sensors, sound sensors, and motion sensors. In a non-limiting embodiment, the input processing system including non-transitory computer readable media including code segments, executable by the digital processor, for real-time audio, visual and motion analysis to develop a digital model of an ambient environment of the digital camera from data derived from the imaging sensor(s), sound sensor(s) and motion sensor(s).
Claims21
A digital camera system with acoustic modeling comprising:
- a camera body;
- a lens supported by the camera body;
- an imaging sensor supported by the camera body in alignment with the lens;
- a sound sensor supported by the camera body;
- a display supported by the camera body capable of displaying an image;
- an input processing system supported by the camera body including
- (a) a system bus;
- (b) a digital processor coupled to the bus;
- (c) a sound sensor subsystem coupling an output of the sound sensor to the bus;
- and
- (d) non-transitory digital memory coupled to the bus including code segments, executable by the digital processor, for real-time audio, visual and motion analysis to develop a digital model of an ambient environment of the digital camera from data derived from the sound sensor subsystem, and code segments, executable by the digital processor, for overlaying an augmented reality (AR) image over an image of the ambient environment on the display.
A method for providing augmented reality by acoustic modeling on a digital camera comprising:
- scanning an ambient environment with a digital camera having a plurality of sensors including, at least, an imaging sensor, a sound sensor and a motion sensor;
- obtaining raw input date from the plurality of sensors;
- deriving metadata from the raw input data;
- processing the metadata and the raw input data with a digital processor of the digital camera to develop a model of the ambient environment of the digital camera that includes physical objects and their properties from data derived from the imaging sensor, the sound sensor and the motion sensor;
- developing an augmented reality (AR) image related to the ambient environment image;
- and
- displaying the ambient environment image and the AR image on a screen of the digital camera.
A non-transitory computer readable medium comprising code segments executable on a digital processor of a digital camera comprising:
- code segments to scan an ambient environment with a digital camera having a plurality of sensors including, at least, an imaging sensor, a sound sensor and a motion sensor;
- code segments to obtain raw input data from the plurality of sensors;
- code segments to derive metadata from the raw input data;
- code segments to process the metadata and the raw input data with a digital processor of the digital camera to develop a model of the ambient environment of the digital camera that includes physical objects and their properties from data derived from the imaging sensor, the sound sensor and the motion sensor;
- and
- code segments to develop augmented reality (AR) to overlay the ambient environment.
Dependencies are inferred from the claim text.