Digital camera with audio, visual and motion analysis
AssigneeAcoustic Knowledge, LLC
InventorsCharles A. G. BOYLE, Caleb J. MADSEN
Life of this patent
Estimating the term…
Abstract
A digital camera with audio, visual and motion analysis includes a digital processor, an input processing system, and one or more imaging sensors, sound sensors, and motion sensors. In a non-limiting embodiment, the input processing system including non-transitory computer readable media including code segments, executable by the digital processor, for real-time audio, visual and motion analysis to develop a digital model of an ambient environment of the digital camera from data derived from the imaging sensor(s), sound sensor(s) and motion sensor(s).
Claims25
A digital camera with audio, visual and motion analysis comprising:
- a camera body;
- a lens supported by the camera body;
- an imaging sensor supported by the camera body in alignment with the lens;
- a sound sensor supported by the camera body;
- a motion sensor supported by the camera body;
- an input processing system supported by the camera body including
- (a) a system bus;
- (b) a digital processor coupled to the bus;
- (c) a sound sensor subsystem coupling an output of the sound sensor to the bus;
- (d) an imaging sensor subsystem coupling an output of the imaging sensor to the bus;
- (e) a motion sensor subsystem coupling an output of the motion sensor to the bus;
- (f) a high precision clock, separate from a system clock, to provide synchronous clock signals to the motion sensor subsystem, the imaging sensor subsystem, and the sound sensor subsystem;
- and
- (g) non-transitory digital memory coupled to the bus including code segments, executable by the digital processor, for real-time audio, visual and motion analysis to develop a digital model of an ambient environment of the digital camera from data derived from the motion sensor subsystem, the imaging sensor subsystem and the sound sensor subsystem.
A method for modeling an ambient environment with a digital camera comprising:
- collecting raw input data from a plurality of sensors including, at least, an imaging sensor, a sound sensor and a motion sensor;
- deriving metadata from the raw input data;
- and
- processing the metadata and the raw input data to develop a model of the ambient environment of the digital camera.
A method for providing augmented reality with a digital camera comprising:
- scanning an ambient environment with a digital camera including at least an imaging sensor, a sound sensor and a motion sensor;
- developing a model of the ambient environment with a digital processor of the digital camera that includes physical objects and their properties from data derived from the imaging sensor, the sound sensor and the motion sensor;
- and
- developing augmented reality (AR) to overlay the ambient environment.
A non-transitory computer readable medium comprising code segments executable on a digital processor of a digital camera for:
- scanning an ambient environment with a digital camera including at least an imaging sensor, a sound sensor and a motion sensor;
- developing a model of the ambient environment with a digital processor of the digital camera that includes physical objects and their properties from data derived from the imaging sensor, the sound sensor and the motion sensor;
- and
- developing augmented reality (AR) to overlay the ambient environment.
Dependencies are inferred from the claim text.