Audiovisual data recording device and method
AssigneeFUJIFILM Corporation
InventorsSatoshi Nakamura, Mikio Watanabe
Life of this patent
Estimating the term…
Abstract
In each of photographed L and R viewpoint images, an object area and an object size are detected. A disparity calculator calculates a maximum disparity of the object area between the L and R viewpoint images. A sound image locating unit determines the shift amount of a reverberation sound ratio from a standard ratio based on the object size and the maximum disparity, to give an appropriate depth to sound data. The sound image locating unit also locates the sound data with an appropriate location angle in accordance with the position of a horizontal center of the object area. The processed sound data and L and R viewpoint image data are compressed, and recorded as an AV file on a memory card.
Claims10
An audiovisual data recording device for recording a stereo motion image with a sound, comprising:
- a plurality of imaging units for capturing one set of viewpoint images for composing the stereo motion image at a predetermined time interval, each of the imaging units having an imaging optical system and an image sensor;
- a plurality of microphones for capturing raw sound data during the capture of the viewpoint images;
- an object area detector for detecting a main object area in each of the viewpoint images, the main object area containing a main object;
- an information obtaining section for obtaining disparity information whenever the one set of viewpoint images is captured;
- a determining section for determining where to locate a sound image as sound image location information, based on the main object area detected by the object area detector and the disparity information obtained by the information obtaining section;
- a recorder for recording on a recording medium the raw sound data and the sound image location information, or processed sound data with the located sound image, together with data of the viewpoint images;
- and
- a sound image locating unit for converting the raw sound data captured by the microphones into the processed sound data based on the sound image location information, if the processed sound data is recorded on the recording medium,
- wherein the sound image locating unit locates the sound image in a depth direction by varying a ratio between a direct sound and a reverberation sound.
A method for recording an audiovisual data containing a stereo motion image with a sound, comprising the steps of:
- capturing by a plurality of imaging units one set of viewpoint images for composing the stereo motion image at a predetermined time interval, each of the imaging units having an imaging optical system and an image sensor;
- capturing by a plurality of microphones raw sound data during the capture of the viewpoint images;
- detecting a main object area in each of the viewpoint images, the main object area containing a main object;
- obtaining disparity information whenever the one set of viewpoint images is captured;
- determining where to locate a sound image as sound image location information, based on the main object area and the disparity information;
- recording on a recording medium the raw sound data and the sound image location information, or processed sound data with the located sound image, together with data of the viewpoint images;
- converting the raw sound data captured by the microphones into the processed sound data based on the sound image location information, if the processed sound data is recorded on the recording medium;
- and
- locating the sound image in a depth direction by varying a ratio between a direct sound and a reverberation sound.
Dependencies are inferred from the claim text.