Back to results
US 12,159,611 B2Granted
Video control device and video control method
AssigneeRoland Corporation
InventorsSatoshi Kusakabe, Yasuto Saito
Life of this patent
Estimating the term…
Abstract
This video control device includes: a detection unit that detects a beat timing of audio; and a control unit that updates a display mode of a video on the basis of the beat timing and change information indicating a change in a display mode of a video displayed on a display device.
Claims20
A video control device comprising:
- a detection unit configured to detect a beat timing of an audio;
- and
- a control unit configured to control a video including a first video and a second video different from the first video displayed on a display device based on the beat timing,
- wherein the control unit switches the video displayed on the display device from one of the first video and the second video to another video of the first video and the second video as controlling of the video,
- wherein the control unit performs a parallel playback process of the audio, the first video, and the second video and performs repeated playback of the first video or the second video ended during playback of the audio,
- wherein the audio is attached with the video which is being reproduced, and
- wherein the beat timing of the audio is detected by the detection unit from the audio attached with the video which is being reproduced,
- wherein the detection unit performs a process of generating timing information for governing a beat of the audio and intensity data indicating power at a timing from data of the audio, a process of calculating a period and a phase of the beat of the audio using the intensity data, and a process of detecting the beat timing based on the period and the phase of the beat of the audio,
- wherein the detection unit performs Fourier transform that has an attenuation term on the intensity data with regard to a plurality of beats per minute (BPMs) and calculates, as the period of the beat of the audio, a BPM among the plurality of BPMs when an absolute value of a value of the Fourier transform is maximum.
6 more elements
A video control device comprising:
- a detection unit configured to detect a beat timing of an audio;
- and
- a control unit configured to control a video including a first video and a second video different from the first video displayed on a display device based on the beat timing,
- wherein the control unit switches the video displayed on the display device from one of the first video and the second video to another video of the first video and the second video as controlling of the video,
- wherein the control unit performs a parallel playback process of the audio, the first video, and the second video and performs repeated playback of the first video or the second video ended during playback of the audio,
- wherein the audio is attached with the video which is being reproduced, and
- wherein the beat timing of the audio is detected by the detection unit from the audio attached with the video which is being reproduced,
- wherein the detection unit performs a process of generating timing information for governing a beat of the audio and intensity data indicating power at a timing from data of the audio, a process of calculating a period and a phase of the beat of the audio using the intensity data, and a process of detecting the beat timing based on the period and the phase of the beat of the audio,
- wherein the detection unit obtains a plurality of wavelet-transformed values by performing Fourier transform on a plurality of values obtained by multiplying window functions shifted by a 1/n period of a BPM corresponding to the period of the beat of the audio by the intensity data, and calculates, as the phase of the beat of the audio, a phase when absolute values of the plurality of wavelet-transformed values are maximum, and n is an integer equal to or greater than 2.
6 more elements
A video control device comprising:
- a detection unit configured to detect a beat timing of an audio;
- and
- a control unit configured to control a video including a first video and a second video different from the first video displayed on a display device based on the beat timing,
- wherein the control unit switches the video displayed on the display device from one of the first video and the second video to another video of the first video and the second video as controlling of the video,
- wherein the control unit performs a parallel playback process of the audio, the first video, and the second video and performs repeated playback of the first video or the second video ended during playback of the audio,
- wherein the audio is attached with the video which is being reproduced, and
- wherein the beat timing of the audio is detected by the detection unit from the audio attached with the video which is being reproduced,
- wherein the detection unit performs a process of generating timing information for governing a beat of the audio and intensity data indicating power at a timing from data of the audio, a process of calculating a period and a phase of the beat of the audio using the intensity data, and a process of detecting the beat timing based on the period and the phase of the beat of the audio,
- wherein the detection unit obtains a count value indicating the period of the beat and the phase of the beat, measures the count value using a counter incremented for each sample of a sampling rate, and detects a timing at which a value of the counter reaches the count value as the beat timing.
6 more elements
Dependencies are inferred from the claim text.