# US 9,040,805 B2 · Information processing apparatus, sound material capturing method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,040,805 B2 - Document ID: US9040805B2 - Status: Granted - Kind: B2 - Application number: 13/186,832 - Filed: 2011-07-20 - Published: 2012-05-24 - Granted: 2015-05-26 - Earliest claimed: 2008-12-05 - Assignees: Sony Corporation - Applicants: Yoshiyuki Kobayashi - Inventors: Yoshiyuki Kobayashi - Web page: https://patentgrep.com/patent/US9040805B2 ## CPC - G10H 1/0025: {Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece (automatically producing a series of tones G10H1/26)} - G10H 1/38: Chord - G10H 2210/051: for extraction or detection of onsets of musical sounds or notes, i.e. note attack timings - G10H 2210/056: for extraction or identification of individual instrumental parts, e.g. melody, chords, bass; Identification or separation of instrumental parts by their characteristic voices or timbres - G10H 2210/076: for extraction of timing, tempo; Beat detection - G10H 2210/131: Morphing, i.e. transformation of a musical piece into a new different one, e.g. remix - G10H 2210/576: Chord progression - G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE ## Abstract An information processing apparatus is provided which includes a music analysis unit for analyzing an audio signal serving as a capture source for a sound material and for detecting beat positions of the audio signal and a presence probability of each instrument sound in the audio signal, and a capture range determination unit for determining a capture range for the sound material by using the beat positions and the presence probability of each instrument sound detected by the music analysis unit. ## Claims ### Claim 1 An information processing apparatus comprising: a music analysis unit for analyzing an audio signal serving as a capture source for a sound material and for detecting beat positions of the audio signal and a presence probability of each instrument sound in the audio signal; a capture range determination unit for determining a capture range for the sound material by using the beat positions and the presence probability of each instrument sound detected by the music analysis unit; and a sound source separation unit that separates, a signal for foreground sound, a signal for background sound, and a center signal to compute the presence probability of each instrument sound, wherein the sound source separation unit comprises: a left-channel band division unit for converting a left-channel signal to a frequency domain; a right-channel band division unit for converting a right-channel signal into the frequency domain; a left-channel band synthesis unit for extracting a first center signal portion; and a right-channel band synthesis unit for extracting a second center signal portion. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, further comprising: a material capturing unit for capturing the capture range determined by the capture range determination unit from the audio signal and for outputting the capture range as the sound material. ### Claim 3 (depends on 1) The information processing apparatus according to claim 1, wherein the sound source separation unit separates the signal of each sound source from a plurality of types of sound sources included in the audio signal. ### Claim 4 (depends on 1) The information processing apparatus according to claim 1, wherein the music analysis unit further detects a chord progression of the audio signal by analyzing the audio signal, and the capture range determination unit determines the capture range for the sound material and outputs, along with information on the capture range, a chord progression in the capture range. ### Claim 5 (depends on 2) The information processing apparatus according to claim 2, wherein the music analysis unit further detects a chord progression of the audio signal by analyzing the audio signal, and the material capturing unit outputs, as the sound material, an audio signal of the capture range, and also outputs a chord progression in the capture range. ### Claim 6 (depends on 1) The information processing apparatus according to claim 1, wherein the music analysis unit generates a calculation formula for extracting information relating to the beat positions and information relating to the presence probability of each instrument sound by using a calculation formula generation apparatus capable of automatically generating a calculation formula for extracting feature quantity of an arbitrary audio signal, and detects the beat positions of the audio signal and the presence probability of each instrument sound in the audio signal by using the calculation formula, the calculation formula generation apparatus automatically generating the calculation formula by using a plurality of audio signals and the feature quantity of each of the audio signals. ### Claim 7 (depends on 2) The information processing apparatus according to claim 2, wherein the sound source separation unit separates the signal for foreground sound and the signal for background sound from the audio signal and also separates from each other the centre signal localized around a centre, the left-channel signal and the right-channel signal in the signal for foreground sound. ### Claim 8 An information processing apparatus comprising: a music analysis unit for analyzing an audio signal serving as a capture source for a sound material and for detecting beat positions of the audio signal and a presence probability of each instrument sound in the audio signal; a capture range determination unit for determining a capture range for the sound material by using the beat positions and the presence probability of each instrument sound detected by the music analysis unit; and a capture request input unit for inputting a capture requesting including, as information, at least one of a length of a range to be captured as the sound material, types of instrument sounds and strictness for capturing, wherein the capture range determination unit determines the capture range for the sound material so that the sound material meets the capture request input by the capture request input unit. ### Claim 9 (depends on 8) The information processing apparatus according to claim 8, wherein the capture range determination unit includes a material score computation unit for totalling presence probabilities of instrument sounds of types specified by the capture request for each range of the audio signal and for computing, as a material score, a value obtained by dividing the totalled presence probability by a total of presence probabilities of all instrument sounds in the range, each range having a length of the capture range specified by the capture request, and determines, as a capture range meeting the capture request, a range where the material score computed by the material score computation unit is higher than a value of the strictness for capturing. ### Claim 10 A sound material capturing method comprising, when an audio signal serving as a capture source for a sound material is input to an information processing apparatus, the steps of: using a computer to analyze the audio signal and to detect beat positions of the audio signal and a presence probability of each instrument sound in the audio signal; using a computer to determine a capture range for the sound material by using the beat positions and the presence probability of each instrument sound detected by the step of analyzing and detecting; and using a computer to separate, from the audio signal, a signal for foreground sound and a signal for background sound to compute the presence probability of each instrument sound, wherein separating the audio signal comprises: converting a left-channel signal to a frequency domain; converting a right-channel signal into the frequency domain; extracting a first center signal portion; and extracting a second center signal portion. ### Claim 11 A computer program product tangibly embodied as instructions on a non-transitory computer-readable storage medium, the computer program causing a computer to realize: when an audio signal serving as a capture source for a sound material is input, a music analysis function for analyzing the audio signal and for detecting beat positions of the audio signal and a presence probability of each instrument sound in the audio signal; a capture range determination function for determining a capture range for the sound material by using the beat positions and the presence probability of each instrument sound detected by the music analysis function; and a sound source separation unit for separating a signal for foreground sound, a signal for background sound, and a center signal to compute the presence probability of each instrument sound, wherein the sound source separation unit comprises: a left-channel band division unit for converting a left-channel signal to a frequency domain; a right-channel band division unit for converting a right-channel signal into the frequency domain; a left-channel band synthesis unit for extracting a first center signal portion; and a right-channel band synthesis unit for extracting a second center signal portion.