Information processing apparatus, configured to generate an audio signal corresponding to a virtual viewpoint image, information processing system, information processing method, and non-transitory computer-readable storage medium
AssigneeCanon Kabushiki Kaisha
InventorMasanobu Funakoshi
Life of this patent
Estimating the term…
Abstract
An information processing apparatus acquires information about designation of a position of a virtual viewpoint related to a virtual viewpoint image generated based on image capturing by a plurality of cameras, and decides, based on the information, a virtual listening point for generating an audio signal based on sound pickup at a plurality of sound pickup points.
Claims21
1-20. (canceled)
An information processing system configured to generate an audio signal associated with a virtual viewpoint image, the information processing apparatus comprising:
- one or more processors;
- and
- a memory which stores instructions executable by the one or more processors to cause the information processing system to perform:
- acquiring information related to a position of a virtual viewpoint for the virtual viewpoint image generated based on images obtained by capturing a region from a plurality of directions by a plurality of image capturing apparatus;
- determining, based on a position of an object in the region and the acquired information related to the position of the virtual viewpoint, at least one collected sound signal to be used for generating the audio signal from among a plurality of collected sound signals based on sound collection by a plurality of microphones for collecting sounds in at least a part of the region;
- and
- generating the audio signal by using the at least one collected sound signal determined.
An information processing system configured to generate an audio signal associated with a virtual viewpoint image, the information processing apparatus comprising:
- one or more processors;
- and
- a memory which stores instructions executable by the one or more processors to cause the information processing system to perform:
- acquiring information related to a position of a virtual viewpoint for the virtual viewpoint image generated based on images obtained by capturing a region from a plurality of directions by a plurality of image capturing apparatus;
- determining, based on a position of a horizontal surface in the region and the acquired information related to the position of the virtual viewpoint, at least one collected sound signal to be used for generating the audio signal from among a plurality of collected sound signals based on sound collection by a plurality of microphones for collecting sounds in at least a part of the region;
- and
- generating the audio signal by using the at least one collected sound signal determined.
An information processing method for generating an audio signal associated with a virtual viewpoint image, the information processing method comprising:
- acquiring information related to a position of a virtual viewpoint for the virtual viewpoint image generated based on images obtained by capturing a region from a plurality of directions by a plurality of image capturing apparatus;
- determining, based on a position of an object in the region and the acquired information related to the position of the virtual viewpoint, at least one collected sound signal to be used for generating the audio signal from among a plurality of collected sound signals based on sound collection by a plurality of microphones for collecting sounds in at least a part of the region;
- and
- generating the audio signal by using the at least one collected sound signal determined.
A non-transitory computer-readable medium storing a program for causing a computer to execute a method, the method comprising:
- acquiring information related to a position of a virtual viewpoint for a virtual viewpoint image generated based on images obtained by capturing a region from a plurality of directions by a plurality of image capturing apparatus;
- determining, based on a position of an object in the region and the acquired information related to the position of the virtual viewpoint, at least one collected sound signal to be used for generating an audio signal associated with the virtual viewpoint image from among a plurality of collected sound signals based on sound collection by a plurality of microphones for collecting sounds in at least a part of the region;
- and
- generating the audio signal by using the at least one collected sound signal determined.
Dependencies are inferred from the claim text.