Back to results
US 11,451,759 B2Granted
Generation apparatus, generation method, and storage medium
AssigneeCanon Kabushiki Kaisha
InventorHiroyasu Ito
Life of this patent
Estimating the term…
Abstract
A generation apparatus according to the present invention is a generation apparatus for generating a media file storing virtual viewpoint image data generated based on pieces of image data of an object captured from a plurality of directions with a plurality of cameras, and obtains a virtual viewpoint parameter to be used to generate virtual viewpoint image data. Further, the generation apparatus generates a media file storing the obtained virtual viewpoint parameter and virtual viewpoint image data generated based on the virtual viewpoint parameter. In this way, the generation apparatus can improve usability related to a virtual viewpoint image.
Claims13
A generation apparatus comprising:
- one or more memories;
- and
- one or more processors functioning by executing instructions stored in the one or more memories as the following units:
- an obtaining unit configured to obtain a plurality of sets of virtual viewpoint parameters, the virtual viewpoint parameters indicating a position of a virtual viewpoint and a direction from a virtual viewpoint, and being used to for generating virtual viewpoint image data generated based on image data obtained based on image capturing by a plurality of imaging devices;
- and
- a generation unit configured to generate a media file storing the plurality of sets of virtual viewpoint parameters obtained by the obtaining unit and virtual viewpoint image data generated based on the plurality of sets of virtual viewpoint parameters obtained by the obtaining unit, (i) the plurality of sets of virtual viewpoint parameters being stored in a header area in a head of the media file, (ii) each of sets of virtual viewpoint parameters corresponding to one of frames included in the virtual viewpoint image data, and (iii) a set of virtual viewpoint parameters including a parameter for specifying one of the frames included in the virtual viewpoint image data, a parameter indicating a position of the virtual viewpoint corresponding to the one of the frames included in the virtual viewpoint image data, and a parameter indicating a direction from the virtual viewpoint corresponding to the one of the frames included in the virtual viewpoint image data.
3 more elements
A generation method comprising:
- obtaining a plurality of sets of virtual viewpoint parameters, the virtual viewpoint parameters indicating a virtual viewpoint and a direction from a virtual viewpoint, and being used for generating virtual viewpoint image data generated based on image data obtained based on image capturing by a plurality of imaging devices;
- and
- generating a media file storing the plurality of sets of virtual viewpoint parameters and virtual viewpoint image data generated based on the obtained plurality of sets of virtual viewpoint parameters, (i) the plurality of sets of virtual viewpoint parameters being stored in a header area in a head of the media file, (ii) each of sets of virtual viewpoint parameters corresponding to one of frames included in the virtual viewpoint image data, and (iii) a set of virtual viewpoint parameters including a parameter for specifying one of the frames included in the virtual viewpoint image data, a parameter indicating a position of the virtual viewpoint corresponding to the one of the frames included in the virtual viewpoint image data, and a parameter indicating a direction from the virtual viewpoint corresponding to the one of the frames included in the virtual viewpoint image data.
A non-transitory computer readable storage medium storing a program which causes a computer to perform a generation method, the generation method comprising:
- obtaining a plurality of sets of virtual viewpoint parameters, the virtual viewpoint parameters indicating a virtual viewpoint and a direction from a virtual viewpoint, and being used for generating virtual viewpoint image data generated based on image data obtained based on image capturing by a plurality of imaging devices;
- and
- generating a media file storing the plurality of sets of virtual viewpoint parameters and virtual viewpoint image data generated based on the obtained plurality of sets of virtual viewpoint parameters, (i) the plurality of sets of virtual viewpoint parameters being stored in a header area in a head of the media file, (ii) each of sets of virtual viewpoint parameters corresponding to one of frames included in the virtual viewpoint image data, and (iii) a set of virtual viewpoint parameters including a parameter for specifying one of the frames included in the virtual viewpoint image data, a parameter indicating a position of the virtual viewpoint corresponding to the one of the frames included in the virtual viewpoint image data, and a parameter indicating a direction from the virtual viewpoint corresponding to the one of the frames included in the virtual viewpoint image data.
Dependencies are inferred from the claim text.