Image processing apparatus, image processing method, and storage medium
AssigneeCanon Kabushiki Kaisha
InventorTomohiro Yano
Life of this patent
Estimating the term…
Abstract
An image processing apparatus includes an acquisition unit configured to acquire line-of-sight information about a movement range of a line of sight of a subject imaged by a plurality of image capturing apparatuses, a determination unit configured to determine virtual viewpoint information indicating a virtual viewpoint related to a virtual viewpoint image that is based on a plurality of captured images acquired by the imaging by the plurality of image capturing apparatuses and that includes the movement range of the line of sight of the subject identified based on the line-of-sight information acquired by the acquisition unit, and an output unit configured to output the virtual viewpoint information determined by the determination unit.
Claims14
An image processing apparatus comprising:
- one or more memories;
- and
- one or more processors in communication with the one or more memories, wherein the one or more processors and the one or more memories are configured to:
- acquire line-of-sight information about a movement range of a line of sight of a subject imaged by a plurality of image capturing apparatuses, based on a movement locus of the line of sight of the subject in a predetermined time range;
- determine virtual viewpoint information indicating a virtual viewpoint related to a virtual viewpoint image that is based on a plurality of captured images acquired by the imaging by the plurality of image capturing apparatuses and that includes the movement range of the line of sight of the subject identified based on the line-of-sight information;
- and
- output the virtual viewpoint information,
- wherein in a case where the virtual viewpoint information includes information that causes change of a visual field size of the virtual viewpoint to a narrow angle, the one or more processors and the one or more memories are further configured to gradually change the visual field size, and
- wherein the one or more processors and the one or more memories are further configured to acquire the line-of-sight information about the movement range of the line of sight, based on a plurality of the movement loci of the line of sight that is respectively acquired in a first predetermined time range and a second predetermined time range each of which is the predetermined time range.
An image processing method comprising:
- acquiring line-of-sight information about a movement range of a line of sight of a subject imaged by a plurality of image capturing apparatuses, based on a movement locus of the line of sight of the subject in a predetermined time range;
- determining virtual viewpoint information indicating a virtual viewpoint related to a virtual viewpoint image that is based on a plurality of captured images acquired by the imaging by the plurality of image capturing apparatuses and that includes the movement range of the line of sight of the subject identified based on the acquired line-of-sight information;
- and
- outputting the determined virtual viewpoint information,
- wherein in a case where the virtual viewpoint information includes information that causes change of a visual field size of the virtual viewpoint to a narrow angle, the determining gradually changes the visual field size, and
- wherein the one or more processors and the one or more memories are further configured to acquire the line-of-sight information about the movement range of the line of sight, based on a plurality of the movement loci of the line of sight that is respectively acquired in a first predetermined time range and a second predetermined time range each of which is the predetermined time range.
A non-transitory computer-readable storage medium storing a program for causing a computer to execute an image processing method, the method comprising:
- acquiring line-of-sight information about a movement range of a line of sight of a subject imaged by a plurality of image capturing apparatuses, based on a movement locus of the line of sight of the subject in a predetermined time range;
- determining virtual viewpoint information indicating a virtual viewpoint related to a virtual viewpoint image that is based on a plurality of captured images acquired by the imaging by the plurality of image capturing apparatuses and that includes the movement range of the line of sight of the subject identified based on the acquired line-of-sight information;
- and
- outputting the determined virtual viewpoint information,
- wherein in a case where the virtual viewpoint information includes information that causes change of a visual field size of the virtual viewpoint to a narrow angle, the determining gradually changes the visual field size, and
- wherein the one or more processors and the one or more memories are further configured to acquire the line-of-sight information about the movement range of the line of sight, based on a plurality of the movement loci of the line of sight that is respectively acquired in a first predetermined time range and a second predetermined time range each of which is the predetermined time range.
Dependencies are inferred from the claim text.