Apparatus, control method, and storage medium
AssigneeCanon Kabushiki Kaisha
InventorKoji Makita
Life of this patent
Estimating the term…
Abstract
An apparatus includes a projection unit configured to project a video image, a capturing unit configured to capture an image, an identification unit configured to identify a shape of a surface onto which the video image is to be projected, based on the captured image, an inference unit configured to infer a viewpoint position and an attitude of a viewer of the video image based on the captured image, a correction unit configured to correct the video image based on the shape of the surface and the viewpoint position and the attitude of the viewer, and a control unit configured to control the projection unit to project the corrected video image.
Claims8
An apparatus comprising:
- a projection unit configured to project a video image;
- a capturing unit configured to capture an image, wherein the captured image is an omnidirectional image;
- at least one processor that operates to:
- identify a shape of a surface onto which the video image is to be projected, based on an image obtained by panoramically expanding the omnidirectional image;
- infer, using a trained model, a viewpoint position and an attitude of a viewer of the video image based on the image obtained by panoramically expanding the omnidirectional image;
- correct the video image based on the shape of the surface and the viewpoint position and the attitude of the viewer;
- and
- control the projection unit to project the corrected video image.
A method for controlling an apparatus including a projection unit configured to project a video image and a capturing unit configured to capture an image, wherein the captured image is an omnidirectional image, the method comprising:
- identifying a shape of a surface onto which the video image is to be projected, based on an image obtained by panoramically expanding the omnidirectional image;
- inferring, using a trained model, a viewpoint position and an attitude of a viewer of the video image based on the image obtained by panoramically expanding the omnidirectional image;
- correcting the video image based on the shape of the surface and the viewpoint position and the attitude of the viewer;
- and
- controlling the projection unit to project the corrected video image.
A non-transitory computer-readable storage medium storing a program for causing a computer to execute a method for controlling an apparatus including a projection unit configured to project a video image and a capturing unit configured to capture an image, wherein the captured image is an omnidirectional image, the method comprising:
- identifying a shape of a surface onto which the video image is to be projected, based on an image obtained by panoramically expanding the omnidirectional image;
- inferring, using a trained model, a viewpoint position and an attitude of a viewer of the video image based on the image obtained by panoramically expanding the omnidirectional image;
- correcting the video image based on the shape of the surface and the viewpoint position and the attitude of the viewer;
- and
- controlling the projection unit to project the corrected video image.
Dependencies are inferred from the claim text.