Back to results
US 12,737,965 B2Granted
Information processing apparatus, information processing method, and non-transitory computer-readable medium for controlling display of digital content in virtual viewpoint images
AssigneeCanon Kabushiki Kaisha
InventorFumihiro Kajimura
Life of this patent
Estimating the term…
Abstract
An information processing apparatus is provided. The apparatus obtains content data of a first digital content related to a first object to which a user has a right, and content data of a second digital content related to a second object to which the user does not have a right. The apparatus verifies whether the user has rights to the first digital content and the second digital content. The apparatus generates a virtual viewpoint image showing the first object and the second object. A display mode of the first object differs from a display mode of the second object.
Claims13
An information processing apparatus comprising one or more memories storing instructions and one or more processors that execute the instructions to:
- obtain content data of a first digital content related to a first object to which a user has a right, and content data of one or more second digital contents related to one or more second objects to which the user does not have a right, wherein the content data of the first digital content and the one or more second digital contents includes appearance information and position information of the first object and the one or more second objects that change with time and that are generated based on a plurality of images of a subject captured by a plurality of capturing apparatuses;
- verify whether the user has rights to the first digital content and the one or more second digital contents;
- and
- generate a virtual viewpoint image of a virtual space from a changeable virtual viewpoint, wherein the virtual viewpoint image includes the first object and the one or more second objects, wherein the first object is displayed in the virtual viewpoint image in a first display mode in accordance with the appearance information of the content data of the first digital content at a position indicated by the position information of the content data of the first digital content, and each of the one or more second objects is displayed in the virtual viewpoint image in a second display mode by placing, in the virtual space, a model having a predetermined shape unrelated to a three-dimensional shape indicated by a corresponding one of the one or more second digital contents at a respective position indicated by the position information of the content data of the corresponding one of the one or more second digital contents, without using the appearance information of the one or more second digital contents, wherein the first display mode differs from the second display mode.
1 more element
An information processing apparatus comprising one or more memories storing instructions and one or more processors that execute the instructions to:
- verify whether a user has a right to digital content;
- transmit content data of the digital content to an image processing apparatus that generates a virtual viewpoint image of a virtual space from a changeable virtual viewpoint, wherein the content data includes appearance information and position information of an object that change with time and that are generated based on a plurality of images of a subject captured by a plurality of capturing apparatuses;
- and
- transmit information indicating a display mode of the object corresponding to the digital content to the image processing apparatus in accordance with whether the user has a right to the digital content,
- wherein the content data includes content data of a first digital content related to a first object to which a user has a right, and content data of a second digital content related to a second object to which the user does not have a right,
- wherein the first object is displayed in the virtual viewpoint image in a first display mode in accordance with the appearance information of the content data of the first digital content at a position indicated by the position information of the content data of the first digital content, and the second object is displayed in the virtual viewpoint image in a second display mode by placing, in the virtual space, a model having a predetermined shape unrelated to a three-dimensional shape indicated by the second digital content at a position indicated by the position information of the content data of the second digital content, without using the appearance information of the second digital content, wherein in a case where the content data includes a plurality of second digital contents related to respective second objects, the model having the predetermined shape are placed for the respective second objects, wherein the first display mode differs from the second display mode.
3 more elements
An information processing method, comprising:
- obtaining content data of a first digital content related to a first object to which a user has a right, and content data of one or more second digital contents related to one or more second objects to which the user does not have a right, wherein the content data of the first digital content and the one or more second digital contents includes appearance information and position information of the first object and the second object that change with time and that are generated based on a plurality of images of a subject captured by a plurality of capturing apparatuses;
- verifying whether the user has rights to the first digital content and the one or more second digital contents;
- and
- generating a virtual viewpoint image of a virtual space from a changeable virtual viewpoint, wherein the virtual viewpoint image includes the first object and the one or more second objects, wherein the first object is displayed in the virtual viewpoint image in a first display mode in accordance with the appearance information of the content data of the first digital content at a position indicated by the position information of the content data of the first digital content, and each of the one or more second objects is displayed in the virtual viewpoint image in a second display mode by placing, in the virtual space, a model having a predetermined shape unrelated to a three-dimensional shape indicated by a corresponding one of the one or more second digital contents at a respective position indicated by the position information of the content data of the corresponding one of the one or more second digital contents, without using the appearance information of the one or more second digital contents, wherein the first display mode differs from the second display mode.
1 more element
An information processing method comprising:
- verifying whether a user has a right to digital content;
- transmitting content data of the digital content to an image processing apparatus that generates a virtual viewpoint image of a virtual space from a changeable virtual viewpoint, wherein the content data includes appearance information and position information of an object that change with time and that are generated based on a plurality of images of a subject captured by a plurality of capturing apparatuses;
- and
- transmitting information indicating a display mode of the object corresponding to the digital content to the image processing apparatus in accordance with whether the user has a right to the digital content,
- wherein the content data includes content data of a first digital content related to a first object to which a user has a right, and content data of a second digital content related to a second object to which the user does not have a right, wherein the first object is displayed in the virtual viewpoint image in a first display mode in accordance with the appearance information of the content data of the first digital content at a position indicated by the position information of the content data of the first digital content, and the second object is displayed in the virtual viewpoint image in a second display mode by placing, in the virtual space, a model having a predetermined shape unrelated to a three-dimensional shape indicated by the second digital content at a position indicated by the position information of the content data of the second digital content, without using the appearance information of the second digital content, wherein in a case where the content data includes a plurality of second digital contents related to respective second objects, the model having the predetermined shape are placed for the respective second objects, wherein the first display mode differs from the second display mode.
2 more elements
A non-transitory computer-readable medium storing a program executable by a computer to perform a method comprising:
- obtaining content data of a first digital content related to a first object to which a user has a right, and content data of one or more second digital contents related to one or more second objects to which the user does not have a right, wherein the content data of the first digital content and the one or more second digital contents includes appearance information and position information of the first object and the second object that change with time and that are generated based on a plurality of images of a subject captured by a plurality of capturing apparatuses;
- verifying whether the user has rights to the first digital content and the one or more second digital contents;
- and
- generating a virtual viewpoint image of a virtual space from a changeable virtual viewpoint, wherein the virtual viewpoint image includes the first object and the second object, wherein the first object is displayed in the virtual viewpoint image in a first display mode in accordance with the appearance information of the content data of the first digital content at a position indicated by the position information of the content data of the first digital content, and each of the one or more second objects is displayed in the virtual viewpoint image in a second display mode by placing, in the virtual space, a model having a predetermined shape unrelated to a three-dimensional shape indicated by a corresponding one of the one or more second digital contents at a respective position indicated by the position information of the content data of the corresponding one of the one or more second digital contents, without using the appearance information of the one or more second digital contents, wherein the first display mode differs from the second display mode.
1 more element
Dependencies are inferred from the claim text.