US 11,776,229 B2 · Modification of multi-view interactive digital media representation

Abstract

Provided are mechanisms and processes for inserting a visual element into a multi-view digital media representation (MVIDMR). In one example, a process includes analyzing an MVIDMR to determine if there is an appropriate location to insert a visual element. Once a location is found, the type of visual element appropriate for the location is determined, where the type of visual element includes either a three-dimensional object to be inserted in the MVIDMR or a two-dimensional image to be inserted as or projected onto a background or object in the MVIDMR. A visual element that is appropriate for the location is then retrieved and inserted into the MVIDMR, such that the visual element is integrated into the MVIDMR and navigable by a user.

Claims19

Dependent claims

A method comprising:

receiving at a server from a mobile device a first multi-view interactive digital media representation (MVIDMR) including inertial measurement unit (IMU) data and a plurality of two-dimensional images of an object and background scenery captured from different viewpoints along a path of the mobile device through space along an arc that is concave with respect to the object, the plurality of two-dimensional images linked using IMU data and being navigable in one or more dimensions, the IMU data and content-weighted keypoint tracks used to apply view interpolation to the MVIDMR;
determining via a processor at the server a designated location within the first MVIDMR at which to insert a visual element;
generating via the processor a second MVIDMR navigable in one or more dimensions by inserting the visual element into one or more of the plurality of two-dimensional images;
and
transmitting the second MVIDMR to the mobile device.

2 more elements

One or more non-transitory computer readable media having instructions stored thereon for performing a method, the method comprising:

receiving at a server from a mobile device a first multi-view interactive digital media representation (MVIDMR) including inertial measurement unit (IMU) data and a plurality of two-dimensional images of an object and background scenery captured from different viewpoints along a path of the mobile device through space along an arc that is concave with respect to the object, the plurality of two-dimensional images linked using IMU data and being navigable in one or more dimensions, the IMU data and content-weighted keypoint tracks used to apply view interpolation to the MVIDMR;
determining via a processor at the server a designated location within the first MVIDMR at which to insert a visual element;
generating via the processor a second MVIDMR navigable in one or more dimensions by inserting the visual element into one or more of the plurality of two-dimensional images;
and
transmitting the second MVIDMR to the mobile device.

2 more elements

A system comprising:

a communication interface configured to receive at a server from a mobile device a first multi-view interactive digital media representation (MVIDMR) including a plurality of two-dimensional images of an object and background scenery captured from different viewpoints along a path of the mobile device through space along an arc that is concave with respect to the object, the plurality of two-dimensional images being navigable in one or more dimensions, wherein IMU data and content-weighted keypoint tracks are used to apply view interpolation to the MVIDMR;
a processor configured to determine via a processor at the server a designated location within the first MVIDMR at which to insert a visual element and to generate a second MVIDMR navigable in one or more dimensions by inserting the visual element into one or more of the plurality of two-dimensional images;
and
a storage device configured to store the second MVIDMR.

1 more element

Dependencies are inferred from the claim text.

Modification of multi-view interactive digital media representation

Life of this patent

Modification of multi-view interactive digital media representation

Life of this patent

Abstract

Claims19