# US 2021/0344891 A1 · System and method for generating combined embedded multi-view interactive digital media representations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0344891 A1
- Document ID: US20210344891A1
- Status: Published application
- Kind: A1
- Application number: 17/373,737
- Filed: 2021-07-12
- Published: 2021-11-04
- Earliest claimed: 2015-07-15
- Assignees: Fyusion, Inc.
- Applicants: Fyusion, Inc.
- Inventors: Stefan Johannes Josef Holzer; Dave Morrison; Radu Bogdan Rusu; George Haber; Keith Martin
- Web page: https://patentgrep.com/patent/US20210344891A1

## CPC

- H04N 13/221: using the relative movement between cameras and objects
- G06T 7/285: using a sequence of stereo image pairs
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
- H04N 13/178: Metadata, e.g. disparity information
- H04N 13/189: Recording image signals; Reproducing recorded image signals
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- H04N 13/275: from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
- H04N 13/279: the virtual viewpoint locations being selected by the viewers or determined by tracking
- H04N 13/344: with head-mounted left-right displays
- H04N 13/366: using viewer tracking
- G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06T 2219/2008: Assembling, disassembling
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Various embodiments describe systems and processes for capturing and generating multi-view interactive digital media representations (MIDMRs). In one aspect, a method for automatically generating a MIDMR comprises obtaining a first MIDMR and a second MIDMR. The first MIDMR includes a convex or concave motion capture using a recording device and is a general object MIDMR. The second MIDMR is a specific feature MIDMR. The first and second MIDMRs may be obtained using different capture motions. A third MIDMR is generated from the first and second MIDMRs, and is a combined embedded MIDMR. The combined embedded MIDMR may comprise the second MIDMR being embedded in the first MIDMR, forming an embedded second MIDMR. The third MIDMR may include a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device. The embedded second MIDMR may not be viewable in the general view.

## Claims

### Claim 1

A method for automatic generation of a multi-view interactive digital media representation (MIDMR) recording, the method comprising:
obtaining a first MIDMR;
obtaining a second MIDMR; and
generating a third MIDMR from the first MIDMR and the second MIDMR, wherein the first and second MIDMRs are obtained using different capture motions, wherein the third MIDMR is a combined embedded MIDMR, wherein the third MIDMR provides a three dimensional view of a first object MIDMR as well as an embedded three dimensional view of a second object MIDMR,
wherein the first and second MIDMRS are generated by stitching together two dimensional images, and wherein the third MIDMR is generated by combining the first and second MIDMR, and wherein the first, second, and third MIDMRs each provide a three-dimensional view of content without rendering and/or storing an actual three-dimensional model.

### Claim 2 (depends on 1)

The method of claim 1, wherein the combined embedded MIDMR comprises the second MIDMR being embedded in the first MIDMR, thereby forming an embedded second MIDMR.

### Claim 3 (depends on 2)

The method of claim 2, wherein the third MIDMR includes a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device.

### Claim 4 (depends on 3)

The method of claim 3, wherein the embedded second MIDMR is not available for viewing in the general view.

### Claim 5 (depends on 4)

The method of claim 4, wherein the general view includes a selectable tag located somewhere on the first MIDMR, the selectable tag corresponding to the embedded second MIDMR.

### Claim 6 (depends on 5)

The method of claim 5, wherein selection of the selectable tag triggers a specific view to be displayed on the user device, wherein the specific view corresponds to the embedded second MIDMR.

### Claim 7 (depends on 1)

The method of claim 1, further comprising generating a user template to assist in execution of the steps in claim 1.

### Claim 8 (depends on 1)

The method of claim 1, further comprising automatically generating a webpage once the third MIDMR is generated.

### Claim 9 (depends on 1)

The method of claim 1, wherein the general object MIDMR is a representation of a vehicle.

### Claim 10 (depends on 1)

The method of claim 1, wherein viewing angles of the third MIDMR are manipulated by rotating the device or moving the device along a translational path.

### Claim 11

A non-transitory computer readable medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions for:
obtaining a first MIDMR;
obtaining a second MIDMR; and
generating a third MIDMR from the first MIDMR and the second MIDMR, wherein the first and second MIDMRs are obtained using different capture motions, wherein the third MIDMR is a combined embedded MIDMR, wherein the third MIDMR provides a three dimensional view of a first object MIDMR as well as an embedded three dimensional view of a second object MIDMR,
wherein the first and second MIDMRS are generated by stitching together two dimensional images, and wherein the third MIDMR is generated by combining the first and second MIDMR, and wherein the first, second, and third MIDMRs each provide a three-dimensional view of content without rendering and/or storing an actual three-dimensional model.

### Claim 12 (depends on 11)

The non-transitory computer readable medium of claim 11, wherein the combined embedded MIDMR comprises the second MIDMR being embedded in the first MIDMR, thereby forming an embedded second MIDMR.

### Claim 13 (depends on 12)

The non-transitory computer readable medium of claim 12, wherein the third MIDMR includes a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device.

### Claim 14 (depends on 13)

The non-transitory computer readable medium of claim 13, wherein the embedded second MIDMR is not available for viewing in the general view.

### Claim 15 (depends on 14)

The non-transitory computer readable medium of claim 14, wherein the general view includes a selectable tag located somewhere on the first MIDMR, the selectable tag corresponding to the embedded second MIDMR.

### Claim 16 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein selection of the selectable tag triggers a specific view to be displayed on the user device, wherein the specific view corresponds to the embedded second MIDMR.

### Claim 17 (depends on 11)

The non-transitory computer readable medium of claim 11, further comprising generating a user template to assist in execution of the steps in claim 11.

### Claim 18 (depends on 11)

The non-transitory computer readable medium of claim 11, further comprising automatically generating a webpage once the third MIDMR is generated.

### Claim 19 (depends on 11)

The non-transitory computer readable medium of claim 11, wherein the general object MIDMR is a representation of a vehicle.

### Claim 20

A system comprising:
a processor;
memory; and
one or more programs stored in the memory, the one or more programs comprising instructions for:
obtaining a first MIDMR;
obtaining a second MIDMR; and
generating a third MIDMR from the first MIDMR and the second MIDMR, wherein the first and second MIDMRs are obtained using different capture motions, wherein the third MIDMR is a combined embedded MIDMR, wherein the third MIDMR provides a three dimensional view of a first object MIDMR as well as an embedded three dimensional view of a second object MIDMR,
wherein the first and second MIDMRS are generated by stitching together two dimensional images, and wherein the third MIDMR is generated by combining the first and second MIDMR, and wherein the first, second, and third MIDMRs each provide a three-dimensional view of content without rendering and/or storing an actual three-dimensional model.
