Visual search using multi-view interactive digital media representations

A method comprising;

• processing a visual search query for a first motor vehicle, the visual search query including a first plurality of shapes and a first plurality of locations, wherein the first plurality of shapes and the first plurality of locations are associated with a first plurality of components for the first motor vehicle, the processing comprising deriving the first plurality of shapes and the first plurality of locations from a first multi-view interactive digital media representation of the first motor vehicle, the first multi-view interactive digital media representation generated from a plurality of images captured from different viewpoints and associated spatial location information;
• comparing the first plurality of shapes and the first plurality of locations to shape and location information for a plurality of stored motor vehicles, the shape and location information for the plurality of stored motor vehicles including a second plurality of shapes and a second plurality of locations associated with a second plurality of components for a second motor vehicle, wherein the shape and location information for the stored motor vehicles is derived from a plurality of stored multi-view interactive digital media representations, wherein comparing comprises comparing spatial information and scale information of the first plurality of shapes and locations to spatial information and scale information of the second plurality of shapes and locations, wherein the spatial information and scale information are extracted from the respective first and second multi-view interactive digital media representations and compared by a computer system;
• generating a correspondence measure indicating the degree of similarity between the first motor vehicle and the second motor vehicle, wherein a plurality of correspondence measures are generated for the plurality of stored motor vehicles;
• and
• transmitting a result associated with the second motor vehicle in response to the visual search query.