# US 2022/0044429 A1 · Method And System For Obtaining Pair-Wise Epipolar Constraints And Solving For Panorama Pose On A Mobile Device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0044429 A1 - Document ID: US20220044429A1 - Status: Published application - Kind: A1 - Application number: 17/390,410 - Filed: 2021-07-30 - Published: 2022-02-10 - Earliest claimed: 2016-05-03 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Alan Sheridan; Scott Benjamin Satkin; Vivek Verma - Web page: https://patentgrep.com/patent/US20220044429A1 ## CPC - G06T 7/337: {involving reference images or patches} - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images - G06T 7/74: {involving reference images or patches} - G06T 2200/32: involving image mosaicing - G06T 2207/20101: Interactive definition of point of interest, landmark or seed - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Aspects of the disclosure generally relate to connecting panoramic images. One or more computing devices may load and display a first panoramic image captured at a first location and receive a selection of an area on the first panoramic image, the area corresponding to where a connection to other panoramic images may be made. The one or more computing devices may identify and display one or more nearby panoramic images which were captured near the first location and receive a selection of one of the one or more nearby panoramic images. The one or more computing devices may display the selected panoramic image and the first panoramic image and align the selected panoramic image with the first panoramic image such that the selected panoramic image is oriented in the same direction as the first panoramic image. The one or more computing devices may connect the selected panoramic image with the first panoramic image. ## Claims ### Claim 1 A computer implemented method for connecting panoramic images, the method comprising: receiving, by the one or more computing devices, a selection of one of two or more panoramic images, wherein the two or more panoramic images were captured near a first geographic location; displaying, with the one or more computing devices, the selected panoramic image and a first panoramic image captured near the first geographic location on a display, wherein the first panoramic image is overlaid on at least a portion of the selected image; overlaying, on the display, an alignment indicator on top of the selected panoramic image and the first panoramic image; aligning, by the one or more computing devices, the selected panoramic image and the first panoramic image such that the selected panoramic image is oriented in the same direction as the first panoramic image on the display, such that similar imagery in the selected panoramic image and the first panoramic imagery is displayed in the same display location relative to the alignment indicator; and connecting, by the one or more computing devices, the selected panoramic image with the first panoramic image. ### Claim 2 (depends on 1) The method of claim 1, further comprising: displaying a navigation icon overlaid on the first panoramic image at the selected area; receiving a selection of the navigation icon; and transitioning the display from the first panoramic image to the selected panoramic image. ### Claim 3 (depends on 2) The method of claim 2, wherein the transitioning is done such that the selected panoramic image is displayed in the same direction as the first panoramic image. ### Claim 4 (depends on 2) The method of claim 2, wherein the nearby images include similar image data to image data in the first panoramic image. ### Claim 5 (depends on 1) The method of claim 1, wherein displaying the selected panoramic image and the first panoramic image includes displaying the selected panoramic image above the first panoramic image. ### Claim 6 (depends on 1) The method of claim 1, further comprising: receiving an input responsive to an interactive portion of the alignment indicator, the input indicating when the first panoramic image and selected panoramic image are aligned. ### Claim 7 (depends on 1) The method of claim 1, further comprising: after aligning the selected panoramic image and the first panoramic image, optimizing the location and orientation of the images. ### Claim 8 A system for connecting panoramic images, the system comprising: one or more computing devices having one or more processors coupled to memory, the one or more processors being configured to: receive, by the one or more computing devices, a selection of one of two or more panoramic images, wherein the two or more panoramic images were captured near a first geographic location; display, with the one or more computing devices, the selected panoramic image and a first panoramic image captured near the first geographic location on a display, wherein the first panoramic image is overlaid on at least a portion of the selected image; overlay, on the display, an alignment indicator on top of the selected panoramic image and the first panoramic image; align, by the one or more computing devices, the selected panoramic image and the first panoramic image such that the selected panoramic image is oriented in the same direction as the first panoramic image on the display, such that similar imagery in the selected panoramic image and the first panoramic imagery is displayed in the same display location relative to the alignment indicator; and connect, by the one or more computing devices, the selected panoramic image with the first panoramic image. ### Claim 9 (depends on 8) The system of claim 8, wherein the processors are further configured to: display a navigation icon overlaid on the first panoramic image at the selected area; receive a selection of the navigation icon; and transition the display from the first panoramic image to the selected panoramic image. ### Claim 10 (depends on 9) The system of claim 9, wherein the transitioning is done such that the selected panoramic image is displayed in the same direction as the first panoramic image. ### Claim 11 (depends on 9) The system of claim 9, wherein the nearby images include similar image data to image data in the first panoramic image. ### Claim 12 (depends on 8) The system of claim 8, wherein displaying the selected panoramic image and the first panoramic image includes displaying the selected panoramic image above the first panoramic image. ### Claim 13 (depends on 8) The system of claim 8, wherein the processors are further configured to: receive an input responsive to an interactive portion of the alignment indicator, the input indicating when the first panoramic image and selected panoramic image are aligned. ### Claim 14 (depends on 8) The system of claim 8, wherein the processors are further configured to: after aligning the selected panoramic image and the first panoramic image, optimizing the location and orientation of the images. ### Claim 15 A non-transitory computer-readable medium storing instructions, which when executed by one or more processors, cause the one or more processors to: receive, by the one or more computing devices, a selection of one of two or more panoramic images, wherein the two or more panoramic images were captured near a first geographic location; display, with the one or more computing devices, the selected panoramic image and a first panoramic image captured near the first geographic location on a display, wherein the first panoramic image is overlaid on at least a portion of the selected image; overlay, on the display, an alignment indicator on top of the selected panoramic image and the first panoramic image; align, by the one or more computing devices, the selected panoramic image and the first panoramic image such that the selected panoramic image is oriented in the same direction as the first panoramic image on the display, such that similar imagery in the selected panoramic image and the first panoramic imagery is displayed in the same display location relative to the alignment indicator; and connect, by the one or more computing devices, the selected panoramic image with the first panoramic image. ### Claim 16 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein the instructions further cause the one or more processors to: display a navigation icon overlaid on the first panoramic image at the selected area; receive a selection of the navigation icon; and transition the display from the first panoramic image to the selected panoramic image. ### Claim 17 (depends on 16) The non-transitory computer-readable medium of claim 16, wherein the transitioning is done such that the selected panoramic image is displayed in the same direction as the first panoramic image. ### Claim 18 (depends on 16) The non-transitory computer-readable medium of claim 16, wherein the nearby images include similar image data to image data in the first panoramic image. ### Claim 19 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein displaying the selected panoramic image and the first panoramic image includes displaying the selected panoramic image above the first panoramic image. ### Claim 20 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein the instructions further cause the one or more processors to: after aligning the selected panoramic image and the first panoramic image, optimize the location and orientation of the images.