# US 11,906,312 B2 · Localizing transportation requests utilizing an image based transportation request interface > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,906,312 B2 - Document ID: US11906312B2 - Status: Granted - Kind: B2 - Application number: 18/170,273 - Filed: 2023-02-16 - Published: 2023-07-06 - Granted: 2024-02-20 - Earliest claimed: 2019-05-14 - Assignees: Lyft, Inc. - Applicants: Lyft, Inc. - Inventors: Ferhan Elvanoglu - Web page: https://patentgrep.com/patent/US11906312B2 ## CPC - G01C 21/32: Structuring or formatting of map data - G01C 21/20: Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence) - G01C 21/30: Map- or contour-matching - G01C 21/3602: {Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera} - G01C 21/3638: {including 3D objects and buildings (three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05)} - G01C 21/3647: {Guidance involving output of stored or live camera images or video streams} - G06Q 10/02: Reservations, e.g. for tickets, services or events - G06Q 50/40: Business processes related to the transportation industry (shipping G06Q10/083) - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G08G 1/005: including pedestrian guidance indicator - G08G 1/202: {Dispatching vehicles on the basis of a location, e.g. taxi dispatching} - G06T 2207/30244: Camera pose - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93}) ## Abstract The present application discloses an improved transportation matching system, and corresponding methods and computer-readable media. According to the disclosed embodiments, the transportation matching system utilizes an image-based transportation request interface and environmental digital image stream to efficiently generate transportation requests with accurate pickup locations. For instance, the disclosed system can utilize one or more environmental digital images provided from a requestor computing device (e.g., a mobile device or an augmented reality wearable device) to determine information such as the location of the requestor computing device and a transportation pickup location within the environmental digital images. Furthermore, the disclosed system can provide, for display on the requestor computing device, one or more augmented reality elements at the transportation pickup location within an environmental scene that includes the transportation pickup location. ## Claims ### Claim 1 A computer-implemented method comprising: capturing an environmental digital image stream utilizing a camera of a requestor computing device; determining that the requestor computing device is moving towards a pickup location based on the environmental digital image stream by analyzing environmental digital images from the environmental digital image stream; transmitting a transportation request corresponding to the pickup location to a provider computing device; and providing, for display on the requestor computing device, an augmented reality element corresponding to the transportation request. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein providing the augmented reality element corresponding to the transportation request comprises providing, for display on the requestor computing device, an augmented reality element for the pickup location. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein providing the augmented reality element corresponding to the transportation request comprises providing, for display on the requestor computing device, an augmented reality path leading to the pickup location. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, further comprising in response to determining that the requestor computing device is within a threshold proximity of the pickup location, transmitting the transportation request corresponding to the pickup location to the provider computing device. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, further comprising providing, for display on the requestor computing device, an augmented reality element indicating that the transportation request has been transmitted. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, further comprising: identifying a plurality of candidate pickup locations; and selecting the pickup location from the plurality of candidate pickup locations based on the environmental digital image stream by analyzing environmental digital images from the environmental digital image stream. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, further comprising: determining an updated location of the requestor computing device; and cancelling the transportation request based on the updated location. ### Claim 8 A system comprising: at least one processor; and at least one non-transitory computer-readable storage medium storing instructions that, when executed by the at least one processor, cause the system to: capture an environmental digital image stream utilizing a camera of a requestor computing device; determine that the requestor computing device is moving towards a pickup location based on the environmental digital image stream by analyzing environmental digital images from the environmental digital image stream; transmit a transportation request corresponding to the pickup location to a provider computing device; and provide, for display on the requestor computing device, an augmented reality element corresponding to the transportation request. ### Claim 9 (depends on 8) The system of claim 8, further comprising instructions that, when executed by the at least one processor, cause the system to provide the augmented reality element corresponding to the transportation request by providing, for display on the requestor computing device, an augmented reality element for the pickup location. ### Claim 10 (depends on 8) The system of claim 8, further comprising instructions that, when executed by the at least one processor, cause the system to provide the augmented reality element corresponding to the transportation request by providing, for display on the requestor computing device, an augmented reality path leading to the pickup location. ### Claim 11 (depends on 8) The system of claim 8, further comprising instructions that, when executed by the at least one processor, cause the system to, in response to determining that the requestor computing device is within a threshold proximity of the pickup location, transmit the transportation request corresponding to the pickup location to the provider computing device. ### Claim 12 (depends on 8) The system of claim 8, further comprising instructions that, when executed by the at least one processor, cause the system to provide, for display on the requestor computing device, an augmented reality element indicating that the transportation request has been transmitted. ### Claim 13 (depends on 8) The system of claim 8, further comprising instructions that, when executed by the at least one processor, cause the system to: identify a plurality of candidate pickup locations; and select the pickup location from the plurality of candidate pickup locations based on the environmental digital image stream by analyzing environmental digital images from the environmental digital image stream. ### Claim 14 (depends on 8) The system of claim 8, further comprising instructions that, when executed by the at least one processor, cause the system to: determine an updated location of the requestor computing device; and cancel the transportation request based on the updated location. ### Claim 15 A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause a computer system to: capture an environmental digital image stream utilizing a camera of a requestor computing device; determine that the requestor computing device is moving towards a pickup location based on the environmental digital image stream by analyzing environmental digital images from the environmental digital image stream; transmit a transportation request corresponding to the pickup location to a provider computing device; and provide, for display on the requestor computing device, an augmented reality element corresponding to the transportation request. ### Claim 16 (depends on 15) The non-transitory computer-readable medium of claim 15, further comprising instructions that, when executed by the at least one processor, cause the computer system to provide the augmented reality element corresponding to the transportation request by providing, for display on the requestor computing device, an augmented reality element for the pickup location. ### Claim 17 (depends on 15) The non-transitory computer-readable medium of claim 15, further comprising instructions that, when executed by the at least one processor, cause the computer system to provide the augmented reality element corresponding to the transportation request by providing, for display on the requestor computing device, an augmented reality path leading to the pickup location. ### Claim 18 (depends on 15) The non-transitory computer-readable medium of claim 15, further comprising instructions that, when executed by the at least one processor, cause the computer system to, in response to determining that the requestor computing device is within a threshold proximity of the pickup location, transmit the transportation request corresponding to the pickup location to the provider computing device. ### Claim 19 (depends on 15) The non-transitory computer-readable medium of claim 15, further comprising instructions that, when executed by the at least one processor, cause the computer system to: identify a plurality of candidate pickup locations; and select the pickup location from the plurality of candidate pickup locations based on the environmental digital image stream by analyzing environmental digital images from the environmental digital image stream. ### Claim 20 (depends on 15) The non-transitory computer-readable medium of claim 15, further comprising instructions that, when executed by the at least one processor, cause the computer system to: determine an updated location of the requestor computing device; and cancel the transportation request based on the updated location.