# US 10,503,778 B2 · Methods, systems, and media for associating scenes depicted in media content with a map of where the media content was produced > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,503,778 B2 - Document ID: US10503778B2 - Status: Granted - Kind: B2 - Application number: 15/816,182 - Filed: 2017-11-17 - Published: 2018-03-15 - Granted: 2019-12-10 - Earliest claimed: 2015-05-22 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Cinthia Rodrigues Abou Assali; Nayeli Rodriguez; Jonathan Becquemin; Leon Bayliss; Gregory Blay-Desforges - Web page: https://patentgrep.com/patent/US10503778B2 ## CPC - G06F 16/7867: {using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Methods, systems, and media for associating scenes depicted in media content with a map of where the media content was produced are provided. In some embodiments, a method for presenting map information with video information is provided, the method comprising: receiving a request for a video from a user device; determining if there is location information associated with portions of the video; in response to determining that there is location information associated with the video, causing first map information corresponding to the location information to be presented in a first format during presentation of the video; receiving an indication that the first map information has been selected; in response to receiving the indication, causing second map information corresponding to the portion of the video that was being presented to be presented by the user device, wherein the second map information is presented in a second format. ## Claims ### Claim 1 A method for presenting media content associated with map information, the method comprising: receiving, using a hardware processor, a request for map information that represents an area; determining, using the hardware processor, that one or more videos of a plurality of videos are associated with location information corresponding to the area for which map information was requested; in response to determining that the one or more videos are associated with location information corresponding to the area for which map information was requested, causing, using the hardware processor, a representation of a first video of the one or more videos to be presented within the map information at a first location corresponding to the location information associated with the first video; receiving, using the hardware processor, an indication that the representation of the first video has been selected; and in response to receiving the indication that the first video has been selected, causing, using the hardware processor, the first video to be presented beginning at a portion of the video that includes a depiction of the first location. ### Claim 2 (depends on 1) The method of claim 1, wherein determining that one or more videos of the plurality of videos are associated with location information corresponding to the area for which map information was requested comprises determining that a first group of videos of the plurality of videos are associated with the location information corresponding to the area for which map information was requested, wherein the method further comprises: selecting a second group of videos from the first group of videos for which a representation is to be presented within the map information; and causing representation information of each video of the second group of videos to be presented within the map information at a location corresponding to the location information associated with the video of the second group of videos. ### Claim 3 (depends on 2) The method of claim 2, wherein selecting the second group of videos comprises selecting the second group of videos based on the relevance of each video of the first group of videos to a user associated with the user device, wherein the relevance is based at least in part on user preferences of the user. ### Claim 4 (depends on 2) The method of claim 2, wherein selecting the second group of videos comprises selecting the second group of videos based on the relevance of each video of the first group of videos to a user associated with the user device, wherein the relevance is based at least in part on whether the user is a social connection of a user associated with the video. ### Claim 5 (depends on 2) The method of claim 2, wherein selecting the second group of videos comprises selecting the second group of videos based on whether each video in the first group of videos is accessible by a user associated with the user device, wherein videos that are not accessible to the user are not selected for inclusion in the second group. ### Claim 6 (depends on 1) The method of claim 1, further comprising: receiving a request for map information that represents a second area that is different than the area for which map information was requested; determining that a group of videos of the plurality of videos are associated with location information corresponding to the second area; and in response to determining that the group of videos are associated with location information corresponding to the second area, causing a representation of a second video of the group of videos to be presented within the map information at a second location corresponding to the location information associated with the second video. ### Claim 7 (depends on 6) The method of claim 6, wherein the request for map information that represents the second area comprises a request to zoom out from the area for which map information was requested. ### Claim 8 (depends on 6) The method of claim 6, wherein the request for map information that represents the second area comprises a request to move the area represented by the map information from the area for which map information was requested. ### Claim 9 (depends on 1) The method of claim 1, wherein the representation of the first video includes an image that represents a portion of the first video that was captured near the first location. ### Claim 10 (depends on 1) The method of claim 1, wherein the representation of the first video includes descriptive information of the first video. ### Claim 11 (depends on 1) The method of claim 1, wherein determining that one or more videos of a plurality of videos are associated with location information corresponding to the area for which map information was requested comprises: querying a database that includes location information associated with videos for location information that corresponds to locations represented in the area for which map information was requested; and in response to the query, receiving identifying information of the one or more videos. ### Claim 12 A system for presenting media content associated with map information, the system comprising: a memory; and a hardware processor that, when executing computer executable instructions stored in the memory, is configured to: receive a request for map information that represents an area; determine that one or more videos of a plurality of videos are associated with location information corresponding to the area for which map information was requested; in response to determining that the one or more videos are associated with location information corresponding to the area for which map information was requested, cause a representation of a first video of the one or more videos to be presented within the map information at a first location corresponding to the location information associated with the first video; receive an indication that the representation of the first video has been selected; and in response to receiving the indication that the first video has been selected, cause the first video to be presented beginning at a portion of the video that includes a depiction of the first location. ### Claim 13 (depends on 12) The system of claim 12, wherein determining that one or more videos of the plurality of videos are associated with location information corresponding to the area for which map information was requested comprises determining that a first group of videos of the plurality of videos are associated with the location information corresponding to the area for which map information was requested, wherein the hardware processor is further configured to: select a second group of videos from the first group of videos for which a representation is to be presented within the map information; and cause representation information of each video of the second group of videos to be presented within the map information at a location corresponding to the location information associated with the video of the second group of videos. ### Claim 14 (depends on 13) The system of claim 13, wherein selecting the second group of videos comprises selecting the second group of videos based on the relevance of each video of the first group of videos to a user associated with the user device, wherein the relevance is based at least in part on user preferences of the user. ### Claim 15 (depends on 13) The system of claim 13, wherein selecting the second group of videos comprises selecting the second group of videos based on the relevance of each video of the first group of videos to a user associated with the user device, wherein the relevance is based at least in part on whether the user is a social connection of a user associated with the video. ### Claim 16 (depends on 13) The system of claim 13, wherein selecting the second group of videos comprises selecting the second group of videos based on whether each video in the first group of videos is accessible by a user associated with the user device, wherein videos that are not accessible to the user are not selected for inclusion in the second group. ### Claim 17 (depends on 12) The system of claim 12, wherein the hardware processor is further configured to: receive a request for map information that represents a second area that is different than the area for which map information was requested; determine that a group of videos of the plurality of videos are associated with location information corresponding to the second area; and in response to determining that the group of videos are associated with location information corresponding to the second area, cause a representation of a second video of the group of videos to be presented within the map information at a second location corresponding to the location information associated with the second video. ### Claim 18 (depends on 17) The system of claim 17, wherein the request for map information that represents the second area comprises a request to zoom out from the area for which map information was requested. ### Claim 19 (depends on 17) The system of claim 17, wherein the request for map information that represents the second area comprises a request to move the area represented by the map information from the area for which map information was requested. ### Claim 20 (depends on 12) The system of claim 12, wherein the representation of the first video includes an image that represents a portion of the first video that was captured near the first location. ### Claim 21 (depends on 12) The system of claim 12, wherein the representation of the first video includes descriptive information of the first video. ### Claim 22 (depends on 12) The system of claim 12, wherein determining that one or more videos of a plurality of videos are associated with location information corresponding to the area for which map information was requested comprises: querying a database that includes location information associated with videos for location information that corresponds to locations represented in the area for which map information was requested; and in response to the query, receiving identifying information of the one or more videos. ### Claim 23 A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for presenting media content associated with map information, the method comprising: receiving a request for map information that represents an area; determining that one or more videos of a plurality of videos are associated with location information corresponding to the area for which map information was requested; in response to determining that the one or more videos are associated with location information corresponding to the area for which map information was requested, causing a representation of a first video of the one or more videos to be presented within the map information at a first location corresponding to the location information associated with the first video; receiving an indication that the representation of the first video has been selected; and in response to receiving the indication that the first video has been selected, causing the first video to be presented beginning at a portion of the video that includes a depiction of the first location.