# US 11,029,173 B2 · Venues map application and system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,029,173 B2 - Document ID: US11029173B2 - Status: Granted - Kind: B2 - Application number: 15/990,456 - Filed: 2018-05-25 - Published: 2018-12-06 - Granted: 2021-06-08 - Earliest claimed: 2017-06-02 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Ryan D. Shelby; Ryan W. Apuy; Vincent P. Arroyo; Sunny Chan; Jae Woo Chang; Megan M. Frost; Brett L. Lareau; Sean P. O'Brien; Tadayasu Sasada; Sebastian A. Araya - Web page: https://patentgrep.com/patent/US11029173B2 ## CPC - G01C 21/3682: {output of POI information on a road map (G01C21/3614, G01C21/3685 take precedence)} - G01C 21/206: {specially adapted for indoor navigation} - G01C 21/3415: {Dynamic re-routing, e.g. recalculating the route when the user deviates from calculated route or after detecting real-time traffic data or accidents} - G01C 21/3492: {employing speed data or traffic data, e.g. real-time or historical (traffic control systems for road vehicles involving transmission of navigation instructions to the vehicle G08G1/0968)} - G01C 21/3614: {through interaction with a road map, e.g. selecting a POI icon on a road map} - G01C 21/3638: {including 3D objects and buildings (three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05)} - G01C 21/3641: {Personalized guidance, e.g. limited guidance on previously travelled routes} - G01C 21/367: {Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker} - G01C 21/3673: {Labelling using text of road map data items, e.g. road names, POI names} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 16/00: Information retrieval; Database structures therefor; File system structures therefor - G06F 16/29: Geographical information databases - G06F 16/9535: Search customisation based on user profiles and personalisation - G06F 16/9537: Spatial or temporal dependent retrieval, e.g. spatiotemporal queries - G06F 16/9538: Presentation of query results - G06T 17/05: Geographic models - G09B 29/10: Map spot or coordinate position indicators; Map reading aids (optical projection apparatus per se G03B) - G09B 29/102: {using electrical means} - G01C 21/3611: {using character input or menus, e.g. menus of POIs (character input methods in general G06F3/0233)} - G01C 21/3617: {using user history, behaviour, conditions or preferences, e.g. predicted or inferred from previous use or current movement} - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - G06Q 90/20: {Destination assistance within a business structure or complex} - G06T 13/20: Three-dimensional [3D] animation - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract In some implementations, a computing device can provide a map application providing a representation of a physical structure of venues (e.g., shopping centers, airports) identified by the application. In addition, the application can provide an inside view that includes the physical layout and geometry of the venue's structure as well as the location, structure and layout of points of interest (e.g., stores, security check points, restrooms) within the venue. The views become more detailed as the user zooms into the venue to reveal points of interest and to give the user a feel for traversing the venue. ## Claims ### Claim 1 A method comprising: presenting, by a mapping application running on a computing device, a first two-dimensional (2D) representation of a venue on an outdoor map on a display of the computing device, the first 2D representation comprising an outdoor structure of the venue; receiving, by the mapping application, a first user input zooming-in on the first 2D representation; and in response to the zooming-in input, transitioning, by the mapping application, from the first 2D representation to a second three-dimensional (3D) representation, the transition comprising animating a rise of a 3D structure of at least one indoor point of interest inside the venue on a first indoor map of the venue. ### Claim 2 (depends on 1) The method of claim 1, wherein the venue is represented with a three-dimensional (3D) representation on the outdoor map and other portions of the outdoor map are two-dimensional (2D) representations. ### Claim 3 (depends on 1) The method of claim 1, wherein the first 2D representation is at a first zoom level and receiving the first user input comprises receiving a zoom-in operation causing the second 3D representation to be presented at a second zoom level. ### Claim 4 (depends on 1) The method of claim 1, further comprising presenting, by the mapping application, a third 2D representation on the display, the third 2D representation corresponding to a second and zoomed-in inside view of the venue, the third 2D representation comprising structural details of a floorplan of the first floor, wherein a first zoom level corresponding to the third 2D representation is lower than a second zoom level corresponding to the second representation. ### Claim 5 (depends on 1) The method of claim 1, wherein the animation is a first animation that comprises 3D structure of a first inside view of the venue rising from a 2D ground level. ### Claim 6 (depends on 1) The method of claim 1, wherein the animation comprises 3D structure of a first inside view of the venue dropping through a virtual roof of the venue. ### Claim 7 (depends on 1) The method of claim 1, further comprising: receiving, by the mapping application, a second user input indicating a selection of the at least one indoor point of interest on the first indoor map; emphasizing, by the mapping application, structure of the at least one indoor point of interest on the display; and presenting, by the mapping application, an interactive information card associated with the at least one indoor point of interest on the display. ### Claim 8 (depends on 1) The method of claim 1, further comprising: presenting, by the mapping application, a floor switcher on the first indoor map; receiving, by the mapping application, a second user input indicating a selection of a second floor within the venue; and presenting, by the mapping application, a fourth representation corresponding to a second inside view of the venue on the display, the fourth representation comprising a second indoor map of the second floor and a structure of the at least one indoor point of interest on the second indoor map and an identification of the at least one indoor point of interest on the second indoor map. ### Claim 9 (depends on 8) The method of claim 8, further comprising presenting, by the map application, a second animation as a transition from the first floor to the second floor, the second animation simulating movement between the first and second floors. ### Claim 10 (depends on 1) The method of claim 1, wherein the first 2D representation of the venue further comprises an indication that a first inside view of the venue is available. ### Claim 11 (depends on 10) The method of claim 10, wherein the indication that the first inside view of the venue is available comprises a user interface item for selecting the first inside view and the received first user input comprises receiving a selection of the user interface item. ### Claim 12 A method comprising: presenting, by a mapping application running on a computing device, a first two-dimensional (2D) representation of a venue on an outdoor map on a display of the computing device, the first 2D representation comprising a 2D outdoor structure of the venue and an indication that a first inside view of the venue is available; receiving, by the mapping application, a first zoom input on the 2D outdoor structure of the venue; and in response to the first zoom input on the 2D outdoor structure, presenting, by the mapping application, a second three-dimensional (3D) representation including animating a rise of a 3D structure of at least one indoor point of interest inside the venue on an indoor map of the venue, wherein the at least one indoor point of interest is identified on the indoor map by an identification state of a plurality of identification states that is based on a zoom level of the indoor map. ### Claim 13 (depends on 12) The method of claim 12, wherein a first identification state of the plurality of identification states comprises identifying a point of interest by a dot, a second identification state comprises identifying a point of interest by a dot and a label, a third identification state comprises identifying a point of interest by an indicator and a label, and a fourth identification state comprising identifying a point of interest by its structure. ### Claim 14 (depends on 12) The method of claim 12, wherein the identification state of the at least one indoor point of interest is based on a size of the structure of the at least one indoor point of interest. ### Claim 15 (depends on 12) The method of claim 12, wherein the identification state of a first point of interest is based on a determination that a label associated with the first point of interest would occlude or be occluded by a label associated with a second point of interest. ### Claim 16 (depends on 12) The method of claim 12, wherein the identification state of a first point of interest is based on a determination that the first point of interest has a higher priority over a second point of interest. ### Claim 17 (depends on 12) The method of claim 12, wherein a plurality of points of interest is selected for presentation on the second 3D representation from a set of map data based on a determination of activity within the venue by a user of the computing device. ### Claim 18 (depends on 12) The method of claim 12, wherein a plurality of points of interest is selected for presentation on the second 3D representation from a set of map data based on a determination of popularity of the points of interest within the venue. ### Claim 19 (depends on 12) The method of claim 12, wherein a first identifier for a first point of interest is offset by a predetermined distance from an entrance point of the structure for the first point of interest. ### Claim 20 (depends on 19) The method of claim 19, wherein a second identifier for a second point of interest is positioned in approximately a center of the structure for the second point of interest. ### Claim 21 (depends on 12) The method of claim 12, wherein identifiers for a first group of points of interest are offset from corresponding entrance points of each structure of the points of interest within the first group and are in alignment with each other. ### Claim 22 A non-transitory computer-readable medium storing a navigation application program, the navigation application program for execution by at least one computing device, the navigation application program comprising sets of instructions for: presenting, by a mapping application running on a computing device, a first two-dimensional (2D) representation of a venue on an outdoor map on a display of the computing device, the first 2D representation comprising an outdoor structure of the venue; receiving, by the mapping application, a first user input zooming-in on the first 2D representation; and in response to the zooming-in input, transitioning, by the mapping application, from the first 2D representation to a second three-dimensional (3D) representation, the transition comprising animating a rise of a 3D structure of at least one indoor point of interest inside the venue on a first indoor map of the venue. ### Claim 23 (depends on 22) The non-transitory computer-readable medium of claim 22, wherein the venue is represented with a three-dimensional (3D) representation on the outdoor map and other portions of the outdoor map are two-dimensional (2D) representations. ### Claim 24 (depends on 22) The non-transitory computer-readable medium of claim 22, wherein the first 2D representation is at a first zoom level and the set of instructions for receiving the first user input comprises a set of instructions for receiving a zoom-in operation causing the second 3D representation to be presented at a second zoom level. ### Claim 25 (depends on 22) The non-transitory computer-readable medium of claim 22, wherein the navigation application program further comprises a set of instructions for a third 2D representation on the display, the third 2D representation corresponding to a second and zoomed-in inside view of the venue, the third 2D representation comprising structural details of a floorplan of the first floor, wherein a first zoom level corresponding to the third 2D representation is lower than a second zoom level corresponding to the second representation. ### Claim 26 (depends on 22) The non-transitory computer-readable medium of claim 22, wherein the animation is a first animation that comprises 3D structure of a first inside view of the venue rising from a 2D ground level. ### Claim 27 (depends on 22) The non-transitory computer-readable medium of claim 22, wherein the animation comprises 3D structure of a first inside view of the venue dropping through a virtual roof of the venue. ### Claim 28 (depends on 22) The non-transitory computer-readable medium of claim 22, wherein the navigation application program further comprises sets of instructions for: receiving, by the mapping application, a second user input indicating a selection of the at least one indoor point of interest on the first indoor map; emphasizing, by the mapping application, structure of the at least one indoor point of interest on the display; and presenting, by the mapping application, an interactive information card associated with the at least one indoor point of interest on the display. ### Claim 29 (depends on 22) The non-transitory computer-readable medium of claim 22, wherein the navigation application program further comprises sets of instructions for: presenting a floor switcher on the first indoor map; receiving a second user input indicating a selection of a second floor within the venue; and presenting, by the mapping application, a fourth representation corresponding to a second inside view of the venue on the display, the fourth representation comprising a second indoor map of the second floor and a structure of the at least one indoor point of interest on the second indoor map and an identification of the at least one indoor point of interest on the second indoor map. ### Claim 30 (depends on 29) The non-transitory computer-readable medium of claim 29, wherein the navigation application program further comprises a set of instructions for presenting a second animation as a transition from the first floor to the second floor, the second animation simulating movement between the first and second floors. ### Claim 31 (depends on 22) The non-transitory computer-readable medium of claim 22, wherein the first 2D representation of the venue further comprises an indication that a first inside view of the venue is available. ### Claim 32 (depends on 31) The non-transitory computer-readable medium of claim 31, wherein the indication that the first inside view of the venue is available comprises a user interface item for selecting the first inside view and the set of instructions for receiving the first user input comprises a set of instructions for receiving a selection of the user interface item. ### Claim 33 A non-transitory computer-readable medium storing a navigation application program, the navigation application program for execution by at least one computing device, the navigation application program comprising sets of instructions for: presenting, by a mapping application running on a computing device, a first two-dimensional (2D) representation of a venue on an outdoor map on a display of the computing device, the first 2D representation comprising a 2D outdoor structure of the venue and an indication that a first inside view of the venue is available; receiving, by the mapping application, a first zoom input on the 2D outdoor structure of the venue; and in response to the first zoom input on the 2D outdoor structure, presenting, by the mapping application, a second three-dimensional (3D) representation including animating a rise of a 3D structure of at least one indoor point of interest inside the venue on an indoor map of the venue, wherein the at least one indoor point of interest is identified on the indoor map by an identification state of a plurality of identification states that is based on a zoom level of the indoor map. ### Claim 34 (depends on 33) The non-transitory computer-readable medium of claim 33, wherein a first identification state of the plurality of identification states comprises identifying a point of interest by a dot, a second identification state comprises identifying a point of interest by a dot and a label, a third identification state comprises identifying a point of interest by an indicator and a label, and a fourth identification state comprising identifying a point of interest by its structure. ### Claim 35 (depends on 33) The non-transitory computer-readable medium of claim 33, wherein the identification state of the at least one indoor point of interest is based on a size of the structure of the at least one indoor point of interest. ### Claim 36 (depends on 33) The non-transitory computer-readable medium of claim 33, wherein the identification state of a first point of interest is based on a determination that a label associated with the first point of interest would occlude or be occluded by a label associated with a second point of interest. ### Claim 37 (depends on 33) The non-transitory computer-readable medium of claim 33, wherein the identification state of a first point of interest is based on a determination that the first point of interest has a higher priority over a second point of interest. ### Claim 38 (depends on 33) The non-transitory computer-readable medium of claim 33, wherein a plurality of points of interest is selected for presentation on the second 3D representation from a set of map data based on a determination of activity within the venue by a user of the computing device. ### Claim 39 (depends on 33) The non-transitory computer-readable medium of claim 33, wherein a plurality of points of interest is selected for presentation on the second 3D representation from a set of map data based on a determination of popularity of the points of interest within the venue. ### Claim 40 (depends on 33) The non-transitory computer-readable medium of claim 33, wherein a first identifier for a first point of interest is offset by a predetermined distance from an entrance point of the structure for the first point of interest. ### Claim 41 (depends on 40) The non-transitory computer-readable medium of claim 40, wherein a second identifier for a second point of interest is positioned in approximately a center of the structure for the second point of interest. ### Claim 42 (depends on 33) The non-transitory computer-readable medium of claim 33, wherein identifiers for a first group of points of interest are offset from corresponding entrance points of each structure of the points of interest within the first group and are in alignment with each other.