# US 2014/0152657 A1 · Caching in Map Systems for Displaying Panoramic Images > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0152657 A1 - Document ID: US20140152657A1 - Status: Published application - Kind: A1 - Application number: 14/096,888 - Filed: 2013-12-04 - Published: 2014-06-05 - Earliest claimed: 2012-12-04 - Assignees: Nintendo Co., Ltd. - Applicants: Nintendo Co., Ltd. - Inventors: Rory JOHNSTON; Corey BIRNBAUM - Web page: https://patentgrep.com/patent/US20140152657A1 ## CPC - G06T 15/205: {Image-based rendering} - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/0412: {Digitisers structurally integrated in a display} - G06T 3/12: Panospheric to cylindrical image transformations - G06T 15/005: {General purpose rendering architectures} - H04N 23/58: Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Operations for caching to display panoramic images include repeatedly receiving an indication of one or both of a current geographic location and a current view direction for a user, receiving from a remote server a first plurality of image tiles of a first panoramic image of a predicted geographic location, caching the received first plurality of image tiles, and processing the cached first plurality of image tiles. The processing includes decompressing the cached first plurality of image tiles and storing the decompressed image tiles. When the current geographic location is at the predicted geographic location, rendering, using the stored decompressed tiles, the first panoramic image to a plurality of three-dimensional surfaces in a memory, wherein each of the plurality of three-dimensional surfaces corresponds to a respective portion of a sphere. ## Claims ### Claim 1 A system, comprising an information processing device connectable over a network to a remote server, wherein the information processing device comprises: first memory; a network interface; and a first processor arrangement including at least one processor, wherein the first processor arrangement is configured to perform first operations comprising: repeatedly receiving an indication of one or both of a current geographic location and a current view direction for a user; receiving from a remote server a first plurality of image tiles of a first panoramic image of a predicted geographic location, wherein the predicted geographic location is located in proximity to the current geographic location; caching the received first plurality of image tiles; processing the cached first plurality of image tiles, wherein the processing includes decompressing respective ones of the cached first plurality of image tiles and storing the decompressed image tiles in the first memory; and when the current geographic location is substantially at the predicted geographic location, rendering, using the stored decompressed tiles, at least a portion of the first panoramic image to a plurality of three-dimensional surfaces in the first memory, wherein each of the plurality of three-dimensional surfaces corresponds to a respective portion of a sphere. ### Claim 2 (depends on 1) The system according to claim 1, wherein the processing comprises: detecting a transition of the user towards the predicted geographic location; and responsive to the detecting, initiating the decompressing. ### Claim 3 (depends on 1) The system according to claim 1, further comprising a movable display device, wherein the first processor arrangement is further configured to perform operations comprising: forming, using the rendered plurality of three-dimensional surfaces, a display image for the predicted geographic location; and providing the display image to the movable display device, and wherein the movable display device comprises: a second memory; and a second processor arrangement including at least one processor, wherein the second processor arrangement is configured to perform operations comprising displaying the provided display image. ### Claim 4 (depends on 1) The system according to claim 1, wherein the rendering comprises: determining a group of tiles required for displaying the current view direction; and determining that each tile of the group of tiles has completed the processing. ### Claim 5 (depends on 4) The system according to claim 4, wherein the rendering further comprises determining the current view direction in accordance with a view direction indicator controlled by an input from the user. ### Claim 6 (depends on 4) The system according to claim 4, wherein the rendering further comprises determining the current view direction in accordance with a position and/or orientation of a handheld movable display device controlled by the user. ### Claim 7 (depends on 4) The system according to claim 4, wherein the determining that each tile of the group of tiles has completed processing comprises: identifying respective tiles of the group based upon a same group identifier associated with each tile of the group; and monitoring to determine if all the identified tiles have completed processing. ### Claim 8 (depends on 4) The system according to claim 4, wherein the system further comprises a second display device, and wherein a location corresponding to the first panoramic image is displayed on a map in the second display device simultaneously when at least a portion of the first panoramic image is displayed on the movable display device. ### Claim 9 (depends on 1) The system according to claim 1, wherein the caching comprises: selecting one of the received tiles for inserting into a cache; if space is available in the cache, inserting the selected tile in the cache; and if space is not available in the cache, evicting one or more other tiles from the cache and inserting the selected tile in the cache after the evicting. ### Claim 10 (depends on 9) The system according to claim 9, wherein the inserting comprises inserting the selected tile such that the tiles in the cache are ordered such that the last received tile or the last drawn tile is at the end of the cache, wherein selection for eviction is made from the front of the cache before being made from the end of the cache. ### Claim 11 (depends on 9) The system according to claim 9, wherein the evicting comprises identifying an oldest tile in the cache, wherein the oldest tile is the earliest received tile among the tiles in the cache. ### Claim 12 (depends on 1) The system according to claim 1, wherein the processing comprises: decompressing respective ones of the cached tiles; and storing each decompressed image in association with the corresponding cached tile. ### Claim 13 A method, comprising: repeatedly receiving an indication of one or both of a current geographic location and a current view direction of a user; receiving from a remote server a first plurality of image tiles of a first panoramic image of a predicted geographic location, wherein the predicted geographic location is located in proximity to the current geographic location; caching the received first plurality of image tiles; processing the cached first plurality of image tiles, wherein the processing includes decompressing respective ones of the cached first plurality of image tiles and storing the decompressed image tiles; and when the current geographic location is substantially at the predicted geographic location, rendering, using the stored decompressed tiles, at least a portion of the first panoramic image to a plurality of three-dimensional surfaces in the first memory, wherein each of the plurality of three-dimensional surfaces corresponds to a respective portion of a sphere. ### Claim 14 (depends on 13) The method according to claim 13, wherein the processing comprises: detecting a transition of the user towards the predicted geographic location; and responsive to the detecting, initiating the decompressing. ### Claim 15 (depends on 13) The method according to claim 13, wherein the rendering comprises: determining a group of tiles required for displaying the current view direction; and determining that each tile of the group of tiles has completed the processing. ### Claim 16 (depends on 15) The method according to claim 15, wherein the determining that each tile of the group of tiles has completed processing comprises: identifying respective tiles of the group based upon a same group identifier associated with each tile of the group; and monitoring to determine if all the identified tiles have completed processing. ### Claim 17 (depends on 13) The method according to claim 13, wherein the caching comprises: selecting one of the received tiles for inserting into a cache; if memory space is available in the cache, inserting the selected tile in the cache; and if memory space is not available in the cache, evicting one or more other tiles from the cache and inserting the selected tile in the cache after the evicting. ### Claim 18 (depends on 13) The method according to claim 13, wherein the processing comprises: decompressing respective ones of the cached tiles; and storing each decompressed image in association with the corresponding cached tile. ### Claim 19 A non-transitory computer-readable storage medium having instructions stored thereon, which when executed by a processor of a computer, causes the computer to perform operations comprising: repeatedly receiving an indication of one or both of a current geographic location and a current view direction for a user; receiving from a remote server a first plurality of image tiles of a first panoramic image of a predicted geographic location, wherein the predicted geographic location is located in proximity to the current geographic location; caching the received first plurality of image tiles; processing the cached first plurality of image tiles, wherein the processing includes decompressing respective ones of the cached first plurality of image tiles and storing the decompressed image tiles in the first memory; and when the current geographic location is substantially at the predicted geographic location, rendering, using the stored decompressed tiles, at least a portion of the first panoramic image to a plurality of three-dimensional surfaces in the first memory, wherein each of the plurality of three-dimensional surfaces corresponds to a respective portion of a sphere. ### Claim 20 (depends on 19) The non-transitory computer-readable medium according to claim 19, wherein the instructions cause the computer to further perform operations comprising: detecting a transition of the user towards the predicted geographic location; and responsive to the detecting, initiating the decompressing.