# US 2009/0262145 A1 · Information display device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2009/0262145 A1 - Document ID: US20090262145A1 - Status: Published application - Kind: A1 - Application number: 12/090,724 - Filed: 2006-10-12 - Published: 2009-10-22 - Earliest claimed: 2005-11-01 - Inventors: Takashi Akita; Takahiro Kudoh; Tsuyoshi Kindo - Web page: https://patentgrep.com/patent/US20090262145A1 ## CPC - G01C 21/3647: {Guidance involving output of stored or live camera images or video streams} - G01C 21/3602: {Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera} - G01C 21/3667: {Display of a road map (G01C21/3614 takes precedence; guidance using 3D or perspective road maps G01C21/3635)} - G01C 21/3679: {Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities (G01C21/3611 takes precedence)} - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) ## Abstract An object of the present invention is to provide an information display device for presenting, to a user, a correspondence between a position in an actual landscape and a position on a map image. In an information display device (IDA, IDAr), a photographed image acquisition section (1) acquires a photographed image (IC), a map information storage section (4) stores map information (IG) so as to generate a map image (IM), an image display section (7, 8) displays the photographed image (IC) and the map image (IM), an input section (6) designates at least one structure (Rc/Rg) which is displayed in either the photographed image (IC) or the map image (IM) based on an operation performed by the user, and a structure correspondence acquisition section (5) acquires a correspondence (ICb) between the designated structure displayed in either the photographed image (IC) or the map image (IM) and a structure displayed in the other image. ## Claims ### Claim 1 An information display device comprising: photographed image acquisition means for acquiring a photographed image; map information storage means for storing map information; image display means for displaying the photographed image and a map image generated based on the map information; input means for designating, based on an operation performed by a user, at least one structure displayed in either the photographed image or the map image; and structure correspondence acquisition means for acquiring a correspondence between the at least one structure displayed in the photographed image and at least one structure displayed in the map image, or acquiring a correspondence between the at least one structure displayed in the map image and at least one structure displayed in the photographed image, wherein the image display means highlights, when the at least one structure displayed in the photographed image is designated, the at least one structure, among structures displayed in the map image, corresponding to the at least one structure having been designated, or highlights, when the at least one structure displayed in the map image is designated, the at least one structure, among structures displayed in the photographed image, corresponding to the at least one structure having been designated. ### Claim 2 (depends on 1) The information display device according to claim 1, wherein the image display means simultaneously displays the photographed image and the map image. ### Claim 3 (depends on 1) The information display device according to claim 1, wherein the image display means displays, when the at least one structure is designated by the input means, at least one of the photographed image and the map image, and further displays, when the at least one structure corresponding to the at least one structure having been designated is highlighted, the at least one of the photographed image and the map image which includes the at least one structure to be highlighted. ### Claim 4 (depends on 1) The information display device according to claim 1, wherein the input means is a touch panel, and the image display means highlights, when the at least one structure displayed in the photographed image is touched, the at least one structure, among the structures displayed in the map image, corresponding to the at least one structure having been touched, or highlights, when the at least one structure displayed in the map image is touched, the at least one structure, among the structures displayed in the photographed image, corresponding to the at least one structure having been touched. ### Claim 5 (depends on 1) The information display device according to claim 1, wherein the photographed image acquisition means provides a camera for picking up the photographed image, and the structure correspondence acquisition means acquires the correspondence between the at least one structure displayed in the photographed image and the at least one structure displayed in the map image, based on a camera position obtained at a time of picking up the photographed image and based on a camera attribute which is a parameter for determining an imaging direction and an imaging area. ### Claim 6 (depends on 5) The information display device according to claim 5, wherein the camera attribute includes a camera angle, a focal length and an image size, all of which are obtained at the time of picking up the photographed image. ### Claim 7 (depends on 1) The information display device according to claim 1, wherein the image display means superimposes, on each of the photographed image and the map image, a supplementary display for indicating any of the structures which can be designated by the user. ### Claim 8 (depends on 1) The information display device according to claim 1, wherein if the photographed image contains a structure in which at least a portion thereof is concealed by other structures, the image display means superimposes, on the photographed image, a supplementary display for indicating that the concealed structure exists in the photographed image. ### Claim 9 (depends on 8) The information display device according to claim 8, further comprising obstacle detection means for detecting an obstacle existing in a visual field space of the photographed image, wherein if the photographed image contains a structure in which at least a portion thereof is concealed by an obstacle detected by the obstacle detection means, the image display means superimposes, on the photographed image, the supplementary display for indicating that the concealed structure exists in the photographed image. ### Claim 10 (depends on 1) The information display device according to claim 1, wherein the image display means highlights, while the at least one structure displayed in the photographed image is designated, the at least one structure, among the structures displayed in the map image, corresponding to the at least one structure having been designated, or highlights, while the at least one structure displayed in the map image is designated, the at least one structure, among the structures displayed in the photographed image, corresponding to the at least one structure having been designated. ### Claim 11 (depends on 1) The information display device according to claim 1, wherein the image display means changes a method of highlighting the at least one structure corresponding to the designated at least one structure, based on the order in which the at least one structure is designated or based on an attribute of the at least one structure. ### Claim 12 (depends on 1) The information display device according to claim 1, wherein the image display means highlights both of the at least one structure designated in the photographed image and the at least one structure, displayed in the map image, corresponding to the at least one structure designated in the photographed image, or highlights both of the at least one structure designated in the map image and the at least one structure, displayed in the photographed image, corresponding to the at least one structure designated in the map image. ### Claim 13 (depends on 12) The information display device according to claim 12, wherein the image display means highlights the at least one structure designated in the photographed image and the at least one structure, displayed in the map image, corresponding to the at least one structure designated in the photographed image, so as to be associated with each other, or highlights the at least one structure designated in the map image and the at least one structure, displayed in the photographed image, corresponding to the at least one structure designated in the map image, so as to be associated with each other. ### Claim 14 (depends on 1) The information display device according to claim 1, wherein the image display means sets a map display area such that structures existing in a visual field space of the photographed image are displayed in the map image. ### Claim 15 (depends on 1) The information display device according to claim 1, wherein a designation method used by the input means is different depending on an attribute of the designated at least one structure. ### Claim 16 (depends on 5) The information display device according to claim 5, wherein the photographed image acquisition means can change at least one of the imaging direction and an imaging scale of the photographed image. ### Claim 17 (depends on 16) The information display device according to claim 16, wherein the photographed image acquisition means changes at least one of the imaging direction and the imaging scale, when the at least one structure designated in the map image does not exist in a visual field space of the photographed image.