# US 2014/0156181 A1 · Navigation device, navigation method, and navigation program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0156181 A1 - Document ID: US20140156181A1 - Status: Published application - Kind: A1 - Application number: 14/130,417 - Filed: 2011-11-10 - Published: 2014-06-05 - Earliest claimed: 2011-11-10 - Assignees: Mitsubishi Electric Corporation - Inventors: Keisuke Watanabe; Yuki Furumoto - Web page: https://patentgrep.com/patent/US20140156181A1 ## CPC - G01C 21/3608: {using speech input, e.g. using speech recognition} - G01C 21/3632: {Guidance using simplified or iconic instructions, e.g. using arrows (G01C21/365 takes precedence)} - G08G 1/096872: {where instructions are given per voice} - G09B 29/106: {using electronic means} - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) - G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93}) - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract Because a navigation device or method according to the present invention extracts only route guidance expressions which a speaking person, such as a fellow passenger, provides for the driver, interprets the abstract route guidance expressions to determine a concrete route guidance expression, and outputs information to be presented corresponding to the concrete route guidance expression, the navigation device enables the driver to understand the content intuitively and can prevent the driver from mishearing the speaking person's utterance and from driving the vehicle toward a direction which the speaking person does not intend. ## Claims ### Claim 1 A navigation device that includes a voice acquirer that acquires an inputted voice, a voice recognizer that carries out a voice recognition process on voice data acquired by said voice acquirer, and a position acquirer that acquires a position of a moving object, and that provides route guidance on a basis of a result of the recognition by said voice recognizer, the position of the moving object which is acquired by said position acquirer and map data, said navigation device comprising: a route guidance expression storage that stores route guidance expressions; a route guidance expression extractor that refers to said route guidance expression storage to extract a route guidance expression from the result of the recognition by said voice recognizer; a route guidance expression interpreter that interprets the route guidance expression extracted by said route guidance expression extractor to determine a concrete route guidance expression; a route guidance expression information to be presented storage that stores visual information to be presented corresponding to said concrete route guidance expression while bringing the visual information to be presented into correspondence with said concrete route guidance expression; a route guidance expression information to be presented retriever that refers to said route guidance expression information to be presented storage to retrieve the corresponding visual information to be presented on a basis of the concrete route guidance expression determined by said route guidance expression interpreter; and a presentation control outputter that outputs the visual information to be presented retrieved by said route guidance expression information to be presented retriever. ### Claim 2 (depends on 1) The navigation device according to claim 1, wherein said route guidance expression interpreter interprets the route guidance expression extracted by said route guidance expression extractor on a basis of both the position of said moving object and said map data to determine the concrete route guidance expression. ### Claim 3 (depends on 1) The navigation device according to claim 1, wherein said navigation device further includes a gesture recognizer that recognizes a gesture, and said route guidance expression interpreter interprets the route guidance expression extracted by said route guidance expression extractor on a basis of a result of the recognition by said gesture recognizer to determine the concrete route guidance expression. ### Claim 4 (depends on 3) The navigation device according to claim 3, wherein said navigation device further includes a contradiction determinator that determines whether or not there is a contradiction between the route guidance expression extracted by said route guidance expression extractor and the recognition result obtained by said gesture recognizer, and, when said contradiction determinator determines that there is a contradiction between them, said route guidance expression interpreter selects either one of the route guidance expression extracted by said route guidance expression extractor and the recognition result obtained by said gesture recognizer according to a predetermined rule to determine said concrete route guidance expression. ### Claim 5 (depends on 4) The navigation device according to claim 4, wherein when said contradiction determinator determines that there is a contradiction between the route guidance expression and the recognition result, said route guidance expression interpreter selects the recognition result obtained by said gesture recognizer to determine said concrete route guidance expression. ### Claim 6 (depends on 4) The navigation device according to claim 4, wherein when said contradiction determinator determines that there is a contradiction between the route guidance expression and the recognition result and a route to a destination is set, said route guidance expression interpreter selects one matching said set route from the route guidance expression extracted by said route guidance expression extractor and the recognition result obtained by said gesture recognizer to determine said concrete route guidance expression. ### Claim 7 (depends on 1) The navigation device according to claim 1, wherein said presentation control outputter outputs the visual information to be presented retrieved by said route guidance expression information to be presented retriever on a basis of a result of the interpretation by said route guidance expression interpreter. ### Claim 8 (depends on 1) The navigation device according to claim 1, wherein said route guidance expression interpreter interprets the route guidance expression extracted by said route guidance expression extractor to also determine a position where said visual information to be presented is to be presented, and said presentation control outputter displays said visual information to be presented at the position determined by said route guidance expression interpreter. ### Claim 9 (depends on 8) The navigation device according to claim 8, wherein when a route to a destination is set, said route guidance expression interpreter determines the position where said visual information to be presented is to be presented on a basis of information about said set route. ### Claim 10 (depends on 8) The navigation device according to claim 8, wherein said navigation device further includes an external object recognizer that recognizes a surrounding object, and said route guidance expression interpreter determines the position where said visual information to be presented is to be presented on a basis of a result of the recognition by said external object recognizer. ### Claim 11 (depends on 1) The navigation device according to claim 1, wherein said navigation device further includes a route guidance expression appropriateness determinator that determines whether or not the concrete route guidance expression determined by said route guidance expression interpreter is appropriate, and said presentation control outputter does not output said visual information to be presented when said route guidance expression appropriateness determinator determines that said concrete route guidance expression is not appropriate. ### Claim 12 (depends on 1) The navigation device according to claim 1, wherein said navigation device further includes a route guidance expression appropriateness determinator that determines whether or not the concrete route guidance expression determined by said route guidance expression interpreter is appropriate, and said presentation control outputter outputs visual information to be presented showing that said route guidance expression is not appropriate when said route guidance expression appropriateness determinator determines that said concrete route guidance expression is not appropriate. ### Claim 13 (depends on 11) The navigation device according to claim 11, wherein said navigation device further includes a route resetter that resets a route when said route guidance expression appropriateness determinator determines that said concrete route guidance expression is not appropriate. ### Claim 14 (depends on 1) The navigation device according to claim 1, wherein said navigation device further includes a cancellation/amendment expression storage that stores expressions used at a time of a cancellation or amendment, and a cancellation/amendment expression extractor that refers to said cancellation/amendment expression storage to extract an expression used for a cancellation or amendment from the result of the recognition by said voice recognizer, and wherein said presentation control outputter does not output said visual information to be presented when said cancellation or amendment expression is extracted. ### Claim 15 (depends on 1) The navigation device according to claim 1, wherein said navigation device further includes a cancellation/amendment expression storage that stores expressions used at a time of a cancellation or amendment, and a cancellation/amendment expression extractor that refers to said cancellation/amendment expression storage to extract an expression used for a cancellation or amendment from the result of the recognition by said voice recognizer, and wherein said presentation control outputter cancels the output of said visual information to be presented when said cancellation or amendment expression is extracted in a state in which said visual information to be presented is outputted. ### Claim 16 (depends on 1) The navigation device according to claim 1, wherein said navigation device further includes a cancellation/amendment expression storage that stores expression used at a time of a cancellation or amendment, and a cancellation/amendment expression extractor that refers to said cancellation/amendment expression storage to extract an expression used for the cancellation or amendment from the result of the recognition by said voice recognizer, and wherein when said cancellation or amendment expression is extracted, said presentation control outputter outputs visual information to be presented corresponding to a route guidance expression extracted successively after said cancellation or amendment expression. ### Claim 17 A navigation method that includes a step that a voice acquirer acquires an inputted voice, a step that a voice recognizer carries out a voice recognition process on voice data acquired by said voice acquirer, a step that a position acquirer acquires a position of a moving object, and a step that provides route guidance on a basis of a result of the recognition by said voice recognizer, the position of the moving object which is acquired by said position acquirer and map data, said method comprising: a step that a route guidance expression storage stores route guidance expressions; a step that a route guidance expression extractor refers to said route guidance expression storage to extract a route guidance expression from the result of the recognition by said voice recognizer; a step that a route guidance expression interpreter interprets the route guidance expression extracted by said route guidance expression extractor to determine a concrete route guidance expression; a step that a route guidance expression information to be presented storage stores visual information to be presented corresponding to said concrete route guidance expression while bringing the visual information to be presented into correspondence with said concrete route guidance expression; a step that a route guidance expression information to be presented retriever refers to said route guidance expression information to be presented storage to retrieve the corresponding visual information to be presented on a basis of the concrete route guidance expression determined by said route guidance expression interpreter; and a step that a presentation control outputter outputs the visual information to be presented retrieved by said route guidance expression information to be presented retriever. ### Claim 18 A navigation program that provides route guidance on a basis of a result of recognition by a voice recognizer, a position of a moving object which is acquired by a position acquirer and map data by causing a computer to function as: a voice acquirer that acquires an inputted voice; said voice recognizer that carries out a voice recognition process on voice data acquired by said voice acquirer; a route guidance expression storage that stores route guidance expressions; a route guidance expression extractor that refers to said route guidance expression storage to extract a route guidance expression from the result of the recognition by said voice recognizer; a route guidance expression interpreter that interprets the route guidance expression extracted by said route guidance expression extractor to determine a concrete route guidance expression; a route guidance expression information to be presented storage that stores visual information to be presented corresponding to said concrete route guidance expression while bringing the visual information to be presented into correspondence with said concrete route guidance expression; a route guidance expression information to be presented retriever that refers to said route guidance expression information to be presented storage to retrieve the corresponding visual information to be presented on a basis of the concrete route guidance expression determined by said route guidance expression interpreter; and a presentation control outputter that outputs the visual information to be presented retrieved by said route guidance expression information to be presented retriever.