System and method for using context in navigation dialog

A computer implemented method for forming a navigation system, comprising:

• an act of encoding a memory of a processor with instruction means to include a route planning module and a route guidance module,
• wherein the route planning module is configured to receive a request from a user for guidance to a particular destination, and based on a starting point, determining a route from the starting point to the particular destination;
• and
• wherein the route guidance module configured to receive the route from the route planning module, and based on the route and current location of the user, provide location-specific instructions to the user, where the location-specific instructions include reference to specific visible objects within the vicinity of the user;
• and
• wherein the route guidance module is further configured to include a vision module and to receive a plurality of image frames and detect and track objects proximate to the navigation system that are represented in the image frames, such that each object is assigned a track identifier and is then tracked in subsequent image frames.

A computer program product for navigating, the computer program product comprising computer-readable instruction means stored on a non-transitory computer-readable medium that are executable by a computer for causing the computer to:

• receive a request from a user for guidance to a particular destination, and based on a starting point, determine a route from the starting point to the particular destination;
• and
• based on the route and current location of the user, provide location-specific instructions to the user, where the location-specific instructions include reference to specific visible objects within the vicinity of the user;
• and
• receive a plurality of image frames and detect and track objects proximate to the computer that are represented in the image frames, such that each object is assigned a track identifier and is then tracked in subsequent image frames.

A navigation system, comprising:

• a route planning module configured to receive a request from a user for guidance to a particular destination, and based on a starting point, determining a route from the starting point to the particular destination;
• a route guidance module configured to receive the route from the route planning module, and based on the route and current location of the user, provide location-specific instructions to the user, where the location-specific instructions include reference to specific visible objects within the vicinity of the user;
• a speech understanding system for receiving an input speech utterance from a user and converting the input speech utterance into an interpreted input utterance, the interpreted input utterance consisting of a semantically labeled phrase;
• wherein the route planning module further comprises a route planning dialog manager, where the route planning dialog manager is configured to receive an interpreted input utterance from a speech understanding system requesting guidance to a particular destination, and based on the starting point, the input utterance, and the particular destination, the route planning dialog manager generates a starting and stopping point on the user's route, and once generated, confirms with the user that the generated starting and stopping points are correct starting and stopping points;
• wherein the route planning module further comprises a navigation route server, wherein the navigation route server is configured to receive the starting and stopping points, and based on the starting and stopping points, generate a route with directional instructions from the starting point to the stopping point;
• wherein the route guidance module further comprises a vehicle position and heading module, wherein the vehicle position and heading module is configured to determine a specific location of the navigation system;
• wherein the route guidance module further comprises a vision module, the vision module being configured to receive a plurality of image frames and detect and track objects proximate to the navigation system that are represented in the image frames, such that each object is assigned a track identifier and is then tracked in subsequent image frames;
• wherein the route guidance module further comprises a context monitor, the context monitor being configured to receive and combine information pertaining to the route, the specific location of the navigation system, and objects being detected and tracked that are proximate to the navigation system, and based on the combination of the information, the context monitor is configured to generate situational data, the situational data being a continuously updated status of the navigation system and its current local situation;
• wherein the route guidance module further comprises a local object blackboard, where the local object blackboard is configured to receive the track identifier and maintain a record of track identifiers that are currently proximate to the navigation system, otherwise deleting the track identifiers;
• wherein the route guidance module further comprises a local reference matcher, the local reference matcher being configured to receive the track identifier, the specific location of the navigation system, and user specific instructions regarding objects proximate to the navigation system, and further configured to match the user specific instructions regarding objects proximate to the navigation system with a specific track identifier;
• wherein the route guidance module further comprises a route guidance dialog manager, where the route guidance dialog manager is configured to receive a combination of information consisting of an interpreted input utterance from the speech understanding system, the route, and the situational data, and based on the combination of information, generating a phrase selected from a group consisting of the phrase being generated in response to a reference to a specific visible object within the vicinity of the user, and the phrase including a reference to a specific visible object within the vicinity of the user;
• a speech generator, the speech generator being configured to receive the phrase from the route guidance dialog manager and convert the phrase into an audible, speech signal;
• and
• an automobile with the route planning module, route guidance module, speech understanding system, and speech generator affixed thereto, thereby creating a driver navigation system.