System and method for navigating and interacting via conversation
AssigneeCarnegie Mellon University
InventorsOscar J. Romero-Lopez, Anthony Tomasic, John D. Zimmerman, Aaron Steinfeld
Life of this patent
Estimating the term…
Abstract
A system and method can be used by blind and low-vision users to navigate and interact in an environment using conversational speech. The system and method integrate object detection, spatial anchors, and conversation to support both independent navigation and interaction. Object detection can be accomplished by capturing data from sensors on an electronic device carried by the user. Spatial anchors can include information relevant to requests from the user. The use of conversational speech permits an exchange of information that is not cognitively overwhelming.
Claims18
A method for providing navigation and interaction assistance comprising:
- acquiring data about an object or an environment using a perception module;
- storing the data in a working memory module, wherein the working memory module receives the data from the perception module and integrates the data with other information stored in the working memory module;
- and
- providing output based on processing of the information, wherein the output comprises conversational speech.
A system for providing navigation and interaction assistance comprising:
- an electronic device adapted perform the following functions:
- acquiring data about an object or an environment using a perception module;
- storing the data in a working memory module, wherein the working memory module receives the data from the perception module and integrates the data with other information stored in the working memory module;
- and
- providing output based on processing of the information, wherein the output comprises conversational speech.
Dependencies are inferred from the claim text.