Intelligent mobility aid device and method of navigating and providing assistance to a user thereof

An intelligent guidance device controlled and operated by a user, comprising:

• a plurality of wheels for travelling on a ground surface;
• a platform coupled to the plurality of wheels;
• a left bar having a left grip and being coupled to the platform;
• a right bar having a right grip and being coupled to the platform;
• a center bar connected between the left bar and the right bar;
• a pair of stereo cameras mounted to the center bar for detecting images;
• a memory storing predefined objects, previously determined user data regarding the user of the intelligent guidance device and previously detected data;
• a processor coupled to the pair of stereo cameras and the memory and configured to:
• proactively identify objects and distances to the objects using the detected images and the predefined objects;
• proactively determine a desirable event or action based on at least one of the identified objects, the previously determined user data, or a current time or day,
• proactively determine a destination based on the determined desirable event or action,
• proactively determine a navigation for navigating the intelligent guidance device based on the determined destination and the image data, and
• proactively determine output data corresponding to the determined navigation path
• a touch screen to proactively provide visual information regarding the objects and the distances to the objects;
• a speaker to proactively provide first audio information based on the output data and second audio information regarding at least one of the determined desirable event or action, the objects or the distances to the objects;
• a first vibratory motor coupled to the left grip for proactively providing haptics to navigate based on the determined output data;
• and
• a second vibratory motor coupled to the right grip for proactively providing haptics to navigate based on the determined output data.

A method of operating an intelligent guidance device, comprising:

• providing a plurality of wheels for travelling on a ground surface;
• providing a platform coupled to the plurality of wheels;
• providing a left bar coupled to the platform and having a left grip;
• providing a right bar coupled to the platform and having a right grip;
• detecting, using an inertial measurement unit (IMU) coupled to the platform, inertial measurement data corresponding to a positioning, a velocity, or an acceleration of the intelligent navigation device;
• proactively detecting, using a global position system (GPS) unit, location data corresponding to a location of the intelligent navigation device;
• proactively detecting, using a plurality of cameras coupled to the platform, image data corresponding to a surrounding environment of the intelligent guidance device;
• storing, using a memory, object data regarding previously determined objects and previously determined user data regarding a user of the intelligent guidance device;
• proactively recognizing, using a processor connected to the IMU, the GPS unit, and the plurality of cameras, an object in the surrounding environment by analyzing the image data based on the stored object data and at least one of the inertial measurement data or the location data;
• proactively determining, using the processor, a desirable event or action based on at least one of the recognized object, the previously determined user data, or a current time or day;
• proactively determining, using the processor, a destination based on the determined desirable event or action;
• proactively determining, using the processor, a navigation path for navigating the intelligent guidance device to the destination based on the determined destination, the image data, and at least one of the inertial measurement data or the location data;
• proactively determining, using the processor, output data based on the determined navigation path;
• proactively displaying, using a display, an image based on the determined output data to provide visual information to the user based on at least one of the recognized object, the determined desirable event or action, or the navigation path;
• and
• proactively outputting, using a speaker, first audio information to the user based on the output data and second audio information based on at least one of the recognized object, the determined desirable event or action, or the navigation path.