Systems and methods for blind and visually impaired person environment navigation assistance

A method, performed by a mobile device, for assisting a visually impaired user, the method comprising:

• receiving, from the mobile device associated with the visually impaired user, one or more images relating to a room or new environment, wherein the one or more images are acquired by the mobile device upon the visually impaired user entering the room or new environment, wherein the mobile device comprises a camera, processor, memory, touch-enabled screen, audio output, and vibration output;
• processing the one or more images to obtain a three-dimensional model representation of the room or new environments and identifying one or more object attributes of one or more identified objects within the room or new environment;
• processing the three-dimensional model to obtain a two-dimensional projection of the room or new environment including the one or more identified objects and the one or more identified object attributes,
• mapping the two-dimensional projection to the touch-enabled screen of the mobile device such that edges of the touch-enabled screen form an outline of the room or new environment;
• playing back audio related to the one or more identified objects responsive to the visually impaired user touching the two-dimensional projection on the touch-enabled screen, wherein the audio includes a distance to the object being touched and/or the object attributes of the object being touched.