Vehicle control and 3D environment experience with or without visualization based on 3D audio/visual sensors

Abstract

Provided is a method for controlling a vehicle, including: receiving a plurality of visual sensor signals containing three-dimensional visual information outside and inside the vehicle; receiving a plurality of audio sensor signals containing three-dimensional audio information outside and inside the mobile vehicle; determining three-dimensional spatial positions of at least two objects and object cognitive information of the at least two objects according to at least a portion of the plurality of visual sensor signals and at least a portion of the plurality of audio sensor signals, wherein the at least two objects include at least one object outside the vehicle and at least one object inside the vehicle; obtaining a circumstance information of the vehicle according to the object cognitive information; and determining operation instructions for the vehicle according to the circumstance information.

Dependencies are inferred from the claim text.