Real-time remodeling of user voice in an immersive visualization system

A method of operating a head-mounted display device with audio capability, the method comprising:

• displaying, by the head-mounted display device, a holographic image depicting a physical thing to a user of the head-mounted display device, such that the holographic image is superimposed over a real world view of a physical environment in which the user is located;
• inputting voice of the user by using an array of microphones of the head-mounted display device, while the holographic image is being displayed to the user;
• dynamically modifying user voice data representing the voice of the user to incorporate an audio effect that corresponds to an acoustic property of the physical thing, while the holographic image is being displayed to the user;
• and
• outputting sound to the user, via a speaker of the head-mounted display device, based on the modified user voice data, to produce an audible effect applied to the voice of the user corresponding to the acoustic property of the physical thing, while the holographic image is being displayed to the user.

A head-mounted display device comprising:

• a head fitting by which to mount the head-mounted display device to the head of a user;
• a display element, coupled to the head fitting and configured to display to the user a holographic image on a real-world view of an environment of the user, the holographic image depicting a physical thing;
• a plurality of microphones to input voice of the user while the holographic image is being displayed to the user;
• a processor configured to access the audio data and to dynamically modify user voice data representing the voice of the user in real-time to incorporate an audio effect corresponding to the physical thing, while the holographic image is being displayed to the user;
• and
• a speaker subsystem to output sound to the user based on the modified user voice data while the holographic image is being displayed to the user, the sound representing the voice of the user as affected by the physical thing.