Methods and systems for speech presentation based on simulated binaural audio signals

A system comprising:

• a memory storing instructions;
• and
• a processor communicatively coupled to the memory and configured to execute the instructions to:
• receive a simulated binaural audio signal merging together a plurality of concurrent speech instances originating from a plurality of different speakers speaking concurrently;
• receive acoustic propagation data associated with the simulated binaural audio signal, the acoustic propagation data representative of respective propagation effects applied, within the simulated binaural audio signal, to each of the concurrent speech instances to simulate propagation of the concurrent speech instances;
• extract, from the simulated binaural audio signal and based on the acoustic propagation data, a different auto-transcribable speech signal for each of the plurality of concurrent speech instances merged together in the simulated binaural audio signal;
• generate, based on the extracted auto-transcribable speech signals, a different closed captioning dataset for each of the plurality of concurrent speech instances merged together in the simulated binaural audio signal;
• and
• provide, for presentation on a display screen of a media player device that displays representations of the plurality of different speakers at different virtual locations within an artificial reality world, the different closed captioning datasets, wherein the providing is configured to allow the media player device to concurrently overlay the different closed captioning datasets next to the plurality of different speakers speaking concurrently at the different virtual locations within the artificial reality world.

A non-transitory computer-readable medium storing instructions that, when executed, direct a processor of a computing device to:

• receive a simulated binaural audio signal merging together a plurality of concurrent speech instances originating from a plurality of different speakers speaking concurrently;
• receive acoustic propagation data associated with the simulated binaural audio signal, the acoustic propagation data representative of respective propagation effects applied, within the simulated binaural audio signal, to each of the concurrent speech instances to simulate propagation of the concurrent speech instances;
• extract, from the simulated binaural audio signal and based on the acoustic propagation data, a different auto-transcribable speech signal for each of the plurality of concurrent speech instances merged together in the simulated binaural audio signal;
• generate, based on the extracted auto-transcribable speech signals, a different closed captioning dataset for each of the plurality of concurrent speech instances merged together in the simulated binaural audio signal;
• and
• provide, for presentation on a display screen of a media player device that displays representations of the plurality of different speakers at different virtual locations within an artificial reality world, the different closed captioning datasets, wherein the providing is configured to allow the media player device to concurrently overlay the different closed captioning datasets next to the plurality of different speakers speaking concurrently at the different virtual locations within the artificial reality world.