Smart hybrid rendering for augmented reality/virtual reality audio

A method of processing a plurality of audio streams, the method comprising:

• determining, by a device, a first listener position;
• clustering, by the device, the plurality of audio streams into a plurality of clusters, the plurality of clusters comprising a first cluster and a second cluster and each of the plurality of clusters comprising at least a respective one of the plurality of audio streams;
• determining, by the device, a first rendering mode based on the first listener position being associated with the first cluster;
• determining, by the device, a second rendering mode based on a listener moving to a second listener position being associated with both the first cluster and the second cluster;
• rendering, by the device, the first cluster based on the first rendering mode when the listener is at the first listener position;
• and
• rendering, by the device, both the first cluster and the second cluster based on the second rendering mode when the listener is at the second listener position, wherein the second rendering mode weights the first cluster and the second cluster based on a relative distance between the second listener position and at least a position location of the first cluster.

A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors of a device to:

• determine a first listener position;
• cluster a plurality of audio streams into a plurality of clusters, the plurality of clusters comprising a first cluster and a second cluster and each of the plurality of clusters comprising at least a respective one of the plurality of audio streams;
• determine a first rendering mode based on the first listener position being associated with the first cluster;
• based on a listener moving to a second listener position associated with both the first cluster and the second cluster, determine a second rendering mode;
• and
• render the first cluster based on the first rendering mode when the listener is at the first listener position and render both the first cluster and the second cluster based on the second rendering mode when the listener is at the second listener position, wherein the second rendering mode weights the first cluster and the second cluster based on a relative distance between the second listener position and at least a position location of the first cluster.

A device configured to process a plurality of audio streams, the device comprising:

• means for determining a first listener position;
• means for clustering the plurality of audio streams into a plurality of clusters, the plurality of clusters comprising a first cluster and a second cluster and each of the plurality of clusters comprising at least a respective one of the plurality of audio streams;
• means for determining a first rendering mode based on the first listener position being associated with the first cluster;
• means for, based on a listener moving to a second listener position being associated with both the first cluster and the second cluster, determining a second rendering mode;
• and
• means for rendering the first cluster based on the first rendering mode when the listener is at the first listener position and render both the first cluster and the second cluster based on the second rendering mode when the listener is at the second listener position, wherein the second rendering mode weights the first cluster and the second cluster based on a relative distance between the second listener position and at least a position location of the first cluster.