Subband spatial processing and crosstalk cancellation system for conferencing
AssigneeBoomcloud 360, Inc.
InventorZachary Seldess
Life of this patent
Estimating the term…
Abstract
Embodiments relate to providing a conference for client devices with spatialized audio. Input audio streams are received from the client devices. For each client device, placement data defining spatial locations of other client devices within a sound field is determined. A mixed stream including a left mixed channel and a right mixed channel for the client device is generated by mixing and panning input audio streams of the other client devices according to the placement data. A spatially enhanced stream including a left enhanced channel for a left speaker and a right enhanced channel for a right speaker is generated by applying subband spatial processing and crosstalk processing on the left mixed channel and the right mixed channel of the mixed stream.
Claims20
A method for providing a conference for a client device of a plurality of client devices, comprising:
- receiving input audio streams from the plurality of client devices;
- generating a mixed stream for the client device including a left mixed channel and a right mixed channel by mixing and panning input audio streams of other client devices of the plurality of client devices according to placement data defining spatial locations for the other client devices within a sound field;
- determining a type of speaker associated with the client device;
- generating a crosstalk processed stream including a left channel and a right channel by applying crosstalk processing on the left mixed channel and the right mixed channel of the mixed stream, wherein:
- the crosstalk processing is a crosstalk simulation responsive to determining a first type of speaker is associated with the client device;
- and
- the crosstalk processing is a crosstalk cancellation responsive to determining a second type of speaker is associated with the client device;
- and
- providing the left channel of the crosstalk processed stream to a left speaker of the client device and the right channel of the crosstalk processed stream to a right speaker of the client device.
A non-transitory computer readable medium storing program code that when executed by a processor configures the processor to:
- receive input audio streams from a plurality of client devices;
- generate a mixed stream for the client device including a left mixed channel and a right mixed channel by mixing and panning input audio streams of other client devices of the plurality of client devices according to the placement data defining spatial locations for the other client devices within a sound field;
- and
- determine a type of speaker associated with the client device;
- and
- generate a crosstalk processed stream including a left channel and a right channel by applying crosstalk processing on the left mixed channel and the right mixed channel of the mixed stream, wherein:
- the crosstalk processing is a crosstalk simulation responsive to determining a first type of speaker is associated with the client device;
- and
- the crosstalk processing is a crosstalk cancellation responsive to determining a second type of speaker is associated with the client device.
A system for providing a conference for a client device of a plurality of client devices, comprising:
- processing circuitry configured to:
- receive input audio streams from the plurality of client devices;
- generate a mixed stream for the client device of the plurality of client devices including a left mixed channel and a right mixed channel by mixing and panning input audio streams of other client devices of the plurality of client devices of the plurality of client devices according to the placement data defining spatial locations for the other client devices within a sound field;
- and
- determine a type of speaker associated with the client device;
- and
- generate a crosstalk processed stream including a left channel and a right channel by applying crosstalk processing on the left mixed channel and the right mixed channel of the mixed stream, wherein:
- the crosstalk processing is a crosstalk simulation responsive to determining a first type of speaker is associated with the client device;
- and
- the crosstalk processing is a crosstalk cancellation responsive to determining a second type of speaker is associated with the client device.
Dependencies are inferred from the claim text.