Back to results
US 2018/0020312 A1Published application
Virtual, augmented, and mixed reality
AssigneeQUALCOMM Incorporated
InventorsErik Visser, Lae-Hoon Kim, Raghuveer Peri
Life of this patent
Estimating the term…
Abstract
A method for outputting virtual sound includes detecting an audio signal in an environment at one or more microphones. The method also includes determining, at a processor, a location of a sound source of the audio signal and estimating one or more acoustical characteristics of the environment based on the audio signal. The method further includes inserting a virtual sound into the environment based on the one or more acoustical characteristics. The virtual sound has one or more audio properties of a sound generated from the location of the sound source.
Claims63
An apparatus for outputting virtual sound, the apparatus comprising:
- one or more microphones configured to detect an audio signal in an environment;
- and
- a processor coupled to the one or more microphones, the processor configured to:
- determine a sound characteristic of the audio signal;
- determine, based on the sound characteristic, whether a sound source of the audio signal is located in a first zone of the environment or a second zone of the environment, the first zone closer to the one or more microphones than the second zone;
- estimate a direction-of-arrival of the audio signal;
- estimate a location of the sound source based on the direction-of-arrival and at least one of the zones associated with the sound source;
- and
- insert a virtual sound into the environment, the virtual sound having one or more audio properties of a sound generated from the location of the sound source.
6 more elements
(canceled)
A method for outputting virtual sound, the method comprising:
- detecting an audio signal in an environment at one or more microphones;
- determining, at a processor, a sound characteristic of the audio signal;
- determining, based on the sound characteristic, whether a sound source of the audio signal is located in a first zone of the environment or a second zone of the environment, the first zone closer to the one or more microphones than the second zone;
- estimating a direction-of-arrival of the audio signal;
- estimating a location of the sound source based on the direction-of-arrival and at least one of the zones associated with the sound source;
- and
- inserting a virtual sound into the environment, the virtual sound having one or more audio properties of a sound generated from the location of the sound source.
4 more elements
(canceled)
A non-transitory computer-readable medium comprising instructions for outputting virtual sound, the instructions, when executed by a processor, cause the processor to perform operations comprising:
- determining a sound characteristic of an audio signal in an environment, the audio signal detected at one or more microphones;
- determining, based on the sound characteristic, whether a sound source of the audio signal is located in a first zone of the environment or a second zone of the environment, the first zone closer to the one or more microphones than the second zone;
- estimating a direction-of-arrival of the audio signal;
- estimating a location of the sound source based on the direction-of-arrival and at least one of the zones associated with the sound source;
- and
- inserting a virtual sound into the environment, the virtual sound having one or more audio properties of a sound generated from the location of the sound source.
3 more elements
An apparatus for outputting virtual sound, the apparatus comprising:
- means for detecting an audio signal in an environment;
- means for determining a sound characteristic of the audio signal;
- means for determining, based on the sound characteristic, whether a sound source of the audio signal is located in a first zone of the environment or a second zone of the environment, the first zone closer to the means for detecting than the second zone;
- means for estimating a direction-of-arrival of the audio signal;
- means for estimating a location of the sound source based on the direction-of-arrival and at least one of the zones associated with the sound source;
- and
- means for inserting a virtual sound into the environment, the virtual sound having one or more audio properties of a sound generated from the location of the sound source.
4 more elements
An apparatus for outputting sound, the apparatus comprising:
- one or more speakers configured to generate audio signals at different locations of an environment;
- one or more microphones configured to detect each audio signal;
- a memory;
- and
- a processor coupled to the memory, to the one or more speakers, and to the one or more microphones, the processor configured to:
- determine one or more acoustical characteristics at one or more locations of the environment based on detected audio signals generated by the one or more speakers;
- receive a user selection indicating a particular object;
- receive a user indication of a particular location;
- determine one or more audio properties of a sound generated from the particular location based on the one or more acoustical characteristics;
- and
- insert a virtual sound associated with the particular object into the environment, the virtual sound having the one or more audio properties.
8 more elements
(canceled)
A method for outputting sound, the method comprising:
- generating audio signals at different locations of an environment using one or more speakers;
- detecting each audio signal using one or more microphones;
- determining one or more acoustical characteristics at one or more locations of the environment based on detected audio signals generated by the one or more speakers;
- receiving a user selection indicating a particular object;
- receiving a user indication of a particular location;
- determining one or more audio properties of a sound generated from the particular location based on the one or more acoustical characteristics;
- and
- inserting a virtual sound associated with the particular object into the environment, the virtual sound having the one or more audio properties.
5 more elements
(canceled)
A non-transitory computer-readable medium comprising instructions for outputting sound, the instructions, when executed by a processor, cause the processor to perform operations comprising:
- initiating generation of audio signals at different locations of an environment using one or more speakers;
- detecting each audio signal using one or more microphones;
- determining one or more acoustical characteristics at one or more locations of the environment based on detected audio signals generated by the one or more speakers;
- receiving a user selection indicating a particular object;
- receiving a user indication of a particular location;
- determining one or more audio properties of a sound generated from the particular location based on the one or more acoustical characteristics;
- and
- inserting a virtual sound associated with the particular object into the environment, the virtual sound having the one or more audio properties.
5 more elements
(canceled)
An apparatus for outputting sound, the apparatus comprising:
- means for generating audio signals at different locations of an environment;
- means for detecting each audio signal;
- means for determining one or more acoustical characteristics at one or more locations of the environment based on detected audio generated by means for generating;
- means for receiving a user selection indicating a particular object;
- means for receiving a user indication of a particular location;
- means for determining one or more audio properties of a sound generated from the particular location based on the one or more acoustical characteristics;
- and
- means for inserting a virtual sound associated with the particular object into the environment, the virtual sound having the one or more audio properties.
5 more elements
(canceled)
Dependencies are inferred from the claim text.