Back to results
US 12,717,543 B2Granted
Devices with enhanced audio
AssigneeApple Inc.
InventorsAleksandar Pance, Brett Bilbrey, Darby E. Hadley, Martin E. Johnson, Ronald Nadim Isaac
Life of this patent
Estimating the term…
Abstract
A system for enhancing audio including a plurality of sensors, an output device, and a processor in communication with the plurality of sensors and the output device. The processor is configured to process data captured by the plurality of sensors, and based on that, modify an output of the output device. The processor also is configured to determine whether there are a plurality of users associated with a video conferencing session, determine which user of the plurality of users is speaking, and enhance the audio or video output of the speaking user on the output device.
Claims18
A computing device, comprising:
- a processor that is configured to communicate with an audio output device and a display to provide a video conferencing session having a video output and a sound output, the processor to:
- receive i) streaming audio from a first microphone and video from a first camera of a first computing device, and ii) streaming audio from a second microphone and video from a second camera of a second computing device;
- produce during the video conferencing session
- i) the video, on the display, that includes simultaneous images of a plurality of people, respectively, that are grouped together on the display to present a single interface of the video conferencing session, wherein the plurality of people include a first user of the first camera and the first computing device and a second user of the second camera and the second computing device, and
- ii) the sound output, by the audio output device, which includes audio of the plurality of people including audio from the first computing device and audio from the second computing device;
- detect that one of the plurality of people is speaking, as a speaking person, and determine which one of the simultaneous images on the display correlates to the audio of the speaking person;
- detect that a location, on the display, of said one of the simultaneous images of the speaking person is offset from a middle of the display, and in response enhance the audio of the speaking person relative to the audio of others in the plurality of people so that the audio of the speaking person is angled towards a side of the display on which the image of the speaking person is located.
4 more elements
A method for providing a video conferencing session having video and sound output, the method comprising:
- receiving in a viewing user's computing device i) streaming audio from a first microphone and video from a first camera of a first computing device, and ii) streaming audio from a second microphone and video from a second camera of a second computing device;
- producing, during the video conferencing session by a single video chat program running in the viewing user's computing device:
- i) the video, on a display, that includes a plurality of simultaneous images of a plurality of people, respectively, wherein the plurality of simultaneous images are grouped together on the display to present a single interface of the video conferencing session, wherein the plurality of people include a first user of the first camera and the first computing device and a second user of the second camera and the second computing device;
- ii) the sound output, by an audio output device, which includes the streaming audio from the first computing device and the streaming audio from the second computing device;
- detecting that one of the plurality of people is speaking, as a speaking person, and determining which one of the plurality of simultaneous images on the display correlates to the streaming audio of the speaking person;
- and
- detecting that a location, on the display, of said one of the plurality of simultaneous images that correlates to the speaking person is offset from a middle of the display, and in response enhancing the streaming audio of the speaking person in the sound output, relative to the streaming audio of others in the plurality of people so that the viewing user hears the streaming audio of the speaking person from where the image of the speaking person is located.
4 more elements
A memory comprising instructions stored therein that configure a processor in a viewing user's computing device to provide a video conferencing session having video and sound output, by the processor:
- receiving i) streaming audio from a first microphone and video from a first camera of a first computing device, and ii) streaming audio from a second microphone and video from a second camera of a second computing device;
- producing, during the video conferencing session by a single video chat program running in the viewing user's computing device, i) the video, on a display, that includes a plurality of simultaneous images of a plurality of people, respectively, that are grouped together on the display to present a single interface of the video conferencing session, wherein the plurality of people includes a first user of the first camera and the first computing device and a second user of the second camera and the second computing device, and ii) the sound output, by an audio output device, that includes the streaming audio from the first microphone and the streaming audio from the second microphone;
- detecting that one of the plurality of people is speaking, as a speaking person, and determining which one of the plurality of simultaneous images on the display correlates to the streaming audio of the speaking person;
- and
- detecting that a location, on the display, of said one of the plurality of simultaneous images that correlates to the speaking person is offset from a middle of the display, and in response enhancing the streaming audio of the speaking person in the sound output, relative to the streaming audio of others in the plurality of people so that the viewing user hears the streaming audio of the speaking person from where the image of the speaking person is located.
2 more elements
Dependencies are inferred from the claim text.