Sound source selection for aural interest
AssigneeInternational Business Machines Corporation
InventorsRobert G. Farrell, James R. Kozloski
Life of this patent
Estimating the term…
Abstract
A viewer-selectable audio display region is associated with certain pixels of a video feed visible to the viewer of the video. Directional microphones provide audio signals for specific audio sources within a three-dimensional (3-D) video recording space. The recorded video signal is augmented with the audio signals and identified sound sources. The sound sources are mapped to pixels on the display. When the viewer selects the pixels, one or more audio recordings are: (i) played; (ii) amplified; (iii) mixed; and/or (iv) otherwise processed.
Claims19
A method for providing viewer-selectable audio in a video, the method comprising:
- recording a first video of a three-dimensional scene using at least one video camera and at least one microphone;
- determining a first sound source for the at least one microphone;
- and
- generating a second video having a first audio display region corresponding to the first sound source;
- wherein:
- the at least one microphone records audio from the first sound source on an audio channel that is distinct from the audio channels of other microphones of the at least one microphone;
- the first audio display region is a user-selectable region corresponding to a set of pixels within the second video;
- selection of the first audio display region plays an audio recording made by the at least one microphone corresponding to the first sound source.
A computer program product for providing viewer-selectable audio in a video, the computer program product comprising a computer readable storage medium having stored thereon:
- first program instructions programmed to record a first video of a three-dimensional scene using at least one video camera and at least one microphone;
- second program instructions programmed to determine a first sound source for the at least one microphone;
- and
- third program instructions programmed to generate a second video having a first audio display region corresponding to the first sound source;
- wherein:
- the at least one microphone records audio from the first sound source on an audio channel that is distinct from the audio channels of other microphones of the at least one microphone;
- the first audio display region is a user-selectable region corresponding to a set of pixels within the second video;
- selection of the first audio display region plays an audio recording made by the at least one microphone corresponding to the first sound source.
A computer system for providing viewer-selectable audio in a video, the computer system comprising:
- a processor(s) set;
- and
- a computer readable storage medium;
- wherein:
- the processor set is structured, located, connected, and/or programmed to run program instructions stored on the computer readable storage medium;
- and
- the program instructions include:
- first program instructions programmed to record a first video of a three-dimensional scene using at least one video camera and at least one microphone;
- second program instructions programmed to determine a first sound source for the at least one microphone;
- and
- third program instructions programmed to generate a second video having a first audio display region corresponding to the first sound source;
- wherein:
- the at least one microphone records audio from the first sound source on an audio channel that is distinct from the audio channels of other microphones of the at least one microphone;
- the first audio display region is a user-selectable region corresponding to a set of pixels within the second video;
- selection of the first audio display region plays an audio recording made by the at least one microphone corresponding to the first sound source.
Dependencies are inferred from the claim text.