Sound source selection for aural interest
AssigneeInternational Business Machines Corporation
InventorsRobert G. Farrell, James R. Kozloski
Life of this patent
Estimating the term…
Abstract
A viewer-selectable audio display region is associated with certain pixels of a video feed visible to the viewer of the video. Directional microphones provide audio signals for specific audio sources within a three-dimensional (3-D) video recording space. The recorded video signal is augmented with the audio signals and identified sound sources. The sound sources are mapped to pixels on the display. When the viewer selects the pixels, one or more audio recordings are: (i) played; (ii) amplified; (iii) mixed; and/or (iv) otherwise processed.
Claims20
A method comprising:
- modifying a video recording by adding to the video recording a viewer-selectable region of a video display plane corresponding to a sub-set of pixels within a set of pixels displayed during playback of the video recording, the viewer-selectable region corresponding to a first sound source recorded by at least one microphone of a plurality of microphones from a three-dimensional scene;
- and
- adjusting an audio signal played by the modified video recording based, at least in part, upon selection of the viewer-selectable region during playback of the modified video recording;
- wherein:
- the at least one microphone records audio from the first sound source on an audio channel that is distinct from the audio channels of other microphones of the plurality of microphones;
- and
- selection of the viewer-selectable region plays an audio recording made by the at least one microphone corresponding to the first sound source.
A computer program product for providing viewer-selectable audio in a video, the computer program product comprising a computer readable storage medium having stored thereon:
- program instructions programmed to modify a video recording by adding to the video recording a viewer-selectable region of a video display plane corresponding to a sub-set of pixels within a set of pixels displayed during playback of the video recording, the viewer-selectable region corresponding to a first sound source recorded by at least one microphone of a plurality of microphones from a three-dimensional scene;
- and
- program instructions programmed to adjust an audio signal played by the modified video recording based, at least in part, upon selection of the viewer-selectable region during playback of the modified video recording;
- wherein:
- the at least one microphone records audio from the first sound source on an audio channel that is distinct from the audio channels of other microphones of the plurality of microphones;
- and
- selection of the viewer-selectable region plays an audio recording made by the at least one microphone corresponding to the first sound source.
A computer system for providing viewer-selectable audio in a video, the computer system comprising:
- a processor(s) set;
- and
- a computer readable storage medium;
- wherein:
- the processor set is structured, located, connected, and/or programmed to run program instructions stored on the computer readable storage medium;
- and
- the program instructions include:
- program instructions programmed to modify a video recording by adding to the video recording a viewer-selectable region of a video display plane corresponding to a sub-set of pixels within a set of pixels displayed during playback of the video recording, the viewer-selectable region corresponding to a first sound source recorded by at least one microphone of a plurality of microphones from a three-dimensional scene;
- and
- program instructions programmed to adjust an audio signal played by the modified video recording based, at least in part, upon selection of the viewer-selectable region during playback of the modified video recording;
- wherein:
- the at least one microphone records audio from the first sound source on an audio channel that is distinct from the audio channels of other microphones of the plurality of microphones;
- and
- selection of the viewer-selectable region plays an audio recording made by the at least one microphone corresponding to the first sound source.
Dependencies are inferred from the claim text.