Source devices, sink devices, methods and computer programs
AssigneeFraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
InventorsStefan KRAEGELOH, Thomas HELLER, Rinat ZEH, Herbert THOMA
Life of this patent
Estimating the term…
Abstract
A source device for providing audio data and video data on one or more digital media interfaces is described, wherein the source device is configured to automatically adjust a time alignment between a provision of audio data and a provision of video data based on an information about a latency of an audio path and based on an information about a latency of a video path.
Claims36
A source device for providing audio data and video data on one or more digital media interfaces,
- wherein the source device is configured to automatically adjust a time alignment between a provision of audio data and a provision of video data based on an information about a latency of an audio path and based on an information about a latency of a video path,
- wherein the source device is configured to acquire an encoded video representation,
- to decode the encoded video representation, to acquire a decoded video representation, and
- to provide the video data, such that the video data represent the decoded video representation, and
- wherein the source device is configured to selectively delay the decoding of the encoded video representation based on the information about the latency of the audio path and the information about the latency of the video path.
- wherein the source device is configured to acquire the information about the latency of the audio path using an audio delay information which is acquired from an audio playback device via one of the one or more digital interfaces, and/or
- wherein the source device is configured to acquire the information about the latency of the video path using a video delay information which is acquired from a video rendering device via one of the one or more digital interfaces.
A sink device,
- wherein the sink device is configured to receive audio data via a digital media interface,
- wherein the sink device is configured to decode the received audio data, to acquire decoded audio data, and
- wherein the sink device is configured to output the decoded output data;
- wherein the sink device is configured to report a device-individual latency information which comprises latency information associated with a playback using the first audio mode and latency information associated with a playback using a second audio mode, in response to a request from a source device, and
- wherein the sink device is configured to negotiate a decoding latency or a playback latency associated with the second audio mode with a source device.
A sink device,
- wherein the sink device is configured to receive video data via a digital media interface,
- wherein the sink device is configured to render the received video data;
- wherein the sink device is configured to report a device-individual latency information which comprises
- static latency information representing a contribution of the sink device to a total video latency information describing a total latency of a video path or describing an average total latency of the video path over a plurality of video modes;
- and
- latency information representing an actual latency of a rendering of video data,
- wherein the contribution to the total video latency information is different from the latency information representing the actual latency of a rendering of video data.
A method for providing audio data and video data on one or more digital media interfaces,
- wherein the method comprises automatically adjusting a time alignment between a provision of audio data and a provision of video data based on an information about a latency of an audio path and based on an information about a latency of a video path,
- wherein the method comprises:
- acquiring an encoded video representation,
- decoding the encoded video representation, to acquire a decoded video representation, and
- providing the video data, such that the video data represent the decoded video representation, and
- wherein the method comprises selectively delaying the decoding of the encoded video representation based on the information about the latency of the audio path and the information about the latency of the video path, and
- wherein the method comprises
- acquiring the information about the latency of the audio path using an audio delay information which is acquired from an audio playback device via one of the one or more digital interfaces, and/or
- acquiring the information about the latency of the video path using a video delay information which is acquired from a video rendering device via one of the one or more digital interfaces.
A method for operating a sink device,
- wherein the method comprises receiving audio data via a digital media interface,
- wherein the method comprises decoding the received audio data, to acquire decoded audio data, and
- wherein the method comprises outputting the decoded output data;
- wherein the method comprises reporting a device-individual latency information which comprises latency information associated with a playback using the first audio mode and latency information associated with a playback using a second audio mode, in response to a request from a source device, and
- wherein the method comprises negotiating a decoding latency or a playback latency associated with the second audio mode with a source device.
A method for operating a sink device,
- wherein the method comprises receiving video data via a digital media interface,
- wherein the method comprises rendering the received video data
- wherein the method comprises reporting a device-individual latency information which comprises
- latency information representing a contribution of the sink device to a total video latency information describing a total latency of a video path or describing an average total latency of the video path over a plurality of video modes;
- and
- latency information representing an actual latency of a rendering of video data,
- wherein the contribution to the total audio latency information is different from the latency information representing the actual latency of a rendering of video data.
A source device for providing audio data and video data on one or more digital media interfaces,
- wherein the source device is configured to automatically adjust a time alignment between a provision of audio data and a provision of video data based on an information about a latency of an audio path and based on an information about a latency of a video path,
- wherein the source device is configured to negotiate a decoding latency with an audio playback device, and to adjust the time alignment in dependence on the negotiated decoding latency.
A source device for providing audio data and video data on one or more digital media interfaces, wherein the source device is configured
- to automatically adjust a time alignment between a provision of audio data and a provision of video data based on an information about a latency of an audio path and based on an information about a latency of a video path;
- and
- to negotiate a decoding latency with an audio playback device, and to adjust the time alignment in dependence on the negotiated decoding latency;
- and
- to acquire a latency span information describing a span of possible latency values from the audio playback device, or to acquire a latency list information describing one or more possible latency values from the audio playback device;
- and
- to select a desired latency value on the basis of the latency span information or the latency list information such that the desired latency value fits an information about the latency of the video path;
- and
- to instruct the audio playback device to use the desired latency value;
- and
- to adjust the time alignment in dependence on the selected desired audio playback latency value.
A method for providing audio data and video data on one or more digital media interfaces, comprising
- automatically adjusting a time alignment between a provision of audio data and a provision of video data based on an information about a latency of an audio path and based on an information about a latency of a video path;
- negotiating a decoding latency with an audio playback device, and to adjust the time alignment in dependence on the negotiated decoding latency.
A method for providing audio data and video data on one or more digital media interfaces, comprising
- automatically adjusting a time alignment between a provision of audio data and a provision of video data based on an information about a latency of an audio path and based on an information about a latency of a video path;
- negotiating a decoding latency with an audio playback device, and to adjust the time alignment in dependence on the negotiated decoding latency;
- acquiring a latency span information describing a span of possible latency values from the audio playback device, or acquiring a latency list information describing one or more possible latency values from the audio playback device;
- and
- selecting a desired latency value on the basis of the latency span information or the latency list information such that the desired latency value fits an information about the latency of the video path;
- and
- instructing the audio playback device to use the desired latency value;
- and
- adjusting the time alignment in dependence on the selected desired audio playback latency value.
Dependencies are inferred from the claim text.