Network-based assistance for receiver processing of video data

A processor system configured for processing video data which is received as a video stream via a network, wherein the processing video data comprises compositing an object into the video data, the processor system comprising:

• a network interface to the network;
• a processor configured to:
• via the network interface, receive the video stream from an intermediary system;
• via the network interface, receive object data from the intermediary system, the object data defining at least part of the object;
• sequentially decode the video stream to obtain a series of decoded video data parts;
• via the network interface, receive a processing assist data stream comprising a series of processing assist data comprising an analysis result of an analysis of the individual ones of the decoded video data parts of the video data, the analysis result including a characteristic of a composition of the object into the video data, such as a position and/or orientation of the object, or a processing instruction derived from the analysis result, wherein the processor system has started decoding of a video data part before the processing assist data of the video data part is provided to the processor system from the intermediary system;
• and
• sequentially process the decoded video data parts to obtain processed video data comprising the compositing of the object into the video data using the analysis result or the processing instruction provided by the processing assist data.

A system comprising an intermediary system and a receiver system, wherein:

• the intermediary system is configured for assisting the receiver system in processing video data which is streamed as a video stream to the receiver system via a network, wherein the processing of the video data by the receiver system is dependent on an analysis of the video data and comprises compositing an object into the video data, the intermediary system comprising:
• a network interface to the network;
• a processor configured to:
• via the network interface, receive the video stream from a stream source in the network;
• via the network interface, forward the video stream to the receiver system;
• via the network interface, provide object data to the receiver system, the object data defining at least part of the object;
• sequentially decode the video stream to obtain a series of decoded video data parts;
• sequentially analyze the decoded video data parts to obtain an analysis result including a characteristic of a composition of the object into the video data, such as a position and/or orientation of the object;
• sequentially generate processing assist data for the individual ones of the decoded video data parts to obtain a series of processing assist data comprising the analysis result or a processing instruction derived from the analysis result;
• via the network interface, provide the series of processing assist data as a processing assist data stream to the receiver system, wherein the intermediary system provides the processing assist data for a video data part to the receiver system after the receiver system has started decoding the video data part;
• the receiver system is configured for processing video data which is received as a video stream via a network, the receiver system comprising:
• a network interface to the network;
• a processor configured to:
• via the network interface, receive the video stream from the intermediary system;
• via the network interface, receive the object data from the receiver system;
• sequentially decode the video stream to obtain a series of decoded video data parts;
• via the network interface, receive the processing assist data stream comprising the series of processing assist data of the individual ones of the decoded video data parts from the intermediary system, and wherein the processing assist data of a decoded video data part is received from the intermediary system at least partially in parallel to decoding said part of the video data;
• sequentially process the decoded video data parts to obtain processed video data comprising the compositing of the object into the video data using the analysis result or the processing instruction provided by the processing assist data.

A computer-implemented method for assisting a receiver system in processing video data which is streamed as a video stream to the receiver system via a network, wherein the processing is dependent on an analysis of the video data and comprises compositing an object into the video data, the method comprising:

• via the network, receiving the video stream;
• via the network, forwarding the video stream to the receiver system;
• via the network, providing object data to the receiver system, the object data defining at least part of the object;
• sequentially decoding the video stream to obtain a series of decoded video data parts;
• sequentially analyzing the decoded video data parts to obtain an analysis result including a characteristic of a composition of the object into the video data, such as a position and/or orientation of the object;
• sequentially generating processing assist data for the individual ones of the decoded video data parts to obtain a series of processing assist data comprising the analysis result or a processing instruction derived from the analysis results;
• via the network, providing the series of processing assist data as a processing assist data stream to the receiver system to enable the receiver system to process the video data as decoded by the receiver system using the analysis result or the processing instruction provided by the processing assist data, wherein the providing the processing assist data for a video data part to the receiver system is performed after the receiver system has started decoding the video data part.

A computer-implemented method for processing video data which is received as a video stream via a network, wherein the processing video data comprises compositing an object into the video data, the method comprising:

• via the network, receiving the video stream from an intermediary system;
• via the network, receive object data from the intermediary system, the object data defining at least part of the object;
• sequentially decoding the video stream to obtain a series of decoded video data parts;
• receiving a processing assist data stream comprising a series of processing assist data from the intermediary system, the processing assist data comprising an analysis result of the analysis of the individual ones of the decoded video data parts of the video data, the analysis result including a characteristic of a composition of the object into the video data, such as a position and/or orientation of the object, or a processing instruction derived from the analysis result, wherein the decoding of a video data part has started before processing assist data of the video data part is provided from the intermediary system;
• and
• sequentially processing the decoded video data parts comprising the compositing of the object into the video data using the analysis result or the processing instruction provided by the processing assist data.

A processor system configured for assisting a receiver system in processing video data which is streamed as a video stream to the receiver system via a network, wherein the processing of the video data by the receiver system is dependent on an analysis of the video data, the processor system comprising:

• a network interface to the network;
• a processor configured to:
• via the network interface, receive the video stream;
• via the network interface, forward the video stream to the receiver system;
• sequentially decode the video stream to obtain a series of decoded video data parts;
• sequentially analyze the decoded video data parts;
• sequentially generate processing assist data for the individual ones of the decoded video data parts to obtain a series of processing assist data comprising the analysis result or a processing instruction derived from the analysis result, wherein the processor is configured to include timing information in the processing assist data, the timing information being indicative of the part of the video stream or the decoded video data part from which the processing assist data was generated;
• via the network interface, provide the series of processing assist data to the receiver system as a processing assist data stream to enable the receiver system to process the video data as decoded by the receiver system using the analysis result or the processing instruction provided by the processing assist data, wherein the processor system provides the processing assist data for a video data part to the receiver system after the receiver system has started decoding the video data part.

A processor system configured for processing video data which is received as a video stream via a network, the processor system comprising:

• a network interface to the network;
• a processor configured to:
• via the network interface, receive the video stream from an intermediary system;
• sequentially decode the video stream to obtain a series of decoded video data parts;
• via the network interface, receive a processing assist data stream comprising a series of processing assist data comprising an analysis result of an analysis of the individual ones of the decoded video data parts of the video data, or a processing instruction derived from the analysis result, wherein the processing assist data includes timing information being indicative of the part of the video stream or the decoded video data part from which the processing assist data was generated, wherein the processor system has started decoding of a video data part before the processing assist data of the video data part is provided to the processor system from the intermediary system;
• and
• sequentially process the decoded video data parts to obtain processed video data using the analysis result or the processing instruction provided by the processing assist data, wherein the processor is configured to identify the part of the video stream or the decoded video data part on the basis of the timing information and to use the analysis result or the processing instruction provided by the processing assist data specifically for the processing of said part.

A system comprising an intermediary system and a receiver system, wherein:

• the intermediary system is configured for assisting the receiver system in processing video data which is streamed as a video stream to the receiver system via a network, and the processing is dependent on an analysis of the video data, the intermediary system comprising:
• a network interface to the network;
• a processor configured to:
• via the network interface, receive the video stream from a stream source in the network;
• via the network interface, forward the video stream to the receiver system;
• sequentially decode the video stream to obtain a series of decoded video data parts;
• sequentially analyze the decoded video data parts to obtain an analysis result;
• sequentially generate processing assist data for the individual ones of the decoded video data parts to obtain a series of processing assist data comprising the analysis result or a processing instruction derived from the analysis result, wherein the processor is configured to include timing information in the processing assist data, the timing information being indicative of the part of the video stream or the decoded video data part from which the processing assist data was generated;
• via the network interface, provide the series of processing assist data as a processing assist data stream to the receiver system, wherein the intermediary system provides the processing assist data for a video data part to the receiver system after the receiver system has started decoding the video data part;
• the receiver system is configured for processing video data which is received as a video stream via a network, the receiver system comprising:
• a network interface to the network;
• a processor configured to:
• via the network interface, receive the video stream from the intermediary system;
• sequentially decode the video stream to obtain a series of decoded video data parts;
• via the network interface, receive the processing assist data stream comprising the series of processing assist data of the individual ones of the decoded video data parts from the intermediary system, wherein the processing assist data includes the timing information, and wherein the processing assist data of a decoded video data part is received from the intermediary system at least partially in parallel to decoding said part of the video data;
• sequentially process the decoded video data parts to obtain processed video data using the analysis result or the processing instruction provided by the processing assist data, wherein the processor is configured to identify the part of the video stream or the decoded video data part on the basis of the timing information and to use the analysis result or the processing instruction provided by the processing assist data specifically for the processing of said part.

A computer-implemented method for assisting a receiver system in processing video data which is streamed as a video stream to the receiver system via a network, wherein the processing is dependent on an analysis of the video data, the method comprising:

• via the network, receiving the video stream;
• via the network, forwarding the video stream to the receiver system;
• sequentially decoding the video stream to obtain a series of decoded video data parts;
• sequentially analyzing the decoded video data parts to obtain an analysis result;
• sequentially generating processing assist data for the individual ones of the decoded video data parts to obtain a series of processing assist data comprising the analysis result or a processing instruction derived from the analysis results, wherein the processor is configured to include timing information in the processing assist data, the timing information being indicative of the part of the video stream or the decoded video data part from which the processing assist data was generated;
• via the network, providing the series of processing assist data as a processing assist data stream to the receiver system to enable the receiver system to process the video data as decoded by the receiver system using the analysis result or the processing instruction provided by the processing assist data, wherein the providing the processing assist data for a video data part to the receiver system is performed after the receiver system has started decoding the video data part.

A computer-implemented method for processing video data which is received as a video stream via a network, the method comprising:

• via the network, receiving the video stream from an intermediary system;
• sequentially decoding the video stream to obtain a series of decoded video data parts;
• receiving a processing assist data stream comprising a series of processing assist data from the intermediary system, the processing assist data comprising an analysis result of the analysis of the individual ones of the decoded video data parts of the video data, or a processing instruction derived from the analysis result, wherein the processing assist data includes timing information being indicative of the part of the video stream or the decoded video data part from which the processing assist data was generated, wherein the decoding of a video data part has started before processing assist data of the video data part is provided from the intermediary system;
• and
• sequentially processing the decoded video data parts using the analysis result or the processing instruction provided by the processing assist data, wherein the processor is configured to identify the part of the video stream or the decoded video data part on the basis of the timing information and to use the analysis result or the processing instruction provided by the processing assist data specifically for the processing of said part.