Method to record and replay synchronized media streams, commands, and on-screen events transmitted through different internet pathways

A computer-implemented method of resynchronizing commands to a time of a live media stream, the system comprising:

• at a multimedia player executing on a client device of a user:
• loading and buffering an output media stream from a location parsed from a command manifest file;
• starting playback of the output media stream;
• receiving input from the user selecting a new time of the output media stream to playback, the new selected time being different from a current playback time of the output media stream;
• adjusting playback of the output media stream to restart at the new selected time, wherein the adjusting updates the current playback time of the output media stream to the new selected time;
• and
• monitoring the current playback time of the output media stream as adjusted, the monitoring includes determining a user-initiated command to execute at the multimedia player by polling the command manifest file based on the current playback time as adjusted;
• at a streaming media server coupled to the multimedia player:
• receiving an input media stream being generated from input captured and encoded by a media encoder;
• as the input media stream is being received:
• transcoding the input media stream in a streaming format compatible with content delivery, the transcoded media stream being the output media stream, the transcoded media stream being stored in media segments of a target length at the location specified in the command manifest file;
• generating and maintaining a media stream playlist;
• and
• at least one of:
• hosting the output media stream or transmitting the output media stream to a Content Distribution Network (CDN) for delivery to the multimedia player;
• at a publishing client logically independent of the media encoder and streaming media server:
• prompting the user to enter at least one of:
• (i) the location of the output media stream, (ii) a start time at which the media encoder began encoding the input media stream, and (iii) an offset time from the start time;
• enabling the user to initiate commands at particular times, the user-initiated commands being relevant to the input simultaneously captured by the media encoder;
• and
• at a publishing server coupled to the multimedia player:
• receiving from the publishing client at least one of:
• (i) the location of the output media stream, (ii) the start time, (iii) the offset time, and (iv) the user-initiated commands;
• and
• generating and maintain a command manifest file by:
• if the location and start time is received, writing the location and the start time as a first command in the command manifest file, and
• as each user-initiated command is received, appending the user-initiated command to the end of the command manifest file, each user-initiated command being appended to the command manifest file with a publishing server clock time and the offset time.

A computer program product comprising a non-transitory computer-readable medium storing instructions for resynchronizing commands to a selected time of a media stream, the instructions, when loaded and executed by a processor, cause the processor to:

• load and buffer an output media stream from a location parsed from a command manifest file;
• start playback of the output media stream;
• receive input from the user selecting a new time of the output media stream to playback, the new selected time being different from a current playback time of the output media stream;
• adjust playback of the output media stream to restart at the new selected time, wherein the adjusting updates the current playback time of the output media stream to the new selected time;
• and
• monitor the current playback time of the output media stream as adjusted, the monitoring includes determining a user-initiated command to display at the multimedia player by polling the command manifest file based on the current playback time as adjusted;
• further comprising a streaming media server coupled to the multimedia player, the streaming media server configured to:
• receive an input media stream from a media encoder coupled to the streaming media server, the media encoder capturing and encoding input from a source device into the encoded input media steam:
• as the input media stream is being received:
• transcode the input media stream in a streaming format compatible with content delivery, the transcoded media stream being the output media stream, the transcoded media stream being stored in media segments of a target length at the location specified in the command manifest file;
• generate and maintain a media stream playlist;
• and
• at least one of:
• host the output media stream or transmit the output media stream to a Content Distribution Network (CDN) for delivery to the multimedia player;
• a publishing client logically independent of the media encoder and streaming media server, the publishing client coupled to a publishing server, the publishing client configured to:
• prompt the user to enter at least one of:
• (i) the location of the output media stream, (ii) a start time at which the media encoder began encoding the input media stream, and (iii) an offset time from the start time:
• enable the user to initiate commands at particular times, the user-initiated commands being relevant to the input simultaneously captured by the media encoder;
• and
• the publishing server coupled to the multimedia player, the publishing server configured to:
• receive from the publishing client at least one of:
• (i) the location of the output media stream, (ii) the start time, (iii) the offset time, and (iv) the user-initiated commands;
• and
• generate and maintain a command manifest file by:
• if the location and start time is received, write the location and the start time as a first command in the command manifest file, and
• as each user-initiated command is received, append the user-initiated command to the end of the command manifest file, each user-initiated command being appended to the command manifest file with a publishing server clock time and the offset time.