Enforcing synchronization by embedding audio within video frame data

A method for enforcing synchronization by embedding audio within video frame data, the method comprising:

• receiving, at a destination computing device, a sequence of access units, each access unit defining a corresponding video frame;
• processing each access unit by examining network abstraction layer (NAL) units of the access unit;
• upon detecting a Supplemental Enhancement Information (SEI) NAL unit in an access unit, extracting a payload of the SEI NAL unit and storing the payload in an audio buffer;
• and
• providing each access unit to a GPU graphics processing unit (GPU).

One or more computer storage media storing computer-executable instructions which when executed implement an encoder that is configured to perform the following:

• receive audio and video data;
• and
• generate an encoded video stream by:
• creating an access unit for each frame defined in the video data;
• and
• for each respective access unit, storing a segment of the audio in a Supplemental Enhancement Information (SEI) network abstraction layer (NAL) unit of the respective access unit.