Television program transmission, storage and recovery with audio and video synchronization

In a system for providing an entertainment program of a determinable length of time which is stored, said entertainment program comprising audio and video portions each of which is of substantially the same length of time as said program, said audio and video portions being synchronized with each other and then stored in compressed digital form with corresponding time flags, a method for providing properly timed audio and video portions of said program for presentation to a viewer, said method including the following steps:

• a) receiving a version of said program via transmission or physical storage medium and providing in decompressed digital sample form a digital audio signal and a digital video signal, each said digital audio and digital video signal being substantially the same length as the other;
• b) recovering said time flags and changing the length of one of said digital audio signal or said digital video signal to reduce any synchronization error between them;
• c) wherein, when said changing in step b) operates by shortening the length of said digital audio signal, one or more of the digital samples included therein are deleted and when said changing operates by increasing said length, digital samples are added thereto wherein in step c), when samples are added to or deleted from said digital audio signal they are chosen in a manner such that audible frequency components of the audible version of the resulting digital audio signal are maintained at the same pitch they originally had.

A method of providing a television like entertainment program comprising audio and video, wherein audio and video digital data is received with corresponding time flags, and wherein said method provides for the storage and recall of said audio and video portions in compressed form with properly time aligned presentation of uncompressed audio and video to a viewer, said system including the steps of:

• a) storing when received, said digital data making up portions of said compressed audio and said compressed video,
• b) retrieving stored, compressed audio data from said storage a), recovering audio time flags, converting said compressed audio data to an uncompressed audio signal and outputting said uncompressed audio signal,
• c) retrieving stored, compressed video data from said storage a), recovering video time flags, converting said compressed video data to an uncompressed video signal and outputting said uncompressed video signal,
• d) comparing the relative timing of said recovered audio and video time flags of steps b) and c) and outputting a timing signal indicating the relative timing of said uncompressed audio signal and said uncompressed video signal,
• e) modifying said uncompressed audio signal from circuit b) in response to said timing signal of d) by changing the alpha length thereof to reduce any relative timing error between said uncompressed audio signal and said uncompressed video signal,
• f) wherein when said changing in step e) operates to shorten the alpha length of said uncompressed audio signal one or more of the digital samples included therein are deleted and when said changing increases the alpha length of said uncompressed audio signal, digital samples are added thereto wherein said modifying step e) includes pitch correction operative to maintain the same pitch of said uncompressed audio signal whenever the alpha length thereof is changed as compared to before the alpha length is changed.

A method of providing a stored television program for presentation to a viewer with proper lip sync, said method including the steps:

• a) receiving the video portion of said television program and storing said video portion in compressed form in a memory comprising one or more of a magnetic disk, computer disk drive, optical disk or semiconductor memory,
• b) generating a video time flag in response to said received video portion of a) and storing said video time flag with said compressed form video portion in said memory as part of step a),
• c) receiving an audio portion of said television program and storing said audio portion in compressed form in said memory,
• d) generating an audio time flag in response to said received audio portion of b) and storing said audio time flag with said compressed form audio portion in said memory as part of step c),
• e) recovering said stored video portion from said memory and decompressing it,
• f) recovering said stored audio portion from said memory and decompressing it,
• g) recovering said video time flag from said stored video portion,
• h) recovering said audio time flag from said stored audio portion,
• i) comparing the relative timing of said recovered audio and video time flags of g) and h) to indicate when decompressed audio of step f) leads or lags decompressed video of step e),
• j) when said decompressed audio lags said decompressed video, decreasing the alpha length of said decompressed audio and when said decompressed audio leads said decompressed video, increasing the alpha length of said decompressed audio wherein said step j) includes pitch correction operative to maintain the same pitch of said uncompressed audio signal whenever the alpha length thereof is changed as compared to before the alpha length is changed.

A method of providing to a viewer with proper lip sync, a television program which is stored with compressed audio and video portions, each including a time flag, said method including the steps of:

• a) recovering said stored video portion from storage and decompressing it,
• b) recovering said stored audio portion from storage and decompressing it,
• c) recovering a video time flag from said stored video portion,
• d) recovering a audio time flag from said stored audio portion,
• e) delaying said audio to provide delayed audio,
• f) in response to said recovered time flags of c) and d) indicating whether said delayed audio of step e) leads or lags decompressed video of step a),
• g) decreasing the delay of e) when said delayed audio lags said decompressed video and increasing the delay of said delayed audio and when said delayed audio leads said decompressed video wherein a plurality of audio channels are stored and in step e) each of said plurality of audio channels is delayed, with any increase or decrease in said delay taking place such that the relative timing therebetween is maintained.