Method and apparatus for synchronizing audio and video signals

An apparatus comprising at least one processor and at least one memory storing computer program code, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to at least:

• determine a trajectory for each of one or more audio objects of an audio signal;
• determine each of the audio objects to be a transient object or a non-transient object;
• and
• cause a respective audio object to be differently extended depending upon whether the audio object is determined to be a transient object or a non-transient object so as to synchronize a video signal that is to be played back in a predefined motion, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to cause the respective audio object to be differently extended by:
• in an instance in which the respective audio object is determined to be a transient object, splitting the transient object into transient segments, inserting silent segments between the transient segments and maintaining the trajectories of the transient object;
• and
• in an instance in which the respective audio object is determined to be a non-transient object, repeating the non-transient object with a trajectory that varies over time in correspondence to the predefined motion of the video signal.

A method comprising:

• separating an audio signal into one or more audio objects;
• determining a trajectory for each of the one or more audio objects;
• separating a video signal into one or more video objects;
• determining a trajectory for each of the one or more video objects;
• associating, with a processor, at least one of the one or more video objects with at least one of the one or more audio objects;
• causing at least one of the video objects that is associated with the at least one audio object to be displayed such that the at least one video object is stationary;
• and
• causing at least one of the audio objects that is associated with the at least one video object that is displayed so as to be stationary to be played back using a trajectory that is at least partially based on the trajectory that was determined for the at least one video object that is displayed so as to be stationary, wherein causing at least one of the audio objects to be played back comprises causing the at least one of the audio objects to be extended at the trajectory while the at least one video object is displayed.