Automated video capture and composition system

An electronic eyewear device for producing a video composition, comprising:

• a camera;
• an inertial measurement unit;
• a memory;
• a processor coupled to the memory, the camera, and the inertial measurement unit;
• and
• programming in the memory, wherein execution of the programming by the processor configures the electronic eyewear device to perform functions, including functions to:
• capture frames of raw video with a camera coupled to a wearable device in motion along a series of positions relative to a physical environment;
• collect motion data with an inertial measurement unit coupled to the wearable device;
• compute a stabilized output path based on the collected motion data, such that the stabilized output path approximates the series of positions, wherein the function to compute the stabilized comprises functions to:
• (a) estimate a camera orientation associated with one or more of the captured frames of raw video, and (b) establish one or more waypoints along the stabilized output path based on the camera orientations;
• and
• produce a video composition based on the stabilized output path, wherein the function to produce the video composition comprises adjusting the one or more frames of raw video relative to the waypoints, such that at least a portion of the video composition appears stable relative to a reference plane.

A non-transitory computer-readable medium storing program code that, when executed, is operative to cause a processor of an electronic eyewear device to perform the steps of:

• capturing frames of raw video with a camera coupled to a wearable device in motion along a series of positions relative to a physical environment;
• collecting motion data with an inertial measurement unit coupled to the wearable device;
• computing a stabilized output path based on the collected motion data, such that the stabilized output path approximates the series of positions, wherein the step of computing the stabilized output path comprises the steps of:
• (a) estimating a camera orientation associated with one or more of the captured frames of raw video,
• (b) establishing one or more waypoints along the stabilized output path based on the camera orientations,
• (c) identifying a reference plane in the one or more captured frames of raw video,
• (d) calculating a distance between the camera orientations and the waypoints, and
• (e) mathematically adjusting one or more captured frames of raw video relative to the reference plane based on the calculated distance;
• and
• producing a video composition based on the stabilized output path, wherein producing the video composition comprises mathematically adjusting the one or more frames of raw video relative to the waypoints, such that at least a portion of the video composition appears stable relative to the reference plane.