Realtime photo retouching of live video

An apparatus, comprising:

• a processor;
• a computer-readable storage medium coupled to the processor;
• and
• logic, stored on the computer-readable storage medium and executed on the processor, for:
• processing as subset of a plurality of video frames to produce a 3D model of a particular clement within each frame of the subset;
• processing the plurality of video frames to identify a particular feature within the particular element in each frame of the plurality of frames in which the particular feature appears to produce a plurality of instances of the element, each instance of the plurality of instances associated with a corresponding frame of the plurality of frames;
• modifying each instance of the plurality of instances in accordance with user-defined parameters and in conformity with the 3D model to generate a plurality of modified instances;
• and
• replacing each instance of the plurality of instances with a corresponding modified instance in the corresponding frame of the plurality of frames to produce a modified video file,

A computer programming, product, comprising:

• a computer-readable storage medium;
• and
• logic, stored on the computer-readable storage medium for execution a processor, for:
• processing a subset of a plurality of video frames to produce a 3D model of a particular element within each frame of the subset;
• processing the plurality of video frames to identify a particular feature within the particular element in each frame of the plurality of frames in which the particular feature appears to produce a plurality of instances of the element, each instance of the plurality of instances associated with a corresponding frame of the plurality of frames;
• modifying each instance of the plurality of instances in accordance with user-defined parameters and in conformity with the 3D model to generate a plurality of modified instances;
• and
• replacing each instance of the plurality of instances with a corresponding modified instance in the corresponding frame of the plurality of frames to produce a modified video file.

A video camera, comprising;

• a processor;
• a computer-readable storage medium coupled to the processor;
• and
• logic, stored on the computer-readable storage medium and executed on the processor, for:
• processing a subset of a plurality of video frames to produce a 3D model of a particular element within each frame of the subset;
• processing the plurality of video frames to identify a particular feature within the particular element in each frame of the plurality of frames in which the particular feature appears to produce a plurality of instances of the element, each instance of the plurality of instances associated with a corresponding frame of the plurality of frames;
• modifying each instance of the plurality of instances in accordance with user-defined parameters and in conformity, with the 3D model to generate a plurality of modified instances;
• and
• replacing each instance of the plurality of instances with a corresponding modified instance in the corresponding frame of the plurality of frames to produce a modified video file.