Video system with object replacement and insertion features

A computing system configured for performing a set of acts comprising:

• obtaining video that depicts an object across multiple frames of the video;
• detecting the object within the obtained video and determining object characteristic data associated with the detected object;
• determining user profile data associated with a viewer of the video;
• determining scene attribute data associated with the obtained video;
• using at least the determined object characteristic data, the determined user profile data, and the determined scene attribute data as a basis to select a replacement object from among a set of multiple candidate replacement objects;
• replacing the detected object with the selected replacement object to generate video that is a modified version of the obtained video, wherein replacing the detected object with the selected replacement object to generate video that is a modified version of the obtained video comprises applying a lighting normalization technique to blend the selected replacement object into the video, wherein applying the lighting normalization technique to blend the selected replacement object into the video comprises determining a shape of a shadow of the selected replacement object, determining a shape of a shadow of the detected object, and using the determined shape of the shadow of the selected replacement object and the determined shape of the shadow of the detected object as a basis to modify a shadow of the detected object, wherein the detected object and the selected replacement object differ in at least one object characteristic other than scale, and wherein the shadow of the detected object and the shadow of the selected replacement object differ in at least one characteristic other than scale;
• and
• outputting for presentation the generated video.

A non-transitory computer-readable medium having stored thereon program instructions that upon execution by a computing system, cause performance of a set of acts comprising:

• obtaining video that depicts an object across multiple frames of the video;
• detecting the object within the obtained video and determining object characteristic data associated with the detected object;
• determining user profile data associated with a viewer of the video;
• determining scene attribute data associated with the obtained video;
• using at least the determined object characteristic data, the determined user profile data, and the determined scene attribute data as a basis to select a replacement object from among a set of multiple candidate replacement objects;
• replacing the detected object with the selected replacement object to generate video that is a modified version of the obtained video, wherein replacing the detected object with the selected replacement object to generate video that is a modified version of the obtained video comprises applying a lighting normalization technique to blend the selected replacement object into the video, wherein applying the lighting normalization technique to blend the selected replacement object into the video comprises determining a shape of a shadow of the selected replacement object, determining a shape of a shadow of the detected object, and using the determined shape of the shadow of the selected replacement object and the determined shape of the shadow of the detected object as a basis to modify a shadow of the detected object, wherein the detected object and the selected replacement object differ in at least one object characteristic other than scale, and wherein the shadow of the detected object and the shadow of the selected replacement object differ in at least one characteristic other than scale;
• and
• outputting for presentation the generated video.