# US 2014/0198177 A1 · Realtime photo retouching of live video > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0198177 A1 - Document ID: US20140198177A1 - Status: Published application - Kind: A1 - Application number: 13/742,242 - Filed: 2013-01-15 - Published: 2014-07-17 - Earliest claimed: 2013-01-15 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Marzia E. Castellani; Roberto Ragusa - Web page: https://patentgrep.com/patent/US20140198177A1 ## CPC - G06T 11/00: Two-dimensional [2D] image generation - G06T 5/77: Retouching; Inpainting; Scratch removal - G06T 2207/10016: Video; Image sequence - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Provided are techniques for processing a subset of a plurality of video frames to produce a 3D model of a particular element within each frame of the subset; processing the plurality of video frames to identify a particular feature within the particular element in each frame of the plurality of frames in which the particular feature appears to produce a plurality of instances of the element, each instance of the plurality of instances associated with a corresponding frame of the plurality of frames; modifying each instance of the plurality of instances in accordance with use parameters and in conformity with the 3D model to generate a plurality of modified instances; and replacing each instance of the plurality of instances with a corresponding modified instance in the corresponding frame of the plurality of frames to produce a modified video file. ## Claims ### Claim 1 A method, comprising: processing a subset of a plurality of video frames to produce a 3D model of a particular element within each frame of the subset; processing the plurality of video frames to identify a particular feature within the particular element in each frame of the plurality of frames in which the particular feature appears to produce a plurality of instances of the element, each instance of the plurality of instances associated with a corresponding frame of the plurality of frames; modifying each instance of the plurality of instances in accordance with user-defined parameters and in conformity with the 3D model to generate a plurality of modified instances; and replacing each instance of the plurality of instances With a corresponding modified instance in the corresponding frame of the plurality of frames to produce a modified video file, ### Claim 2 (depends on 1) The method of claim 1, wherein the processing of the subset of the plurality of video frames to produce a 3D model, comprises: identifying an identifying feature in each frame of the subset of frames; and tracking the identifying feature from frame to frame in the subset of frames to produce a correlation between the corresponding identifying feature in successive frames of the subset of frames. ### Claim 3 (depends on 1) The method of claim 1, where a specific number of frames in the subset is based upon a user-defined parameter. ### Claim 4 (depends on 1) The method of claim 1, wherein the feature. is a human face. ### Claim 5 (depends on 1) The method of claim 1, wherein the feature is an article of clothing. ### Claim 6 (depends on 1) The method of claim 1, further comprising rendering the modified video file on a display. ### Claim 7 An apparatus, comprising: a processor; a computer-readable storage medium coupled to the processor; and logic, stored on the computer-readable storage medium and executed on the processor, for: processing as subset of a plurality of video frames to produce a 3D model of a particular clement within each frame of the subset; processing the plurality of video frames to identify a particular feature within the particular element in each frame of the plurality of frames in which the particular feature appears to produce a plurality of instances of the element, each instance of the plurality of instances associated with a corresponding frame of the plurality of frames; modifying each instance of the plurality of instances in accordance with user-defined parameters and in conformity with the 3D model to generate a plurality of modified instances; and replacing each instance of the plurality of instances with a corresponding modified instance in the corresponding frame of the plurality of frames to produce a modified video file, ### Claim 8 (depends on 7) The apparatus of claim 7, wherein the logic for processing of the subset of the plurality of video frames to produce a 3D model, comprises logic for: identifying an identifying feature in each frame of the subset of frames; and tracking the identifying feature from frame to frame in the subset of frames to produce a correlation. between the corresponding identifying feature in successive frames of the subset of frames. ### Claim 9 (depends on 7) The apparatus of claim 7, where a specific number of frames in the subset is based upon a user-defined parameter. ### Claim 10 (depends on 7) The apparatus of claim 7, wherein the feature is a human thee. ### Claim 11 (depends on 7) The apparatus of claim 7, wherein the feature is an article of clothing. ### Claim 12 (depends on 7) The apparatus of claim 7, the logic further comprising logic for rendering the modified video file on a display. ### Claim 13 A computer programming, product, comprising: a computer-readable storage medium; and logic, stored on the computer-readable storage medium for execution a processor, for: processing a subset of a plurality of video frames to produce a 3D model of a particular element within each frame of the subset; processing the plurality of video frames to identify a particular feature within the particular element in each frame of the plurality of frames in which the particular feature appears to produce a plurality of instances of the element, each instance of the plurality of instances associated with a corresponding frame of the plurality of frames; modifying each instance of the plurality of instances in accordance with user-defined parameters and in conformity with the 3D model to generate a plurality of modified instances; and replacing each instance of the plurality of instances with a corresponding modified instance in the corresponding frame of the plurality of frames to produce a modified video file. ### Claim 14 (depends on 13) The computer programming product of claim 13, wherein the logic for processing of the subset of the plurality of video frames to produce a 3D model, comprises logic for: identifying an identifying feature in each frame of the subset of frames; and tracking the identifying feature from frame to frame in the subset of frames to produce a correlation between file corresponding identifying feature in successive frames of the subset of frames. ### Claim 15 (depends on 13) The computer programming product of claim 13, where a specific number of frames in the subset is based upon a user-defined parameter. ### Claim 16 (depends on 13) The computer programming product of claim 13, wherein the feature is a human face. ### Claim 17 (depends on 13) The computer programming product of claim 13, wherein the feature is an article of clothing. ### Claim 18 The computer programming product of claim. 13, the logic further comprising logic for rendering the modified video file on a display. ### Claim 19 A video camera, comprising; a processor; a computer-readable storage medium coupled to the processor; and logic, stored on the computer-readable storage medium and executed on the processor, for: processing a subset of a plurality of video frames to produce a 3D model of a particular element within each frame of the subset; processing the plurality of video frames to identify a particular feature within the particular element in each frame of the plurality of frames in which the particular feature appears to produce a plurality of instances of the element, each instance of the plurality of instances associated with a corresponding frame of the plurality of frames; modifying each instance of the plurality of instances in accordance with user-defined parameters and in conformity, with the 3D model to generate a plurality of modified instances; and replacing each instance of the plurality of instances with a corresponding modified instance in the corresponding frame of the plurality of frames to produce a modified video file. ### Claim 20 (depends on 19) The video camera of claim 19, wherein the logic for processing of the subset of the plurality of video frames to produce a 3D model, comprises logic for: identifying an identifying feature in each frame of the subset of frames; and tracking the identifying feature from frame to frame in the subset of frames to produce a correlation between the corresponding identifying feature in successive frames of the subset of frames. ### Claim 21 (depends on 19) The video camera of claim 19, where a specific number of frames in the subset is based upon a user-defined parameter. ### Claim 22 (depends on 19) The video camera of claim 19, wherein the feature is a human face. ### Claim 23 (depends on 19) The video camera of claim 19, wherein the feature is an article of clothing. ### Claim 24 (depends on 19) The video camera of claim 19, the logic further comprising logic for rendering the modified video file on a display.