Temporally stable data reconstruction with an external recurrent neural network
AssigneeNVIDIA Corporation
InventorsMarco Salvi, Anjul Patney, Aaron Eliot Lefohn, Donald Lee Brittain
Life of this patent
Estimating the term…
Loading patent…
AssigneeNVIDIA Corporation
InventorsMarco Salvi, Anjul Patney, Aaron Eliot Lefohn, Donald Lee Brittain
Estimating the term…
A method, computer readable medium, and system are disclosed for temporally stable data reconstruction. A sequence of input data including artifacts is received. A first input data frame is processed using layers of a neural network model to produce external state including a reconstructed first data frame that approximates the first input data frame without artifacts. Hidden state generated during processing of the first input data is not provided as an input to the layer to process second input data. The external state is warped, using difference data corresponding to changes between input data frames, to produce warped external state more closely aligned with the second input data frame. The second input data frame is processed, based on the warped external state, using the layers of the neural network model to produce a reconstructed second data frame that approximates the second data frame without artifacts.
1-20. (canceled)
A processor, comprising:
A system, comprising memory to store instructions that, as a result of performance by one or more processors, cause the system to modify one or more neural networks based, at least in part, on motion of one or more pixels between a first frame and a second frame.
A method comprising modifying one or more neural networks based, at least in part, on motion of one or more pixels between a first frame and a second frame.
Dependencies are inferred from the claim text.