Neural representation for event-camera data
AssigneeDolby Laboratories Licensing Corporation
InventorsTsung-Wei HUANG, Anustup Kumar CHOUDHURY, Guan-Ming SU
Life of this patent
Estimating the term…
Abstract
Methodology for generating a neural representation of event-camera data. In some examples, a method of representing event-camera data includes converting a set of the event-camera data into a corresponding set of voxel data for a voxel grid in a three-dimensional space in which first and second dimensions correspond to first and second spatial coordinates of an image frame, and a third dimension corresponds to time. The method further includes training a neural network to represent the voxel grid.
Claims15
A method of representing event-camera data, the method comprising:
- converting a set of the event-camera data into a corresponding set of voxel data for a voxel grid in a three-dimensional (3D) space in which first and second dimensions correspond to first and second spatial coordinates of an image frame, and a third dimension corresponds to time;
- and
- training a neural network to represent the voxel grid, wherein the neural network is configured to output a corresponding voxel value in response to a received input specifying a set of coordinate values in the 3D space.
A method of predicting event-camera data, the method comprising:
- inputting one or more coordinate values corresponding to a three-dimensional (3D) space to a neural network trained to represent a voxel grid,
- wherein first and second dimensions of the 3D space correspond to first and second spatial coordinates of an image frame corresponding to the event-camera data, and a third dimension of the 3D space corresponds to time;
- and
- wherein the voxel grid in the 3D space is generated by converting a set of the event-camera data into a corresponding set of voxel data for the 3D space.
Dependencies are inferred from the claim text.