Systems and methods for synthetic augmentation of cameras using neural networks
AssigneeAugmented Reality Media Corp., Inc.
InventorSravan Puttagunta
Life of this patent
Estimating the term…
Abstract
A method of augmenting camera devices with neural networks to control framerate, time synchronization, image stitching and resolution, the method comprising: creating synthetic camera frames by using neural networks to interpolate between actual frame captures; utilizing frame interpolation to align camera images when the frames are misaligned in time, with additional hardware; retroactively processing recorded sensor data to achieve time synchronization from multiple camera sensors; stitching temporally misaligned camera recordings together to create spherical or panoramic images with vision pipelines augmented by neural networks; and enhance images by utilizing neural networks to adjust optimize resolution.
Claims4
A method of augmenting camera devices with neural networks to control framerate, time synchronization, image stitching and resolution, the method comprising:
- creating synthetic camera frames by using neural networks to interpolate between actual frame captures;
- utilizing frame interpolation to align camera images when the frames are misaligned in time, with additional hardware;
- retroactively processing recorded sensor data to achieve time synchronization from multiple camera sensors;
- stitching temporally misaligned camera recordings together to create spherical or panoramic images with vision pipelines augmented by neural networks;
- and
- enhance images by utilizing neural networks to adjust optimize resolution.
A method to transfer image data on bandwidth constrained communication channels, the method comprising:
- downscaling images and transferring the downscaled images over a communication channel using neural networks;
- upscaling using generative networks to restore an original image from a downscaled image;
- utilizing hardware encoders and decoders to process images using neural networks;
- interleaving large images with small images and using neural networks to upscale smaller images to match a resolution of larger images;
- and
- creating a mosaic of images by finding overlapping sections of imagery and sampling pixels from multiple images to achieve a higher resolution using neural networks.
A method of removing personally identifiable information from camera video feed using hardware accelerated neural networks, the method comprising:
- blurring and obfuscating personally identifiable information including faces, gait, and unique signatures;
- blurring and obfuscating vehicular data including license plates, VIN numbers and personnel driving or operating vehicles within camera data;
- and
- before exposing image data to a computing device, ensuring privacy compliance at a sensor level instead of an application layer.
A method of improving or denoising camera data using hardware accelerated neural networks, the method comprising:
- inpainting pixel data using neural networks to remove artifacts including rain, dust, glare, and adverse effects;
- optimizing image quality in low light conditions by using neural networks to optimize contrast and clarity within images;
- and
- inferring sections of the image which are occluded by objects using generative networks.
Dependencies are inferred from the claim text.