Deep convolutional image up-sampling
AssigneeHERE Global B.V.
InventorsAnirudh Viswanathan, Peter Christian
Life of this patent
Estimating the term…
Abstract
An image and/or temporal sequence of images is received. The image and/or sequence of images was captured by an image capturing device of a vehicle apparatus onboard a vehicle and was down-sampled thereby. A scale of the image(s) is determined. An up-sampling network receives the image(s) and the scale. The up-sampling network determines appropriate network weights based on the scale. Based on the appropriate network weights, the up-sampling network generates a higher resolution image having a pre-defined scale.
Claims21
An apparatus in communication with a Cloud-based computing environment, the apparatus comprising:
- a communications interface for communicating with the Cloud-based computing environment;
- a graphical processing unit configured to operate an up-sampling network;
- and
- a processing unit configured to:
- receive an image (a) captured by an image capturing device of a vehicle apparatus onboard a vehicle and (b) down-sampled by the vehicle apparatus;
- determine a scale of the image;
- cause the up-sampling network to receive the image and the scale of the image;
- cause the up-sampling network to determine appropriate network weights based on the scale of the image;
- and
- cause the up-sampling network to generate a higher resolution image having a pre-defined scale based on the image and the appropriate network weights.
A method comprising:
- receiving an image (a) captured by an image capturing device of a vehicle apparatus onboard a vehicle and (b) down-sampled by the vehicle apparatus;
- determining a scale of the image;
- receiving, by an up-sampling network, the image and the scale of the image;
- determining, by the up-sampling network, appropriate network weights based on the scale of the image;
- and
- generating, by the up-sampling network, a higher resolution image having a pre-defined scale based on the image and the appropriate network weights.
An apparatus comprising at least one processor, at least one memory storing computer program code, and an up-sampling network, the at least one memory and the computer program code configured to, with the processor, cause the apparatus to at least:
- receive an image (a) captured by an image capturing device of a vehicle apparatus onboard a vehicle and (b) down-sampled by the vehicle apparatus;
- determine a scale of the image;
- receive, by the up-sampling network, the image and the scale of the image;
- determine, by the up-sampling network, appropriate network weights based on the scale of the image;
- and
- generate, by the up-sampling network, a higher resolution image having a pre-defined scale based on the image and the appropriate network weights.
A computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions comprising program code instructions configured to:
- receive an image (a) captured by an image capturing device of a vehicle apparatus onboard a vehicle and (b) down-sampled by the vehicle apparatus;
- determine a scale of the image;
- receive, by the up-sampling network, the image and the scale of the image;
- determine, by the up-sampling network, appropriate network weights based on the scale of the image;
- and
- generate, by the up-sampling network, a higher resolution image having a pre-defined scale based on the image and the appropriate network weights.
Dependencies are inferred from the claim text.