Processing images using neural style transfer network

A system comprising at least one server configured to:

• obtain a plurality of input images captured by a plurality of input cameras comprising at least a first input camera per eye and a second input camera per eye, wherein a first field of view of the first input camera is narrower than a second field of view of the second input camera and is overlapping with an overlapping portion of the second field of view, the plurality of input images comprising at least a first input image and a second input image captured by the first input camera and the second input camera, respectively;
• and
• process the plurality of input images, by using at least one neural style transfer network, to generate a single output image per eye;
• wherein when processing the plurality of input images, the at least one server is configured to use the at least one neural style transfer network to combine at least the first input image and the second input image, whilst blending a transition region of the first input image with a transition region of the second input image, wherein an outer boundary of the transition region of the first input image and an outer boundary of the transition region of the second input image represent a boundary between the overlapping portion of the second field of view and a non-overlapping portion of the second field of view.

A system comprising at least one server configured to:

• obtain a plurality of input images captured by a plurality of input cameras comprising at least a first input camera per eye and a second input camera per eye, wherein a first field of view of the first input camera is narrower than a second field of view of the second input camera and is overlapping with an overlapping portion of the second field of view, the plurality of input images comprising at least a first input image and a second input image captured by the first input camera and the second input camera, respectively;
• and
• process the plurality of input images, by using at least one neural style transfer network, to generate a single output image per eye;
• wherein when processing the plurality of input images, the at least one server is configured to use the at least one neural style transfer network to combine at least the first input image and the second input image, whilst blending the first input image with a corresponding portion of the second input image that pertains to the overlapping portion of the second field of view;
• wherein when processing the plurality of input images, the at least one server is configured to:
• use the at least one neural style transfer network to perform a style transfer on at least the first input image and the second input image to generate a first style-transferred image and a second style-transferred image, respectively;
• and
• use the at least one neural style transfer network to combine the first input image, the second input image, the first style-transferred image and the second style-transferred image, to generate the single output image.

A method comprising:

• obtaining a plurality of input images captured by a plurality of input cameras comprising at least a first input camera per eye and a second input camera per eye, wherein a first field of view of the first input camera is narrower than a second field of view of the second input camera and is overlapping with an overlapping portion of the second field of view, the plurality of input images comprising at least a first input image and a second input image captured by the first input camera and the second input camera, respectively;
• and
• processing the plurality of input images by using at least one neural style transfer network, to generate a single output image per eye;
• wherein the step of processing the plurality of input images comprises:
• identifying respective gaze regions in the first input image and the second input image, based on a given gaze direction;
• detecting when a gaze region of the second input image is in a proximity of a boundary between the overlapping portion of the second field of view and a non-overlapping portion of the second field of view;
• when it is detected that the gaze region is in the proximity of the boundary, identifying respective surrounding regions in the first input image and the second input image that include and surround the respective gaze regions;
• and
• using the at least one neural style transfer network to combine at least the first input image and the second input image, whilst blending the respective surrounding regions of the first input image and the second input image.

A method comprising:

• obtaining a plurality of input images captured by a plurality of input cameras comprising at least a first input camera per eye and a second input camera per eye, wherein a first field of view of the first input camera is narrower than a second field of view of the second input camera and is overlapping with an overlapping portion of the second field of view, the plurality of input images comprising at least a first input image and a second input image captured by the first input camera and the second input camera, respectively;
• and
• processing the plurality of input images by using at least one neural style transfer network, to generate a single output image per eye;
• wherein the step of processing the plurality of input images comprises using the at least one neural style transfer network to combine at least the first input image and the second input image, whilst blending a transition region of the first input image with a transition region of the second input image, wherein an outer boundary of the transition region of the first input image and an outer boundary of the transition region of the second input image represent a boundary between the overlapping portion of the second field of view and a non-overlapping portion of the second field of view.

A method comprising:

• obtaining a plurality of input images captured by a plurality of input cameras comprising at least a first input camera per eye and a second input camera per eye, wherein a first field of view of the first input camera is narrower than a second field of view of the second input camera and is overlapping with an overlapping portion of the second field of view, the plurality of input images comprising at least a first input image and a second input image captured by the first input camera and the second input camera, respectively;
• and
• processing the plurality of input images by using at least one neural style transfer network, to generate a single output image per eye;
• wherein the step of processing the plurality of input images comprises using the at least one neural style transfer network to combine at least the first input image and the second input image, whilst blending the first input image with a corresponding portion of the second input image that pertains to the overlapping portion of the second field of view;
• wherein the step of processing the plurality of input images comprises:
• using the at least one neural style transfer network to perform a style transfer on at least the first input image and the second input image to generate a first style-transferred image and a second style-transferred image, respectively;
• and
• using the at least one neural style transfer network to combine the first input image, the second input image, the first style-transferred image and the second style-transferred image, to generate the single output image.