Photorealistic image stylization using a neural network model

A system, comprising a processor configured to implement a photo style transfer neural network model comprising an encoder portion and a decoder portion configured to:

• process a photorealistic content image by a sequence of processing layers within the encoder portion to extract content features from the photorealistic content image, wherein each processing layer includes a max pooling layer that generates location data identifying a location of a maximum value of the content features output by the processing layer;
• process an output of the encoder portion based on style features extracted from a photorealistic style image to produce a transformed feature map;
• and
• processing the transformed feature map by a sequence of decoder processing layers within the decoder portion to produce a stylized photorealistic image including content from the photorealistic content image that is modified according to the photorealistic style image, wherein an unpooling layer within each decoder processing layer uses the location data generated by a corresponding one of the max pooling layers to process the transformed feature map.

A non-transitory, computer-readable storage medium storing instructions that, when executed by a processing unit, cause the processing unit to:

• process a photorealistic content image by a sequence of processing layers within an encoder portion of a photo style transfer neural network model to extract content features from the photorealistic content image, wherein each processing layer includes a max pooling layer that generates location data identifying a location of a maximum value of the content features output by the processing layer;
• process an output of the encoder portion based on style features extracted from a photorealistic style image to produce a transformed feature map;
• and
• processing the transformed feature map by a sequence of decoder processing layers within the decoder portion of the photo style transfer neural network model to produce a stylized photorealistic image including content from the photorealistic content image that is modified according to the photorealistic style image, wherein an unpooling layer within each decoder processing layer uses the location data generated by a corresponding one of the max pooling layers to process the transformed feature map.