AI encoding apparatus and operation method of the same, and AI decoding apparatus and operation method of the same

A server for providing an image by using an artificial intelligence (AI) comprising:

• a memory storing one or more instructions;
• and
• one or more processors configured to execute the stored one or more instructions to:
• select neural network (NN) setting information from a plurality of NN setting information that is pre-stored in the server,
• input an original image to a down-scaling NN comprising a plurality of layers comprising a first layer and a second layer, the first layer comprising a first filter kernel and a second filter kernel, the down-scaling NN being set with the selected NN setting information,
• obtain first result values based on an operation between the original image and the first filter kernel, and obtain second result values based on an operation between the original image and the second filter kernel,
• perform normalization by transforming the first result values into first values by using a first scale factor, and perform normalization by transforming the second result values into second values by using a second scale factor,
• transform the first values into first integer values included in a preset range and transform the second values into second integer values included in the preset range,
• input the first and second integer values to the second layer, and obtain third result values based on the first and second integer values in the second layer,
• obtain a first image by downscaling the original image, based on the third result values,
• encode the first image to obtain image data, and
• provide an electronic device with the image data and AI data related to the AI down-scaling, the AI data being used to select NN setting information from a plurality of NN setting information that is pre-stored in the electronic device,
• wherein the first scale factor and the second scale factor are set in association with scale factors of an up-scaling NN that is configured to upscale the first image.

An operation method of an electronic device for displaying an image by using an artificial intelligence (AI), the operation method comprising:

• obtaining AI data related to AI down-scaling an original image to a first image, the AI data comprising information related to the first image;
• obtaining image data corresponding to an encoding result of the first image;
• obtaining a second image by decoding the obtained image data;
• selecting neural network (NN) setting information from a plurality of NN setting information that is pre-stored in the electronic device, the NN setting information corresponding to at least a portion of the obtained AI data, and the NN setting information being for performing AI up-scaling on the obtained second image;
• inputting the second image to an up-scaling NN comprising a plurality of layers comprising a first layer and a second layer, the first layer comprising a first filter kernel and a second filter kernel, the up-scaling NN being set with the selected NN setting information;
• obtaining first result values based on an operation between the second image and the first filter kernel, and obtaining second result values based on an operation between the second image and the second filter kernel;
• performing normalization by transforming the first result values into first values by using a first scale factor, and performing normalization by transforming the second result values into second values by using a second scale factor;
• transforming the first values into first integer values included in a preset range and transforming the second values into second integer values included in the preset range;
• inputting the first and second integer values to the second layer, and obtaining third result values based on the first and second integer values in the second layer;
• obtaining a third image by upscaling the second image, based on the third result values;
• and
• providing, on the display of the electronic device, the obtained third image,
• wherein the first scale factor and the second scale factor are set in association with scale factors of a down-scaling NN.

An operation method of a server for providing an image by using an artificial intelligence (AI), the operation method comprising:

• selecting neural network (NN) setting information from a plurality of NN setting information that is pre-stored in the server;
• inputting an original image to a down-scaling NN comprising a plurality of layers comprising a first layer and a second layer, the first layer comprising a first filter kernel and a second filter kernel, the down-scaling NN being set with the selected NN setting information;
• obtaining first result values based on an operation between the original image and the first filter kernel and obtaining second result values based on an operation between the original image and the second filter kernel;
• performing normalization by transforming the first result values into first values by using a first scale factor, and performing normalization by transforming the second result values into second values by using a second scale factor;
• transforming the first values into first integer values included in a preset range and transforming the second values into second integer values included in the preset range;
• inputting the first and second integer values to the second layer, and obtaining third result values based on the first and second integer values in the second layer;
• obtaining a first image by downscaling the original image, based on the third result values;
• encoding the first image to obtain image data;
• and
• providing an electronic device with the image data and AI data related to the AI down- scaling, the AI data being used to select NN setting information from a plurality of NN setting information that is pre-stored in the electronic device,
• wherein the first scale factor and the second scale factor are set in association with scale factors of an up-scaling NN that is configured to upscale the first image.