Display apparatus, image providing apparatus, and methods of controlling the same
AssigneeSamsung Electronics Co., Ltd.
InventorsDoohyun Kim, Minyong Sung, Sangkwon Na, Kiwon Yoo, Sangjo Lee
Life of this patent
Estimating the term…
Abstract
Disclosed are a display apparatus, an image providing apparatus, and methods of controlling the same, the display apparatus including: a display; and a processor configured to: decode an encoded video stream, decompress the video stream through a neural network including a plurality of channels and a plurality of layers with a parameter set based on learning, and perform image compensation determined based on learning about the decompression with respect to the video stream.
Claims18
A display apparatus comprising:
- a display;
- and
- a processor configured to:
- decode an encoded video stream through a decoding module, wherein the decoded video stream comprises a first image,
- decompress the decoded video stream through a neural network, wherein the neural network comprises a plurality of channels and a plurality of layers, the neural network is configured to operate with a parameter set, and the parameter set is identified based on a learning operation about the neural network, wherein an output performance of the neural network with regard to another input image is evaluated based on the learning operation and a configuration of the neural network is changeable based on an evaluation result on the output performance of the neural network to identify a final configuration, and
- perform a function corresponding to an image compensation through at least one of a preprocessing module connected to a front-end of the neural network or a postprocessing module connected to a back-end of the neural network, wherein the image compensation is identified based on a problem of the neural network, the problem of the neural network corresponding to a predetermined image pattern with regard to the neural network with the final configuration changed based on a final evaluation result on the output performance of the neural network, and
- wherein the decoding module, the preprocessing module, the neural network and the postprocessing module are configured to connected serially so that the video stream passes sequentially to output the first image, and the image compensation based on the problem of the neural network is pre-processed by the preprocessing module or post-processed by the postprocessing module.
An image providing apparatus comprising:
- a processor configured to:
- compress an input image through a neural network, wherein the neural network comprises a plurality of channels and a plurality of layers, the neural network is configured to operate with a parameter set, and the parameter set is identified based on a learning operation about the neural network, wherein an output performance of the neural network with regard to another input image is evaluated based on the learning operation and a configuration of the neural network is changeable based on an evaluation result on the output performance of the neural network to identify a final configuration,
- perform a function corresponding to an image compensation through at least one of a preprocessing module connected to a front-end of the neural network or a postprocessing module connected to a back-end of the neural network, wherein the image compensation is identified based on a problem of the neural network, the problem of the neural network corresponding to a predetermined image pattern with regard to the neural network with the final configuration changed based on a final evaluation result on the output performance of the neural network, and
- generate an encoded video stream through an encoding module configured to encode the input image compressed and compensated;
- and
- data interface circuitry configured to output the encoded video stream, and
- wherein the preprocessing module, the neural network, the postprocessing module and the encoding module are configured to connected serially so that the input image passes sequentially to output the encoded video stream, and the image compensation based on the problem of the neural network is pre-processed by the preprocessing module or post-processed by the postprocessing module.
A method of controlling a display apparatus, the method comprising:
- decoding an encoded video stream through a decoding module, wherein the decoded video stream includes a first image;
- decompressing the decoded video stream through a neural network, wherein the neural network comprises a plurality of channels and a plurality of layers, the neural network is configured to operate with a parameter set, and the parameter set is identified based on a learning operation about the neural network, wherein an output performance of the neural network with regard to another input image is evaluated based on the learning operation and a configuration of the neural network is changeable based on an evaluation result on the output performance of the neural network to identify a final configuration;
- and
- performing a function corresponding to an image compensation through at least one of a preprocessing module connected to a front-end of the neural network or a postprocessing module connected to a back-end of the neural network, wherein the image compensation is identified based on a problem of the neural network, the problem of the neural network corresponding to a predetermined image pattern with regard to the neural network with the final configuration changed based on a final evaluation result on the output performance of the neural network, and
- wherein the decoding module, the preprocessing module, the neural network and the postprocessing module are configured to connected serially so that the video stream passes sequentially to output the first image, and the image compensation based on the problem of the neural network is pre-processed by the preprocessing module or post-processed by the postprocessing module.
A method of controlling an image providing apparatus, the method comprising:
- compressing an input image through a neural network, wherein the neural network comprises a plurality of channels and a plurality of layers, the neural network is configured to operate with a plurality of parameters, and the plurality of parameters are identified based on a learning operation about the neural network, wherein an output performance of the neural network with regard to another input image is evaluated based on the learning operation and a configuration of the neural network is changeable based on an evaluation result on the output performance of the neural network to identify a final configuration;
- performing a function corresponding to an image compensation through at least one of a preprocessing module connected to a front-end of the neural network or a postprocessing module connected to a back-end of the neural network, wherein the image compensation is identified based on a problem of the neural network, the problem of the neural network corresponding to a predetermined image pattern with regard to the neural network with the final configuration changed based on a final evaluation result on the output performance of the neural network;
- generating an encoded video stream through an encoding module configured to encode the input image compressed and compensated;
- and
- outputting the encoded video stream, and
- wherein the preprocessing module, the neural network, the postprocessing module and the encoding module are configured to connected serially so that the input image passes sequentially to output the encoded video stream, and the image compensation based on the problem of the neural network is pre-processed by the preprocessing module or post-processed by the postprocessing module.
Dependencies are inferred from the claim text.