Method, apparatus, and computer program for completing painting of image, and method, apparatus, and computer program for training artificial neural network
AssigneeNaver Webtoon Ltd.
InventorsSungmin Kang, Jaehyuk Chang
Life of this patent
Estimating the term…
Abstract
A method of completing coloring of an image based on a query regarding a color-unknown region in the image and an answer to the query, includes: generating, by using an artificial neural network, a first intermediate image in which at least one uncolored region in a primary image is colored; generating, by using the artificial neural network, a first color query regarding the at least one color-unknown region in the primary image; and generating a secondary image based on at least one of the first color query, a first answer to the first color query, and the first intermediate image.
Claims11
A method of completing coloring of an image based on a query regarding a color-unknown region in the image and an answer to the query, the method comprising:
- generating, by using an artificial neural network, a first intermediate image in which at least one uncolored region in a primary image is colored;
- generating, by using the artificial neural network, a first color query regarding the at least one color-unknown region in the primary image;
- and
- generating a secondary image based on at least one of the first color query, a first answer to the first color query, and the first intermediate image,
- wherein the artificial neural network is a neural network that further learned a corresponding relationship between an input image in which a first region is not colored, a third color query regarding a colored second region of the input image, a third answer to the third color query, an output image in which the first region is colored, and a fourth color query regarding the output image, and
- wherein the second region is a region colored according to the third color query of the input image and the third answer.
A non-transitory computer-readable recording medium storing a computer program that, when executed by a computer, causes the computer to perform a method comprising:
- generating, by using an artificial neural network, a first intermediate image in which at least one uncolored region in a primary image is colored;
- generating, by using the artificial neural network, a first color query regarding the at least one color-unknown region in the primary image;
- and
- generating a secondary image based on at least one of the first color query, a first answer to the first color query, and the first intermediate image,
- wherein the artificial neural network is a neural network that further learned a corresponding relationship between an input image in which a first region is not colored, a third color query regarding a colored second region of the input image, a third answer to the third color query, an output image in which the first region is colored, and a fourth color query regarding the output image, and
- wherein the second region is a region colored according to the third color query of the input image and the third answer.
An apparatus for completing coloring of an image based on a query regarding a color-unknown region in the image and an answer to the query, the apparatus comprising a processor configured to:
- generate, by using an artificial neural network, a first intermediate image in which at least one uncolored region in a primary image is colored;
- generate, by using the artificial neural network, a first color query regarding the at least one color-unknown region in the primary image;
- and
- generate a secondary image based on at least one of the first color query, a first answer to the first color query, and the first intermediate image,
- wherein the artificial neural network is a neural network that further learned a corresponding relationship between an input image in which a first region is not colored, a third color query regarding a colored second region of the input image, a third answer to the third color query, an output image in which the first region is colored, and a fourth color query regarding the output image, and
- wherein the second region is a region colored according to the third color query of the input image and the third answer.
Dependencies are inferred from the claim text.