US 2026/0065537 A1Published application

Method and system for stroke-by-stroke creation of visual artworks and images

AssigneeTata Consultancy Services Limited

InventorsJERIPOTHULA PRUDVIRAJ, VIKRAM JAMWAL

Life of this patent

Estimating the term…

Loading patent…

Abstract

Existing sketch generation techniques have disadvantages such as less accuracy over complex sketches, incapable of scaling for complex sketches involving shading and textures, and high computational demands of deep reinforcement learning and lack an inherent sequence order while generating strokes. Embodiments disclosed herein provide a method and system which converts an input image to a sketch, and further obtains an associated sequence of strokes. Further, a sketch sequencing to orchestrate the sequence of strokes is performed, during which a stroke sequence is generated for a constructed sketch of strokes. Based on the generated stroke sequence, the input image is recreated. Further, a paint sequence for the recreated image is generated, wherein by executing the paint sequence, the recreated image is painted to match color of the input image.

Claims12

Dependent claims

A processor implemented method, comprising:

receiving, via one or more hardware processors, an input image;
converting, via the one or more hardware processors, the input image to a sketch of the input image, wherein, for the sketch, an associated sequence of strokes is obtained by feeding the sketch and the input image to a plurality of individual streams;
performing, via the one or more hardware processors, a sketch sequencing to orchestrate the associated sequence of strokes, comprising:
constructing, by processing the associated sequence of strokes and an associated plurality of pixel values, a sketch of strokes for the input image, wherein the sketch of strokes is constructed based on a plurality of vector curves identified in the sketch;
and
generating a stroke sequence for the constructed sketch of strokes, comprising:
organizing a plurality of strokes forming the sketch of strokes to a plurality of stroke clusters, based on proximity of the plurality of strokes;
and
determining, based on proximity of the plurality of stroke clusters, a shortest path to traverse the plurality of stroke clusters, touching each of the plurality of stroke clusters only once, from a stroke cluster identified as a central node, wherein the determined shortest path forms the stroke sequence, and wherein by following the determined stroke sequence, the input image is recreated;
and
generating, via the one or more hardware processors, a paint sequence for the recreated image, wherein by executing the paint sequence, the recreated image is painted to match color of the input image.

8 more elements

A system, comprising:

one or more hardware processors;
a communication interface;
and
a memory storing a plurality of instructions, wherein the plurality of instructions cause the one or more hardware processors to:
receive an input image;
convert the input image to a sketch of the input image, wherein, for the sketch, an associated sequence of strokes is obtained by feeding the sketch and the input image to a plurality of individual streams;
perform a sketch sequencing to orchestrate the associated sequence of strokes, by:
constructing, by processing the associated sequence of strokes and an associated plurality of pixel values, a sketch of strokes for the input image, wherein the sketch of strokes is constructed based on a plurality of vector curves identified in the sketch;
and
generating a stroke sequence for the constructed sketch of strokes, comprising:
organizing a plurality of strokes forming the sketch of strokes to a plurality of stroke clusters, based on proximity of the plurality of strokes;
and
determining, based on proximity of the plurality of stroke clusters, a shortest path to traverse the plurality of stroke clusters, touching each of the plurality of stroke clusters only once, from a stroke cluster identified as a central node, wherein the determined shortest path forms the stroke sequence, and wherein by following the determined stroke sequence, the input image is recreated;
and
generate a paint sequence for the recreated image, wherein by executing the paint sequence, the recreated image is painted to match color of the input image.

12 more elements

One or more non-transitory machine-readable information storage mediums comprising one or more instructions which when executed by one or more hardware processors cause:

receiving an input image;
converting the input image to a sketch of the input image, wherein, for the sketch, an associated sequence of strokes is obtained by feeding the sketch and the input image to a plurality of individual streams;
performing a sketch sequencing to orchestrate the associated sequence of strokes, comprising:
constructing, by processing the associated sequence of strokes and an associated plurality of pixel values, a sketch of strokes for the input image, wherein the sketch of strokes is constructed based on a plurality of vector curves identified in the sketch;
and
generating a stroke sequence for the constructed sketch of strokes, comprising:
organizing a plurality of strokes forming the sketch of strokes to a plurality of stroke clusters, based on proximity of the plurality of strokes;
and
determining, based on proximity of the plurality of stroke clusters, a shortest path to traverse the plurality of stroke clusters, touching each of the plurality of stroke clusters only once, from a stroke cluster identified as a central node, wherein the determined shortest path forms the stroke sequence, and wherein by following the determined stroke sequence, the input image is recreated;
and
generating a paint sequence for the recreated image, wherein by executing the paint sequence, the recreated image is painted to match color of the input image.

8 more elements

Dependencies are inferred from the claim text.