# US 10,311,642 B2 · Augmented reality service method and system for coloring play > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,642 B2 - Document ID: US10311642B2 - Status: Granted - Kind: B2 - Application number: 15/578,495 - Filed: 2016-05-30 - Published: 2018-05-17 - Granted: 2019-06-04 - Earliest claimed: 2015-06-03 - Assignees: Ds Global - Applicants: Ds Global - Inventors: Sam Hee Lee - Web page: https://patentgrep.com/patent/US10311642B2 ## CPC - G06Q 50/10: Services - G06T 7/90: Determination of colour characteristics - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 11/60: Creating or editing images; Combining images with text - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04N 1/00108: {of digital signals} - H04N 1/00307: {with a mobile telephone apparatus (constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00)} - H04N 1/46: Colour picture communication systems - H04N 1/60: Colour correction or control {(H04N1/54 takes precedence)} - G06T 2207/10008: from scanner, fax or copier - G06T 2207/30204: Marker - G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An augmented reality service method for a coloring play according to the present invention comprises the steps of: 1) executing a service application, and selecting and downloading an image to be colored from a server by a user terminal; 2) coloring the downloaded image in a specific pattern, using tool provided by the service application; 3) printing the colored image; 4) executing the service application, scanning a printed material of the colored image so as to recognize a marker, and extracting color information according to coordinates of the image; 5) coloring an augmented reality content provided by the server according to the extracted color information, so as to generate a colored augmented reality content on the basis of the image colored by a user; and 7) displaying the colored augmented reality content on a display unit of the user terminal. ## Claims ### Claim 1 An augmented reality service method for coloring play, comprising steps of: 1) executing, by a user terminal, a service app and selecting and downloading an image to be colored from a server; 2) coloring the downloaded image in a specific pattern using a tool provided by the service app; 3) printing the colored image; 4) executing the service app, recognizing a marker by scanning a printed matter of the colored image, and extracting color information according to coordinates of the image; 5) generating coloring augmented reality content based on the image colored by a user by coloring augmented reality content provided by the server based on the extracted color information; and 6) displaying the coloring augmented reality content on a display unit of the user terminal. ### Claim 2 (depends on 1) The augmented reality service method of claim 1, further comprising a step of storing the image colored in the step 2) in the user terminal. ### Claim 3 (depends on 1) The augmented reality service method of claim 1, wherein the coloring augmented reality content is generated in the server or the user terminal. ### Claim 4 (depends on 1) The augmented reality service method of claim 1, wherein in the step 3), the image colored by the user is colorfully printed. ### Claim 5 (depends on 1) The augmented reality service method of claim 1, wherein: the step 2) comprises generating, by the user, a voice file and transmitting the voice file to the server, and the step 6) comprises playing back the voice file when the coloring augmented reality content is displayed on the display unit of the user terminal. ### Claim 6 An augmented reality service system for coloring play, comprising: a server providing various images for coloring play and augmented reality content corresponding to a corresponding image; a user terminal comprising a service app for downloading the image in response to a selection of a user and providing a tool for allowing the user to color the image; and a printing device printing the image colored in the service app, wherein the service app recognizes a marker by scanning a printed matter of the colored image and extracts color information according to coordinates of the image, the server or the service app generates coloring augmented reality content based on the image colored by the user by coloring augmented reality content provided by the server based on the extracted color information, and the user terminal displays the coloring augmented reality content. ### Claim 7 (depends on 6) The augmented reality service system of claim 6, wherein the user terminal stores the image colored by the user in the service app. ### Claim 8 (depends on 6) The augmented reality service system of claim 6, wherein the printing device comprises short-distance wireless communication means, receives the colored image from the user terminal, and colorfully prints the received image.