# US 11,029,841 B2 · Electronic device for generating augmented reality emoji and method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,029,841 B2 - Document ID: US11029841B2 - Status: Granted - Kind: B2 - Application number: 16/701,465 - Filed: 2019-12-03 - Published: 2020-06-04 - Granted: 2021-06-08 - Earliest claimed: 2018-12-04 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Sangmin Shin; Ohyoon Kwon; Deokgyoon Yoon; Jiwoo Lee; Yeunwook Lim - Web page: https://patentgrep.com/patent/US11029841B2 ## CPC - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06T 11/00: Two-dimensional [2D] image generation - G06F 3/03545: {Pens or stylus} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Certain embodiments include an electronic device comprising a housing, a touchscreen display viewable through a portion of the housing, at least one processor disposed inside the housing and operatively connected with the touchscreen display; and a memory disposed within the housing and operatively connected with the processor, wherein the memory stores instructions that, when executed, cause the at least one processor to perform a plurality of operations, the plurality of operations comprising displaying a first augmented reality (AR) emoji on a window capable of receiving at least one first stroke input, through the touchscreen display, receiving the at least one first stroke input while displaying the first AR emoji on the window, and displaying a second AR emoji, based at least partially on a position and a shape of the at least one first stroke input. ## Claims ### Claim 1 An electronic device comprising: a housing; a touchscreen display viewable through a portion of the housing; at least one processor disposed inside the housing and operatively connected with the touchscreen display; and a memory disposed within the housing and operatively connected with the at least one processor, wherein the memory stores instructions that, when executed, cause the at least one processor to perform a plurality of operations, the plurality of operations comprising: displaying a first augmented reality (AR) emoji on a window capable of receiving at least one first stroke input, through the touchscreen display; receiving the at least one first stroke input while displaying the first AR emoji on the window; displaying a second AR emoji, based at least partially on a position and a shape of the at least one first stroke input; and displaying at least one of a sticker image or a background image based on the shape of the received at least one first stroke input on the window. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the second AR emoji includes a gesture, said gesture based on the position and the shape of the at least one first stroke input. ### Claim 3 (depends on 1) The electronic device of claim 1, further comprising: a wireless communication circuit configured to communicate with an external electronic device, wherein the plurality of operations further comprise: receive a first user input for transmitting the second AR emoji while at least one of the second AR emoji, the sticker image, or the background image is displayed; generating a first image file including at least one of the second AR emoji, the sticker image, or the background image in response to the received first user input; and transmitting the generated first image file to the external electronic device, through the wireless communication circuit. ### Claim 4 (depends on 3) The electronic device of claim 3, wherein plurality of operations further comprise: receiving a second stroke input while at least one of the second AR emoji, the sticker image, or the background image is displayed; displaying a character corresponding to the second stroke input on the window, through the touchscreen display; receiving the first user input while the character is displayed; generating a second image file including at least one of the second AR emoji, the displayed character, the sticker image, or the background image in response to the received first user input; and transmitting the generated second image file to the external electronic device, through the wireless communication circuit. ### Claim 5 (depends on 3) The electronic device of claim 3, wherein operations further comprise: transmitting first information about the received at least one first stroke input to an external server, through the wireless communication circuit; receiving second information about the second AR emoji from the external server, through the wireless communication circuit, based at least partially on the transmitted first information; and displaying the second AR emoji through the display, based at least partially on the received second information. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the plurality of operations further comprise: receiving a second user input of executing a function associated with transmitting a message; displaying the window, through the touchscreen display, in response to the received second user input; displaying an object for executing an AR emoji function on a partial area of the window, through the touchscreen display; and displaying the first AR emoji on the window, in response to a third user input of selecting the displayed object. ### Claim 7 (depends on 1) The electronic device of claim 1, wherein plurality of operations further comprise: displaying an output stroke corresponding to the at least first stroke input on the window while the at least one first stroke input is received; displaying the second AR emoji in response to detecting that the at least one first stroke input is completed; and allowing the displayed output stroke on the window to fade away. ### Claim 8 A method of an electronic device comprising: displaying a first augmented reality (AR) emoji on a window configured to receive at least one first stroke input; receiving the at least one first stroke input on the window; displaying a second AR emoji, based at least partially on a position and a shape of the at least one first stroke input; and displaying at least one of a sticker image or a background image based on the shape of the received at least one first stroke input on the window. ### Claim 9 (depends on 8) The method of claim 8, wherein the second AR emoji includes a gesture, said gesture based on the position and the shape of the at least one first stroke input. ### Claim 10 (depends on 8) The method of claim 8, further comprising: receiving a first user input for transmitting the second AR emoji while at least one of the second AR emoji, the sticker image, or the background image is displayed; generating a first image file including at least one of the second AR emoji, the sticker image, or the background image in response to the received first user input; and transmitting the generated first image file to an external electronic device. ### Claim 11 (depends on 10) The method of claim 10, further comprising: receiving a second stroke input while at least one of the second AR emoji, the sticker image, or the background image is displayed; displaying a character corresponding to the second stroke input on the window; receiving the first user input while the character is displayed; generating a second image file including at least one of the second AR emoji, the displayed character, the sticker image, or the background image in response to the received first user input; and transmitting the generated second image file to the external electronic device. ### Claim 12 (depends on 8) The method of claim 8, further comprising: transmitting first information about the received at least one first stroke input to an external server; and receiving second information about the second AR emoji, from the external server, wherein the displaying of the second AR emoji includes: displaying the second AR emoji based at least partially on the received second information. ### Claim 13 (depends on 8) The method of claim 8, further comprising: receiving a second user input of executing a function associated with transmitting a message; and displaying the window and an object for executing an AR emoji function on a partial area of the window, in response to the received second user input, wherein the displaying of the first AR emoji includes: displaying the first AR emoji on the window, in response to a third user input of selecting a displayed object. ### Claim 14 An electronic device comprising: a housing; a touchscreen display viewable through a portion of the housing; a wireless communication circuit disposed within the housing, and configured to communicate with an external server; at least one processor disposed within the housing and operatively connected with the display and the wireless communication circuit; and a memory disposed within the housing and operatively connected with the at least one processor, wherein the memory stores instructions that, when executed, cause the at least one processor to perform a plurality of operations comprising: displaying a first augmented reality (AR) emoji capable of receiving at least one first stroke input, through the display; receiving the at least one first stroke input while displaying the first AR emoji on a window; transmitting information about the at least one first stroke input to the external server, through the wireless communication circuit; receiving information about a second AR emoji indicating a gesture corresponding to the at least one first stroke input from the external server, through the wireless communication circuit; displaying the second AR emoji, through the display, based at least partially on information about the received second AR emoji; receiving a first user input for transmitting the second AR emoji while the second AR emoji is displayed; generating a first image file including the second AR emoji in response to the received first user input; and transmitting the generated first image file to an external electronic device, through the wireless communication circuit. ### Claim 15 (depends on 14) The electronic device of claim 14, wherein the plurality of operations further comprise: receiving a second user input of executing a function associated with transmitting a message; displaying the window, through the display, in response to the received second user input; displaying an object for executing an AR emoji function on a partial area of the window, through the display; and displaying the first AR emoji on the window, in response to a third user input of selecting the displayed object. ### Claim 16 (depends on 14) The electronic device of claim 14, wherein the at least one first stroke input includes a first stroke input using a digital pen. ### Claim 17 (depends on 14) The electronic device of claim 14, wherein the plurality of operations further comprise: displaying an output stroke corresponding to the at least first stroke input on the window while the at least one first stroke input is received; displaying the second AR emoji in response to detecting that the at least one first stroke input is completed; and fading away the displayed output stroke on the window. ### Claim 18 (depends on 14) The electronic device of claim 14, wherein the plurality of operations further comprise: receiving a second user input while the second AR emoji is displayed; displaying a character corresponding to the received second user input on the window, through the display; generating a second image file including the second AR emoji and the displayed character in response to the received first user input; and transmitting the generated second image file to the external electronic device, through the wireless communication circuit.