# US 10,768,777 B2 · Mobile terminal > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,768,777 B2 - Document ID: US10768777B2 - Status: Granted - Kind: B2 - Application number: 16/683,137 - Filed: 2019-11-13 - Published: 2020-03-12 - Granted: 2020-09-08 - Earliest claimed: 2015-06-01 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Euikyeom Kim; Kyungtae Oh; Seungju Choi; Yoonjung Son - Web page: https://patentgrep.com/patent/US10768777B2 ## CPC - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves} - G06F 3/0486: Drag-and-drop - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06Q 10/101: Collaborative creation, e.g. joint development of products or services - H04B 1/3833: {Hand-held transceivers} - H04L 51/04: Real-time or near real-time messaging, e.g. instant messaging [IM] - H04L 51/046: Interoperability with other network applications or services - H04M 1/725: Cordless telephones (user interfaces specially adapted therefor H04M1/724) - H04M 1/72522 - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen - G06Q 30/02: Marketing; Price estimation or determination; Fundraising - G06Q 50/01 - H04M 2250/52: including functional features of a camera - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - H04B: TRANSMISSION - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) ## Abstract Provided is a mobile terminal which allows pieces of furniture to be virtually arranged. A mobile terminal according to one embodiment of the present invention comprises: a wireless communication unit which is capable of communicating with an external server or an external device; a display unit for displaying an execution screen of a certain application; and a control unit, wherein the execution screen at least comprises: a first area for displaying a first image corresponding to a certain area; a second area for displaying information on each of a plurality of pieces of furniture which can virtually be arranged on the first image; and a third area which includes a chat room for exchanging opinions related to the virtual arrangement of the pieces of furniture on the first image, with a user of at least one predetermined external device on which the certain application is installed. ## Claims ### Claim 1 A mobile terminal, comprising: a wireless communication unit configured to communicate with an external server or device; a display unit configured to display an execution screen of a specific application; and a controller, wherein the executions screen comprises at least one of a first area for displaying a first image corresponding to a specific space or a second area for displaying information of each of a plurality of pieces of furniture that can be virtually arranged in the first image, wherein the controller is configured to: when detecting a second signal that selects information of a third piece of furniture from the information of the plurality of pieces of furniture displayed in the second area and drags the selected information into the first area, display an image of the third piece of furniture on the first image, when detecting at least one of a third signal for changing a location of the image of the third piece of furniture in the first image and a fourth signal for rotating the image of the third piece of furniture in the first image, change at least one of the location of the image of the third piece of furniture, a size of the image of the third piece of furniture, or a rotation angle of the image of the third piece of furniture in the first image, and when the third piece of furniture cannot be placed in a specific area in the specific space corresponding to the first image based on a size of the specific area and a size and a shape of the third piece of furniture, display a notification message on the display unit to inform that the third piece of furniture cannot be placed in the specific area in the specific space corresponding to the first image. ### Claim 2 (depends on 1) The mobile terminal of claim 1, wherein the first image comprises at least one of an image stored in a memory of the mobile terminal, a preview image obtained by a camera of the mobile terminal, or an image received from the external server or device through the wireless communication unit. ### Claim 3 (depends on 1) The mobile terminal of claim 1, wherein the first image comprises at least one of a 2-dimensional (2D) image, a 3-dimensional (3D) image, or a 3D reconstruction image. ### Claim 4 (depends on 1) The mobile terminal of claim 1, further comprising a memory configured to store at least one of size information of the specific space corresponding to the first image, location information of furniture previously placed in the specific space, shape information of the furniture previously place in the specific space, or size information of the furniture previously placed in the specific space, and at least one of shape information of the third piece of furniture, color information of the third piece of furniture, or size information of the third piece of furniture. ### Claim 5 (depends on 4) The mobile terminal of claim 4, wherein when detecting the at least one of the third and fourth signals, the controller is further configured to change the at least one of the location of the image of the third piece of furniture, the size of the image of the third piece of furniture, or the rotation angle of the image of the third piece of furniture in the first image based on the information stored in the memory. ### Claim 6 (depends on 4) The mobile terminal of claim 4, wherein the controller is further configured to display, on the first image, an indicator for notifying a candidate area where the third piece of furniture can be placed in the specific place, based on the information stored in the memory. ### Claim 7 (depends on 4) The mobile terminal of claim 4, when detecting an eighth signal for selecting an object in the first image corresponding to a specific piece of furniture among a plurality of piece of furniture previously in the specific space, the controller is further configured to delete the selected object the first image. ### Claim 8 (depends on 1) The mobile terminal of claim 1, wherein the controller is further configured to: control the wireless communication unit to receive at least one of a fifth signal for changing the location of the image of the third piece of furniture in the first image or a sixth signal for rotating the image of the third piece of furniture in the first image from the predetermined external device, and change the at least one of the location of the image of the third piece of furniture, the size of the image of the third piece of furniture, or the rotation angle of the image of the third piece of furniture in the first image based on at least one of the received fifth or sixth signals. ### Claim 9 (depends on 8) The mobile terminal of claim 8, wherein the controller is further configured to display, on the first image, both of the image of the third piece of furniture based on the at least one of the third or fourth signals and the image of the third piece of furniture based on the at least one of the fifth or sixth signals. ### Claim 10 (depends on 9) The mobile terminal of claim 9, wherein at least one of a color, a transparent level, or a pattern of the image of the third piece of furniture in accordance with the at least one of the third or fourth signals is different from at least one of a color, a transparent level, or a pattern of the image of the image of the third piece of furniture in accordance with the at least one of the fifth or sixth signals. ### Claim 11 (depends on 1) The mobile terminal of claim 1, wherein when detecting a seventh signal for confirming arrangement of the third piece of furniture in the first image, the controller is further configured to configure lock so that changes in the location, size, and rotation angle of image of the third piece of furniture are not allowed. ### Claim 12 (depends on 11) The mobile terminal of claim 11, wherein when detecting the seventh signal for confirming arrangement of the third piece of furniture in the first image, the controller is further configured to display an indicator on the information of the third piece of furniture, which is displayed in the second area. ### Claim 13 (depends on 1) The mobile terminal of claim 1, wherein the image of the third piece of furniture is a 3-dimensional (3D) reconstruction image. ### Claim 14 (depends on 1) The mobile terminal of claim 1, wherein the execution screen further comprises a third area including a chat room for exchanging opinions about virtual furniture arrangement in the first image with at least one user using a predetermined external device when the specific application is installed. ### Claim 15 (depends on 14) The mobile terminal of claim 14, wherein the chat room in the third area comprises a chat window for text input, and wherein when a text is inputted to the chat window after detection of a first signal that selects information of a first piece of furniture from the information of the plurality of pieces of furniture displayed in the second area, the controller is further configured to display first information to the inputted text and second information corresponding to at least part of the selected information of the first piece of furniture in the chat room of the third area. ### Claim 16 (depends on 14) The mobile terminal of claim 14, wherein the controller is further configured to: recognize a predetermined first text from texts displayed in the chat room, and when the recognized first text matches information of a second piece of furniture displayed in the second area, display at least part of the information of the second piece of furniture in the chat room of the third area. ### Claim 17 (depends on 14) The mobile terminal of claim 14, wherein the controller is further configured to control the wireless communication unit to transmit information of the first image and information of the image of the third piece of furniture, which is displayed on the first image, to the predetermined external device. ### Claim 18 (depends on 14) The mobile terminal of claim 14, wherein the controller is further configured to: recognize a second text corresponding to a name of the third piece of furniture and a third text corresponding to a specific color from texts displayed in the chat room, and change a color of the image of the third piece of furniture to the specific color corresponding to the third text.