# US 11,113,850 B2 · Electronic apparatus and control method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,113,850 B2 - Document ID: US11113850B2 - Status: Granted - Kind: B2 - Application number: 16/526,174 - Filed: 2019-07-30 - Published: 2020-04-02 - Granted: 2021-09-07 - Earliest claimed: 2018-09-27 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Byounghyun Kim; Youngin Park - Web page: https://patentgrep.com/patent/US11113850B2 ## CPC - G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 7/90: Determination of colour characteristics - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06V 20/00: Scenes; Scene-specific elements (control of digital cameras H04N23/60) - G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) - H04N 9/73: Colour balance circuits, e.g. white balance circuits or colour temperature control (camera processing pipelines for colour balance H04N23/88) - H04N 9/74: for obtaining special effects (H04N9/65 - H04N9/73 take precedence) - H04N 23/88: for colour balance, e.g. white-balance circuits or colour temperature control - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An electronic apparatus includes a communicator, a camera, and a processor configured to obtain an image including a display apparatus through the camera, identify the display apparatus from the image, analyze at least one pattern of the remaining areas excluding an area corresponding to the display apparatus in the image, and obtain a pattern corresponding to the image based on patterns included in the image by ratios equal to or greater than a predetermined ratio among the at least one pattern, cluster the colors of the remaining areas into at least one color, and control the communicator such that an image generated by applying the at least one clustered color to the obtained pattern is output at the display apparatus. ## Claims ### Claim 1 An electronic apparatus comprising: a communicator; a camera; and a processor configured to: control the camera to obtain an image including a display apparatus, identify the display apparatus in the image, identify a display area corresponding to the identified display apparatus in the image and a surrounding area excluding the display area in the image, identify a plurality of shapes of a plurality of objects included in the surrounding area, identify a pattern corresponding to the image based on a shape that occupies the surrounding area at a predetermined ratio or more among the plurality of shapes, cluster colors of the surrounding area into a plurality of clustered colors, and control the communicator to communicate with the display apparatus such that an image by applying the plurality of clustered colors to the identified pattern is output by the display apparatus. ### Claim 2 (depends on 1) The electronic apparatus of claim 1, wherein the processor is further configured to analyze the at least one pattern of the surrounding area in different directions relative to the display apparatus, and identify the pattern corresponding to the image based on locations of respective objects in the at least one pattern and the predetermined ratio. ### Claim 3 (depends on 2) The electronic apparatus of claim 2, wherein the processor is further configured to: analyze a color of each object in the at least one pattern, cluster the colors of the surrounding area based on a similarity among the respective colors of the objects, and apply the plurality of clustered colors to the identified pattern based on a location of the clustered colors. ### Claim 4 (depends on 2) The electronic apparatus of claim 2, wherein the processor is further configured to analyze colors of the at least one pattern in units of pixels, and cluster pixels where a similarity among the analyzed colors is greater than or equal to a predetermined threshold. ### Claim 5 (depends on 1) The electronic apparatus of claim 1, wherein the processor is further configured to identify the pattern corresponding to the image from a plurality of pre-stored patterns. ### Claim 6 (depends on 5) The electronic apparatus of claim 5, wherein the processor is further configured to apply additionally clustered colors to the identified pattern. ### Claim 7 (depends on 1) The electronic apparatus of claim 1, wherein the processor is further configured to apply colors in the plurality of clustered colors occupying the surrounding area in a ratio greater than or equal to a predetermined ratio to the identified pattern. ### Claim 8 (depends on 1) The electronic apparatus of claim 1, wherein the processor is further configured to apply colors in the plurality of clustered colors randomly to the identified pattern. ### Claim 9 (depends on 1) The electronic apparatus of claim 1, wherein the processor is further configured to identify a ratio that each color of the plurality of clustered colors occupies in the surrounding area, and apply the colors of the plurality of clustered colors of which the identified ratios are high to the identified pattern more than the colors of the plurality of clustered colors of which the identified ratios are low. ### Claim 10 (depends on 1) The electronic apparatus of claim 1, wherein the processor is further configured to identify a ratio that each color of the plurality of clustered colors occupies in the surrounding area, balance the ratio of each color of the plurality of clustered colors, and apply the balanced plurality of clustered colors to the identified pattern. ### Claim 11 A control method to be performed by an electronic apparatus, the control method comprising: obtaining an image including a display apparatus; identifying the display apparatus in the image; identifying a display area corresponding to the identified display apparatus in the image and a surrounding area excluding the display area in the image; identifying a plurality of shapes of a plurality of objects included in the surrounding area; identifying a pattern corresponding to the image based on a shape that occupies the surrounding area at a predetermined ratio or more among the plurality of shapes; clustering colors of the surrounding area into a plurality of clustered colors; and controlling communication with the display apparatus such that an image applying the plurality of clustered colors to the identified pattern is output by the display apparatus. ### Claim 12 (depends on 11) The control method of claim 11, further comprising: analyzing at least one pattern of the surrounding area in different directions relative to the display apparatus, wherein the identifying the pattern corresponding to the image further comprises identifying the pattern corresponding to the image based on locations of respective objects in the at least one pattern and the predetermined ratio. ### Claim 13 (depends on 12) The control method of claim 12, further comprising: analyzing a color of each object in the at least one pattern; cluster the colors of the surrounding area based on a similarity among the respective colors of the objects; and applying the plurality of clustered colors to the identified pattern based on a location of the clustered colors. ### Claim 14 (depends on 12) The control method of claim 12, wherein the clustering further comprises analyzing colors of the at least one pattern in units of pixels, and clustering pixels where a similarity among the analyzed colors is greater than or equal to a predetermined threshold. ### Claim 15 (depends on 11) The control method of claim 11, wherein the identifying the pattern corresponding to the image further comprises identifying the pattern corresponding to the image from a plurality of pre-stored patterns. ### Claim 16 (depends on 15) The control method of claim 15, further comprising: applying additionally clustered colors to the identified pattern. ### Claim 17 (depends on 11) The control method of claim 11, further comprising: applying colors in the plurality of clustered colors occupying the surrounding area in a ratio greater than or equal to a predetermined ratio to the identified pattern. ### Claim 18 (depends on 11) The control method of claim 11, further comprising: applying colors in the plurality of clustered colors randomly to the identified pattern. ### Claim 19 (depends on 11) The control method of claim 11, further comprising: identifying a ratio that each color of the plurality of clustered colors occupies in the surrounding area; and applying the colors of the plurality of clustered colors of which the identified ratios are high to the identified pattern more than the colors of the plurality of clustered colors of which the identified ratios are low. ### Claim 20 (depends on 11) The control method of claim 11, further comprising: identifying a ratio that each color of the plurality of clustered colors occupies in the surrounding area; balancing the ratio of each color of the plurality of clustered colors; and applying the balanced plurality of clustered colors to the identified pattern.