# US 11,310,441 B2 · Electronic device for generating a background image for a display apparatus and operation method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,310,441 B2 - Document ID: US11310441B2 - Status: Granted - Kind: B2 - Application number: 16/961,595 - Filed: 2019-01-29 - Published: 2020-11-26 - Granted: 2022-04-19 - Earliest claimed: 2018-02-13 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Insun Lee; Yunho Lee; Kwansik Yang - Web page: https://patentgrep.com/patent/US11310441B2 ## CPC - H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay - H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation} - H04N 5/265: Mixing - H04N 5/4448: {for frame-grabbing} - H04N 21/4126: {The peripheral being portable, e.g. PDAs or mobile phones} - H04N 21/422: Input-only peripherals {, i.e. input devices connected to specially adapted client devices}, e.g. global positioning system [GPS] {(input devices also receiving signals from specially adapted client devices H04N21/4104)} - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/8153: {comprising still images, e.g. texture, background image} - H04N 23/635: {Region indicators; Field of view indicators} - H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image} - H04N 23/80: Camera processing pipelines; Components thereof - H04N 21/4131: {home appliance, e.g. lighting, air conditioning system, metering devices (home automation data switching networks exchanging configuration information on appliance services H04L12/2807)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An electronic device and an operating method thereof are provided. The electronic device includes: a camera; a display; a communication interface; a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to: generate an event to instruct a plurality of markers to be displayed on a screen of a display apparatus and transmit the generated event to the display apparatus; determine, from among images obtained from the camera, an image from which at least a region of a wall surface in the vicinity of the display apparatus is to be extracted, via recognition of the plurality of markers displayed on the screen of the display apparatus in response to the generated event; extract, from the determined image, a region corresponding to a shape obtained based on the recognized plurality of markers; generate a background image to be displayed on the screen of the display apparatus, by correcting an image of the extracted region; and transmit the generated background image to the display apparatus so that the generated background image is displayed on the screen of the display apparatus. ## Claims ### Claim 1 An electronic device comprising: a camera; a display; a communication interface; a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to: generate an event and transmit, to a display apparatus, the generated event to instruct a plurality of markers to be displayed on a screen of the display apparatus; determine, from among images obtained from the camera, an image, from which at least a region of a wall surface in the vicinity of the display apparatus is to be extracted, based on recognition of the plurality of markers displayed on the screen of the display apparatus in response to the generated event; extract, from the determined image, a region corresponding to a shape obtained based on the recognized plurality of markers; generate a background image to be displayed on the screen of the display apparatus, by correcting an image of the extracted region; and transmit the generated background image to the display apparatus so that the generated background image is displayed on the screen of the display apparatus. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to execute the one or more instructions to: obtain size information of the screen of the display apparatus; and determine, based on the obtained size information, a location of the screen of the display apparatus on which the plurality of markers are to be displayed, and generate the event including information about the determined location. ### Claim 3 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to execute the one or more instructions to, when the plurality of markers displayed on the screen of the display apparatus are recognized, determine, from the images obtained from the camera, an image in which the plurality of markers exist, as an image from which the background image is to be extracted. ### Claim 4 (depends on 1) The electronic device of claim 1, wherein the at least the region of the wall surface on which the display apparatus is mounted includes at least one of a left region, a right region, an upper region, and a lower region of the wall surface in the vicinity of the display apparatus. ### Claim 5 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to execute the one or more instructions to correct the image of the extracted region by performing at least one of adjusting of a length of at least one side of the image, rotating the image of the extracted region, and symmetrizing the image of the extracted region. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to execute the one or more instructions to generate the background image by combining an image generated by correcting the image of the extracted region with a symmetric image of the corrected image. ### Claim 7 (depends on 6) The electronic device of claim 6, wherein the processor is further configured to execute the one or more instructions to: when the determined image is an image obtained from a left region or a right region of the wall surface in the vicinity of the display apparatus, obtain the symmetric image by symmetrizing the obtained image in a left direction or a right direction; and when the determined image is an image obtained from an upper region or a lower region of the wall surface in the vicinity of the display apparatus, obtain the symmetric image by symmetrizing the obtained image in an upper direction or a lower direction. ### Claim 8 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to execute the one or more instructions to transmit the event and the background image to the display apparatus via a server. ### Claim 9 (depends on 1) The electronic device of claim 1, wherein the shape obtained based on the recognized plurality of markers includes a polygonal shape obtained by connecting the recognized plurality of markers. ### Claim 10 An operating method of an electronic device, the method comprising: generating an event to instruct a plurality of markers to be displayed on a screen of a display apparatus and transmitting the generated event to the display apparatus; determining, from among images obtained from a camera, an image, from which at least a region of a wall surface in the vicinity of the display apparatus is to be extracted, via recognition of the plurality of markers displayed on the screen of the display apparatus in response to the generated event; extracting, from the determined image, a region corresponding to a shape obtained based on the recognized plurality of markers; generating a background image to be displayed on the screen of the display apparatus, by correcting an image of the extracted region; and transmitting the generated background image to the display apparatus so that the generated background image is displayed on the screen of the display apparatus. ### Claim 11 (depends on 10) The method of claim 10, further comprising: obtaining size information of the screen of the display apparatus; and determining, based on the obtained size information, a location of the screen of the display apparatus on which the plurality of markers are to be displayed, and generating the event including information about the determined location. ### Claim 12 (depends on 10) The method of claim 10, further comprising: recognizing the plurality of markers displayed on the screen of the display apparatus, from the images obtained from the camera; and determining an image, in which the recognized plurality of markers exist, as an image from which the background image is to be extracted. ### Claim 13 (depends on 10) The method of claim 10, wherein the at least the region of the wall surface on which the display apparatus is mounted includes at least one of a left region, a right region, an upper region, and a lower region of the wall surface in the vicinity of the display apparatus. ### Claim 14 (depends on 10) The method of claim 10, further comprising, with respect to the image of the extracted region, correcting the image of the extracted region by performing at least one of adjusting a length of at least one side of the image, rotating the image of the extracted region, and symmetrizing the image of the extracted region. ### Claim 15 (depends on 10) A non-transitory computer-readable recording medium having recorded thereon a program for executing the method of claim 10 on a computer.