# US 10,120,635 B2 · Configuration and operation of display devices including device management > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,120,635 B2 - Document ID: US10120635B2 - Status: Granted - Kind: B2 - Application number: 15/283,026 - Filed: 2016-09-30 - Published: 2017-09-14 - Granted: 2018-11-06 - Earliest claimed: 2016-03-09 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Arun Rakesh Yoganandan; Kumi Akiyoshi; Melinda Yang; Yuchang Hu; Mark Schlager - Web page: https://patentgrep.com/patent/US10120635B2 ## CPC - G06F 3/1446: {display composed of modules, e.g. video walls} - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display} - G06F 3/1438: {using more than one graphics controller} - G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay} - G06F 3/1462: {with means for detecting differences between the image stored in the host and the images displayed on the remote displays} - G06F 3/147: using display panels - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 7/90: Determination of colour characteristics - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 11/40: Filling planar surfaces by adding surface attributes, e.g. adding colours or textures - G09G 5/14: Display of multiple viewports - H04N 23/63: by using electronic viewfinders - G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting - G06T 2207/10004: Still image; Photographic image - G06T 2207/20024: Filtering details - G06T 2210/22: Cropping - G09G 5/377: for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence) - G09G 2360/144: the light being ambient light - G09G 2370/02: Networking aspects - G09G 2370/042: for monitor identification - G09G 2370/06: Consumer Electronics Control, i.e. control of another device by a display or vice versa - G09G 2370/16: Use of wireless transmission of display information - G09G 2380/16: Digital picture frames - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract Device management includes receiving an image including one or more display devices, the image including contextual data associated with environmental information surrounding the one or more display devices. An updated image of the image of the one or more display devices is displayed. The updated image projects a view of the one or more display devices from a desired perspective. ## Claims ### Claim 1 A method for device management, comprising: receiving an image including one or more display devices, the image including contextual data associated with environmental information surrounding the one or more display devices; and controlling, by a processor device, a display showing an updated image of the image of the one or more display devices, the updated image projecting a view of the one or more display devices from a desired viewing perspective using perspective correction. ### Claim 2 (depends on 1) The method of claim 1, further comprising: recognizing a device type for each of the one or more display devices based on a respective content displayed; retrieving measurement data for each of the one or more display devices according to corresponding device type; and providing one or more device arrangement templates, each template providing indicators for mapping to marked measurement of the one or more display devices. ### Claim 3 (depends on 1) The method of claim 1, further comprising: recommending a filter based on the contextual data and the environmental information, wherein the filter is configured to neutralize a color palette; and causing update of a mat of at least one display device of the one or more display devices based on the contextual data and the environmental information. ### Claim 4 (depends on 1) The method of claim 1, further comprising: sensing, by sensors of an electronic device, data comprising distance and angle of the electronic device to the one or more display devices; determining a deformation level based on the sensed data and image of the one or more display devices; calculating position of a viewpoint relative to the one or more display devices based on the deformation level; and determining an ideal viewing position based on size, shape and layout of the one or more display devices. ### Claim 5 (depends on 1) The method of claim 1, further comprising: determining combinations of placement locations for the one or more display devices; marking display device representations with measurement information for a display device placement structure; and displaying template recommendations with the measurement information based on the determined combinations of placement locations. ### Claim 6 (depends on 1) The method of claim 1, further comprising: detecting ambient colors and lighting of an environment surrounding the one or more display devices; determining filters for neutralizing a color palette of content displayed on the one or more display devices based on the detected ambient colors; and providing recommendations for application of the determined filters to the content displayed on the one or more display devices. ### Claim 7 (depends on 1) The method of claim 1, further comprising: detecting ambient colors and lighting of an environment surrounding the one or more display devices; determining a group of content for display on the one or more display devices based on the detected ambient colors and lighting. ### Claim 8 (depends on 1) The method of claim 1, further comprising: detecting a pattern design on an environment surrounding the one or more display devices; analyzing the pattern design for identifying a repeating pattern, arrangement of the repeating pattern and spatial relationship of the repeating pattern to a location of at least one of the one or more display devices; determining filling patterns for regions of the repeating pattern that would display under a mat area of the at least one display device; and replacing the mat area content with the filling patterns. ### Claim 9 (depends on 1) The method of claim 1, further comprising: determining combinations of placement locations for the one or more display devices; displaying template recommendations based on the determined combinations of placement locations; and providing indications on a canvas structure for display device placement based on a received selection of one of the template recommendations. ### Claim 10 A system for device management comprising: a memory storing instructions; and at least one processor executing the instructions including a process configured to: receive an image including one or more display devices, the image including contextual data associated with environmental information surrounding the one or more display devices; and control a display showing an updated image of the image of the one or more display devices, the updated image projecting a view of the one or more display devices from a desired viewing perspective using perspective correction. ### Claim 11 (depends on 10) The system of claim 10, wherein the process is further configured to: recognize a device type for each of the one or more display devices based on a respective content displayed; retrieve measurement data for each of the one or more display devices according to corresponding device type; and provide one or more device arrangement templates, each template providing indicators for mapping to marked measurement of the one or more display devices. ### Claim 12 (depends on 10) The system of claim 10, wherein the process is further configured to: recommend a filter based on the contextual data and the environmental information, wherein the filter is configured to neutralize a color palette; and cause an update of a mat of at least one display device of the one or more display devices based on the contextual data and the environmental information. ### Claim 13 (depends on 10) The system of claim 10, further comprising: one or more sensors configured to sense data comprising distance and angle of to the one or more display devices; wherein the process is further configured to: determine a deformation level based on the sensed data and image of the one or more display devices; calculate position of a viewpoint relative to the one or more display devices based on the deformation level; and determine an ideal viewing position based on size, shape and layout of the one or more display devices. ### Claim 14 (depends on 10) The system of claim 10, wherein the process is further configured to: determine combinations of placement locations for the one or more display devices; illuminating display device representations based on measurement information for a display device placement structure; and display template recommendations with the measurement information based on the determined combinations of placement locations. ### Claim 15 (depends on 10) The system of claim 10, wherein the process is further configured to: detect ambient colors and lighting of an environment surrounding the one or more display devices; determine filters for neutralizing a color palette of content displayed on the one or more display devices based on the detected ambient colors; and provide recommendations for application of the determined filters to the content displayed on the one or more display devices. ### Claim 16 (depends on 10) The system of claim 10, wherein the process is further configured to: detect a pattern design on an environment surrounding the one or more display devices; analyze the pattern design to identify a repeating pattern, arrangement of the repeating pattern and spatial relationship of the repeating pattern to a location of at least one of the one or more display devices; determine filling patterns for regions of the repeating pattern that would display under a mat area of the at least one display device; and replace the mat area content with the filling patterns. ### Claim 17 A non-transitory processor-readable medium that includes a program that when executed by a processor device performs a method comprising: receiving an image including one or more display devices, the image including contextual data associated with environmental information surrounding the one or more display devices; and controlling, by the processor device, a display showing an updated image of the image of the one or more display devices, the updated image projecting a view of the one or more display devices from a desired viewing perspective using perspective correction. ### Claim 18 (depends on 17) The non-transitory processor-readable medium of claim 17, further comprising: recognizing a device type for each of the one or more display devices based on a respective content displayed; retrieving measurement data for each of the one or more display devices according to corresponding device type; and providing one or more device arrangement templates, each template providing indicators for mapping to marked measurement of the one or more display devices. ### Claim 19 (depends on 17) The non-transitory processor-readable medium of claim 17, further comprising: recommending a filter based on the contextual data and the environmental information, wherein the filter is configured to neutralize a color palette; and causing update of a mat of at least one display device of the one or more display devices based on the contextual data and the environmental information. ### Claim 20 (depends on 17) The non-transitory processor-readable medium of claim 17, further comprising: sensing, by sensors of an electronic device, data comprising distance and angle of the electronic device to the one or more display devices; determining a deformation level based on the sensed data and image of the one or more display devices; calculating position of a viewpoint relative to the one or more display devices based on the deformation level; and determining an ideal viewing position based on size, shape and layout of the one or more display devices.