# US 10,482,346 B2 · Electronic device for processing image and method for controlling the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,482,346 B2 - Document ID: US10482346B2 - Status: Granted - Kind: B2 - Application number: 15/172,873 - Filed: 2016-06-03 - Published: 2016-12-15 - Granted: 2019-11-19 - Earliest claimed: 2015-06-09 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Chang-Hoon Kim; Ki-Huk Lee - Web page: https://patentgrep.com/patent/US10482346B2 ## CPC - G06T 7/73: using feature-based methods - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 15/50: Lighting effects - G06V 10/42: Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation - G06V 10/50: by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis - G06V 10/56: relating to colour - G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model - G06V 40/161: {Detection; Localisation; Normalisation} - G06T 2207/30201: Face - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A method for controlling an electronic device is provided. The method includes obtaining an image, detecting at least one object in a facial area from the image, and applying a virtual light source effect to the image based on an attribute of the detected object and displaying the image. ## Claims ### Claim 1 A method for controlling an electronic device, the method comprising: obtaining an image from an external device or a camera of the electronic device; detecting a facial area from the image; detecting at least one object in the facial area from the image; applying a virtual light source effect to the image based on an attribute of the detected at least one object, wherein the applying of the virtual light source effect includes: identifying a brightness adjustment ratio of each of at least one pixel in the image according to a distance from a virtual light source, and adjusting a brightness of the at least one pixel in the image; and displaying the image to which the virtual light source effect is applied. ### Claim 2 (depends on 1) The method of claim 1, further comprising: determining a characteristic of the virtual light source, wherein the applying of the virtual light source effect to the image further comprises adjusting an attribute of the at least one pixel in the image according to the virtual light source, and wherein the displaying of the image to which the virtual light source effect is applied further comprises displaying the image comprising the adjusted at least one pixel. ### Claim 3 (depends on 2) The method of claim 2, wherein the displaying of the image to which the virtual light source effect is applied further comprises: displaying the image comprising the at least one pixel according to the distance between the virtual light source and each of the at least one pixel. ### Claim 4 (depends on 3) The method of claim 3, wherein the displaying of the image to which the virtual light source effect is applied further comprises: displaying the image comprising the at least one pixel according to the identified brightness adjustment ratio. ### Claim 5 (depends on 2) The method of claim 2, wherein the displaying of the image to which the virtual light source effect is applied further comprises: displaying the image comprising the at least one pixel; based on an object attribute of the at least one object and the virtual light source. ### Claim 6 (depends on 2) The method of claim 2, wherein the displaying of the image to which the virtual light source effect is applied further comprises: displaying the image, including the at least one pixel, based on at least one of a determined brightness, color, or color temperature of the virtual light source. ### Claim 7 (depends on 2) The method of claim 2, wherein the number of virtual light sources is one or more. ### Claim 8 (depends on 2) The method of claim 2, further comprises: providing a user interface for setting light source information on the virtual light source; and obtaining the light source information on the virtual light source through the user interface, wherein the displaying of the image to which the virtual light source effect is applied further comprises displaying the image comprising the at least one pixel based on the obtained light source information on the virtual light source. ### Claim 9 (depends on 1) The method of claim 1, further comprising: detecting posture information on the facial area; wherein the applying of the virtual light source effect to the image further comprises adjusting an attribute of the at least one pixel in the image according to a position of the virtual light source adjusted based on the detected posture information, and wherein the displaying of the image to which the virtual light source effect is applied further comprises displaying the image comprising the adjusted at least one pixel. ### Claim 10 (depends on 9) The method of claim 9, further comprises: determining the position of the virtual light source corresponding to a second angle for radiating light at a first angle preset with respect to a front side of the facial area, or determining the position of the virtual light source at the first angle based on the detected posture information. ### Claim 11 (depends on 9) The method of claim 9, wherein the detecting of the posture information on the facial area further comprises: comparing an object attribute of the at least one object with previously stored attribute information; and detecting the posture information according to a result of the comparison. ### Claim 12 (depends on 1) The method of claim 1, further comprising: obtaining light source information on an actual light source of the image; determining light source information on the virtual light source based on the light source information on the actual light source; and adjusting an attribute of the at least one pixel in the image according to the virtual light source. ### Claim 13 (depends on 12) The method of claim 12, wherein the determining of the light source information on the virtual light source based on the light source information on the actual light source further comprises: determining at least one of a position, brightness, color, or color temperature of the virtual light source corresponding to each of at least one of a position, brightness, color, or color temperature of the actual light source. ### Claim 14 (depends on 12) The method of claim 12, wherein the obtaining of the light source information on the actual light source of the image further comprises: analyzing a histogram for a brightness of the image to obtain at least one of a position, brightness, color, or color temperature of the actual light source. ### Claim 15 (depends on 1) The method of claim 1, wherein the displaying of the image to which the virtual light source effect is applied further comprises: displaying the image, including the at least one pixel according to correlation information between the object attribute and pixel attribute adjustment information. ### Claim 16 (depends on 1) The method of claim 1, wherein the image includes two-dimensional (2D) data or three-dimensional (3D) data. ### Claim 17 An electronic device, comprising: a display; at least one processor electrically connected to the display; and a memory electrically connected to the processor, wherein the memory is configured to store instructions that, when executed, configure the at least one processor to: obtain an image from an external device or a camera of the electronic device, detect a facial area from the image; detect at least one object in the facial area from the image, apply a virtual light source effect to the image based on an attribute of the at least one detected object, and display the image, wherein, to apply the virtual light source effect to the image, the at least one processor is further configured to: identify a brightness adjustment ratio of each of at least one pixel in the image according to a distance from a virtual light source, and adjust a brightness of the at least one pixel in the image. ### Claim 18 (depends on 17) The electronic device of claim 17, wherein the memory is further configured to store an instruction that when executed, further configures the at least one processor to: determine a characteristic of the virtual light source, adjust an attribute of the at least one pixel in the image according to the virtual light source, and display the image including the at least one pixel. ### Claim 19 (depends on 17) The electronic device of claim 17, wherein the memory is further configured to store an instruction that when executed, further configures the at least one processor to: detect posture information on the facial area, adjust an attribute of each of at least one pixel in the image according to a position of the virtual light source adjusted based on the detected posture information, and display the image including the at least one pixel. ### Claim 20 A method for an electronic device, the method comprising: obtaining an image; displaying the image on a display of the electronic device; receiving, while displaying the image, a first command to apply a first virtual light source effect on the image; in response to receiving the first command, adjusting a pixel value of a first part of pixels of the image as if a virtual light source is positioned at a first position; receiving, while displaying the image, a second command to apply a second virtual light source effect on the image; and in response to receiving the second command, adjusting a pixel value of a second part of pixels of the image as if the virtual light source is positioned at a second position different from the first position. ### Claim 21 (depends on 20) The method of claim 20, further comprising: adjusting each pixel value based on a distance between the virtual light source and each of the pixels. ### Claim 22 (depends on 20) The method of claim 20, wherein the adjusting of the pixel value of the first part of pixels of the image further comprises: adjusting a brightness of the first part of pixels in the image; and displaying the image based on at least one of a determined brightness, color, or color temperature of the virtual light source. ### Claim 23 (depends on 20) The method of claim 20, further comprising: displaying an user interface for guidance of at least one of position or direction of an object being included in the image. ### Claim 24 An electronic device, comprising: a display; and at least one processor electrically connected to the display, wherein the at least one processor is configured to: obtain an image, display the image on a display of the electronic device, receive, while displaying the image, a first command to apply a first virtual light source effect on the image, in response to receiving the first command, adjust a pixel value of a first part of pixels of the image as if a virtual light source is positioned at a first position, receive, while displaying the image, a second command to apply a second virtual light source effect on the image, and in response to receiving the second command, adjust a pixel value of a second part of pixels of the image as if the virtual light source is positioned at a second position different from the first position. ### Claim 25 (depends on 24) The electronic device of claim 24, wherein the at least one processor is further configured to adjust each pixel value based on a distance between the virtual light source and each of the pixels. ### Claim 26 (depends on 24) The electronic device of claim 24, wherein the at least one processor is further configured to: adjust a brightness of the first part of pixels in the image, and display the image based on at least one of a determined brightness, color, or color temperature of the virtual light source. ### Claim 27 (depends on 24) The electronic device of claim 24, wherein the at least one processor is further configured to display a user interface for guidance of at least one of position or direction of an object included in the image.