# US 10,769,475 B2 · Method of identifying objects based on region of interest and electronic device supporting the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,769,475 B2 - Document ID: US10769475B2 - Status: Granted - Kind: B2 - Application number: 16/108,980 - Filed: 2018-08-22 - Published: 2019-02-28 - Granted: 2020-09-08 - Earliest claimed: 2017-08-22 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd - Inventors: Moojung Kim; Daehee Kim; Daekyu Shin; Sungdae Cho - Web page: https://patentgrep.com/patent/US10769475B2 ## CPC - G06T 7/11: Region-based segmentation - G06T 7/90: Determination of colour characteristics - G06V 10/235: {based on user input or interaction} - G06V 10/464: {using a plurality of salient features, e.g. bag-of-words [BoW] representations} - G06F 3/03545: {Pens or stylus} - G06F 3/0416: {Control or interface arrangements specially adapted for digitisers} - G06T 2207/10024: Color image - G06T 2207/20101: Interactive definition of point of interest, landmark or seed - G06T 2207/20104: Interactive definition of region of interest [ROI] - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An electronic device includes a display, and a processor functionally connected with the display. The processor is configured to output content including one or more objects through the display, receive user input for specifying at least one point in the entire region of the content, determine a portion of an entire region with respect to the at least one point as a search region, obtain a saliency map associated with the content based on the search region, and determine a region of interest of the user based on the saliency map. Alternatively, the processor is configured to obtain an index map associated with the content by dividing the entire region of the content into similar regions according to a preset criterion and determine the region of interest of the user by overlapping the saliency map and the index map. It is possible to provide other embodiments. ## Claims ### Claim 1 An electronic device comprising: a display; and a processor functionally connected with the display, wherein the processor is configured to: output content including one or more objects through the display; receive user input for specifying at least one point in an entire region of the content; determine a portion of the entire region with respect to the at least one point as a search region; obtain a saliency map associated with the content based on the search region; obtain an index map associated with the content by dividing the entire region of the content into similar regions according to a preset criterion; and determine a region of interest of a user based on the saliency map and the index map. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to: examine relative variations between one or more pixels constituting the content or blocks including multiple pixels; and obtain an entropy map related to the content based on the relative variations. ### Claim 3 (depends on 2) The electronic device of claim 2, wherein the processor is further configured to: divide the entropy map according to a specific criterion; identify at least one region to which the point specified by the user belongs; calculate statistical characteristics of the at least one identified region; find additional regions including statistical characteristics similar to those of the at least one identified region; and determine the search region as including the at least one identified region and the found additional regions. ### Claim 4 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to: generate a weighting matrix based on the point specified by the user; and obtain a weighted saliency map by applying the weighting matrix to at least a portion of the saliency map. ### Claim 5 (depends on 1) The electronic device of claim 1, wherein the preset criterion is at least one of color, outline, or contrast. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to identify an object according to the point specified by the user by overlapping main regions in the saliency map and similar regions in the index map. ### Claim 7 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to: provide a main region of the content as a preset region of interest; and determine, when the user input is received within the preset region of interest, a region other than the preset region of interest as a non-search region. ### Claim 8 (depends on 1) The electronic device of claim 1, wherein the processor is configured to: provide a main region of the content as a preset region of interest; and determine, when the user input is received outside the preset region of interest, at least a portion of the content including the preset region of interest as a non-search region. ### Claim 9 A method for object identification based on a region of interest, the method comprising: outputting content including one or more objects through a display; receiving user input for specifying at least one point in an entire region of the content; determining a portion of the entire region with respect to the at least one point as a search region; obtaining a saliency map associated with the content based on the search region; obtaining an index map associated with the content by dividing the entire region of the content into similar regions according to a preset criterion; and determining a region of interest of a user based on the saliency map and the index map. ### Claim 10 (depends on 9) The method of claim 9, further comprising: examining relative variations between one or more pixels constituting the content or blocks including multiple pixels; and obtaining an entropy map related to the content based on the relative variations. ### Claim 11 (depends on 10) The method of claim 10, further comprising: dividing the entropy map according to a specific criterion; identifying at least one region to which the point specified by the user belongs; calculating statistical characteristics of the at least one identified region; finding additional regions including statistical characteristics similar to those of the at least one identified region; and determining the search region as including the at least one identified region and the found additional regions. ### Claim 12 (depends on 10) The method of claim 10, further comprising: generating a weighting matrix based on the point specified by the user; and obtaining a weighted saliency map by applying the weighting matrix to at least a portion of the saliency map. ### Claim 13 (depends on 9) The method of claim 9, wherein the preset criterion is at least one of color, outline, or contrast. ### Claim 14 (depends on 9) The method of claim 9, further comprising identifying an object according to the point specified by the user by overlapping main regions in the saliency map and similar regions in the index map. ### Claim 15 (depends on 9) The method of claim 9, further comprising: providing a main region of the content as a preset region of interest; and determining, when the user input is received within the preset region of interest, a region other than the preset region of interest as a non-search region. ### Claim 16 (depends on 9) The method of claim 9, further comprising: providing a main region of the content as a preset region of interest; and determining, when the user input is received outside the preset region of interest, at least a portion of the content including the preset region of interest as a non-search region.