# US 11,113,523 B2 · Method for recognizing a specific object inside an image and electronic device thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,113,523 B2 - Document ID: US11113523B2 - Status: Granted - Kind: B2 - Application number: 16/169,127 - Filed: 2018-10-24 - Published: 2019-02-21 - Granted: 2021-09-07 - Earliest claimed: 2013-11-22 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Dong-Il Son; Cheol-Ho Cheong - Web page: https://patentgrep.com/patent/US11113523B2 ## CPC - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06V 10/17: {using hand-held instruments} - G06V 10/235: {based on user input or interaction} - G06V 20/00: Scenes; Scene-specific elements (control of digital cameras H04N23/60) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A method and an apparatus for recognizing a specific object inside an image in an electronic device are provided. The method includes displaying at least one image; detecting at least one gesture; selecting a recognition function related to at least one object existing in the at least one image according to the detected at least one gesture; and recognizing the at least one object using the selected recognition function. ## Claims ### Claim 1 A portable communication device comprising: a display; and a processor configured to: display a photographic image including an object via the display, the displayed object including first information corresponding to a first information type and second information corresponding to a second information type; receive, via the display, a user input with respect to the displayed object; based at least in part on a determination that the user input is received with respect to the first information, display, via the display, a first recognition outcome generated using a first recognition function corresponding to the first information type; and based at least in part on a determination that the user input is received with respect to the second information, display, via the display, a second recognition outcome generated using a second recognition function corresponding to the second information type. ### Claim 2 (depends on 1) The portable communication device of claim 1, wherein the processor is further configured to: identify a text as at least part of the first information type; and identify a non-textual object as at least part of the second information type. ### Claim 3 (depends on 1) The portable communication device of claim 1, wherein the processor is further configured to: perform the displaying of the first recognition outcome generated using an optical character reader function as at least part of the first recognition function. ### Claim 4 (depends on 1) The portable communication device of claim 1, wherein the processor is further configured to: perform the displaying of the second recognition outcome generated using an image recognition function as at least part of the second recognition function. ### Claim 5 (depends on 1) The portable communication device of claim 1, wherein the second information includes a quick response code, and wherein the processor is further configured to: perform the displaying of the second recognition outcome generated using a code recognition function as at least part of the second recognition function. ### Claim 6 (depends on 1) The portable communication device of claim 1, wherein the processor is further configured to: display a menu with a corresponding recognition outcome of the first recognition outcome and the second recognition outcome, the menu indicative of one or more functions related to a corresponding information type of the first information type and the second information type. ### Claim 7 (depends on 6) The portable communication device of claim 6, wherein the processor is further configured to: display, as at least part of the menu, an icon indicative of a corresponding function of the one or more functions. ### Claim 8 (depends on 1) The portable communication device of claim 1, wherein the display includes a touchscreen display, wherein the processor is further configured to: determine a corresponding one of the first information and the second information from the displayed object based at least in part on a position in the touchscreen display at which the user input is detected. ### Claim 9 (depends on 1) The portable communication device of claim 1, wherein the user input includes a user gesture, and wherein the processor is further configured to: select a corresponding one of the first information and the second information from the displayed object based at least in part on the user gesture. ### Claim 10 (depends on 1) The portable communication device of claim 1, wherein a corresponding one of the first recognition function and the second recognition function is selected from a plurality of recognition functions. ### Claim 11 (depends on 10) The portable communication device of claim 10, further comprising: a memory configured to store the plurality of recognition functions, and wherein the processor is further configured to: select a corresponding one of the first recognition function and the second recognition function from the plurality of recognition functions stored in the memory. ### Claim 12 A portable communication device comprising: a display; and a processor configured to: display a photographic image including an object via the display; based at least in part on a determination that the displayed object includes first information corresponding to a first information type, display, via the display, a first recognition outcome generated using a first recognition function corresponding to the first information type; and based at least in part on a determination that the displayed object includes second information corresponding to a second information type, display, via the display, a second recognition outcome generated using a second recognition function corresponding to the second information type. ### Claim 13 (depends on 12) The portable communication device of claim 12, wherein the processor is further configured to: identify a text as at least part of the first information type; and identify a non-textual object as at least part of the second information type. ### Claim 14 (depends on 12) The portable communication device of claim 12, wherein the processor is further configured to: perform the displaying of the first recognition outcome generated using an optical character reader function as at least part of the first recognition function. ### Claim 15 (depends on 12) The portable communication device of claim 12, wherein the processor is further configured to: perform the displaying of the second recognition outcome generated using an image recognition function as at least part of the second recognition function. ### Claim 16 (depends on 12) The portable communication device of claim 12, wherein the second information includes a quick response code, and wherein the processor is further configured to: perform the displaying of the second recognition outcome generated using a code recognition function as at least part of the second recognition function. ### Claim 17 (depends on 12) The portable communication device of claim 12, wherein the processor is further configured to: display a menu with a corresponding recognition outcome of the first recognition outcome and the second recognition outcome, the menu indicative of one or more functions related to a corresponding type of the first information type and the second information type. ### Claim 18 (depends on 12) The portable communication device of claim 12, wherein the display includes a touchscreen display, and wherein the processor is further configured to: receive, via the display, a user input with respect to the display object; and in response to the receiving the user input, determine the displayed object based at least in part on a position in the touchscreen display at which the user input is detected. ### Claim 19 A non-transitory machine-readable storage device storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising: displaying, via a display operatively coupled with the one or more processors, a photographic image including an object, the displayed object including first information corresponding to a first information type and second information corresponding to a second information type; receiving a user input with respect to the displayed object, via the display; based at least in part on a determination that the user input is received with respect to the first information, displaying, via the display, a first recognition outcome generated using a first recognition function corresponding to the first information type; and based at least in part on a determination that the user input is received with respect to the second information, displaying, via the display, a second recognition outcome generated using a second recognition function corresponding to the second information type. ### Claim 20 (depends on 19) The non-transitory machine-readable storage device of claim 19, wherein the operations further comprise: displaying a menu with a corresponding recognition outcome of the first recognition outcome and the second recognition outcome, the menu indicative of one or more functions related to a corresponding information type of the first information type and the second information type. ### Claim 21 A portable communication device comprising: a camera; a display; and a processor configured to: control the camera to capture an image, display the captured image including an object via the display, the displayed object including a first image portion and a second image portion, receive, via the display, a user input with respect to the displayed object, based at least in part on a determination that the user input is received with respect to the first image portion, display, via the display, a first set of user interface items for executing functions relating to the first image portion, wherein the first set of user interface items is displayed in response to a first type of image recognition function being applicable to the first image portion, and based at least in part on a determination that the user input is received with respect to the second image portion, display, via the display, a second set of user interface items for executing functions relating to the second image portion, wherein the second set of user interface items is displayed in response to a second type of image recognition function being applicable to the second image portion. ### Claim 22 (depends on 21) The portable communication device of claim 21, wherein the first type of image recognition function corresponds to an object recognition function, and the second type of image recognition function correspond to a character recognition function. ### Claim 23 (depends on 21) The portable communication device of claim 21, wherein the first image portion corresponds to first information and the second image portion corresponds to second information, and wherein a first recognition result is generated based on the first information, and a second recognition result is generated based on the second information. ### Claim 24 (depends on 23) The portable communication device of claim 23, wherein a first item corresponding to the first recognition result is displayed with the first set of user interface items, and wherein a second item corresponding to the second recognition result is displayed with the second set of user interface items. ### Claim 25 (depends on 24) The portable communication device of claim 24, wherein at least one first item further comprises an icon indicative of a function using the first information. ### Claim 26 (depends on 21) The portable communication device of claim 21, wherein a non-textual object is identified from the first image portion via the first type of image recognition function, and wherein one or more character is identified from the second image portion via the second type of image recognition function. ### Claim 27 (depends on 26) The portable communication device of claim 26, wherein the processor is further configured to: control the display to display a first result, wherein the first result is obtained based on the identified non-textual object; and control the display to display a second result, wherein the second result is obtained based on the identified one or more character. ### Claim 28 (depends on 21) The portable communication device of claim 21, wherein the second image portion comprises a quick response code, and wherein the processor is further configured to: control the display to display a third recognition result, the third result is obtained, via a code recognition function, based on the quick response code. ### Claim 29 (depends on 21) The portable communication device of claim 21, further comprising a memory configured to store the plurality of recognition functions, wherein the processor is further configured to select a corresponding one of the first type of image recognition function and the second type of image recognition function from the plurality of recognition functions stored in the memory. ### Claim 30 (depends on 21) The portable communication device of claim 21, wherein the display includes a touchscreen display, and wherein the processor is further configured to determine a corresponding one of the first image portion and the second image portion from the displayed object based at least in part on a position on the touchscreen display at which the user input is detected.