# US 11,443,135 B2 · Method for monitoring object and electronic device for supporting the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,443,135 B2 - Document ID: US11443135B2 - Status: Granted - Kind: B2 - Application number: 16/787,264 - Filed: 2020-02-11 - Published: 2020-08-13 - Granted: 2022-09-13 - Earliest claimed: 2019-02-12 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Minsung Jung; Mihyun Jeong; Woocheol Jung; Seungnyun Kim; Changryong Heo - Web page: https://patentgrep.com/patent/US11443135B2 ## CPC - G06V 20/20: in augmented reality scenes - G06F 18/40: Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor - G06V 10/945: {User interactive design; Environments; Toolboxes} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An electronic device according to certain embodiments may include a camera, a memory, and at least one processor, wherein the at least one processor is configured to: obtain an image through the camera; obtain an image of at least one object from the obtained image; determine whether the image of the at least one object corresponds to an image of an object stored in the memory; output about a request for information about the at least one object, based at least in part on the determination; and obtain the information about the at least one object, based at least in part on information received from an external source. ## Claims ### Claim 1 An electronic device comprising: a camera; a memory; and at least one processor, wherein the at least one processor is configured to: obtain an image through the camera; obtain an image of at least one object from the obtained image; determine whether the image of the at least one object corresponds to an image of an object stored in the memory; when it is determined that the image of the at least one object does not correspond to the image of the object stored in the memory, output a request for information about the at least one object to an external source; and obtain the information on the at least one object, based at least in part on information received from the external source. ### Claim 2 (depends on 1) The electronic device of claim 1, further comprising: a speaker; and a microphone, wherein the at least one processor is configured to output the request for the information about the at least one object, through the speaker, and obtain the information about the at least one object, based at least in part on information received through the microphone. ### Claim 3 (depends on 1) The electronic device of claim 1, further comprising a display, wherein the at least one processor is configured to request for the information about the at least one object, through the display, and obtain the information about the at least one object, based at least in part on information received from the external source. ### Claim 4 (depends on 1) The electronic device of claim 1, further comprising a communication unit, wherein the at least one processor is configured to: transmit the request for the information about the at least one object to an external electronic device using the communication unit; and obtain the information about the at least one object, based at least in part on information received from the external electronic device by the communication unit. ### Claim 5 (depends on 1) The electronic device of claim 1, wherein the at least one processor is configured to: when the at least one object is not the same as the object stored in the memory, store the information about the at least one object in the memory; and when the at least one object is the same as the object stored in the memory, update information about the object stored in the memory. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the at least one processor is configured to obtain an image of a plurality of objects from the obtained image, and store a relation between at least two objects among the plurality of objects. ### Claim 7 (depends on 6) The electronic device of claim 6, further comprising a display, wherein the at least one processor is configured to: display a guide for allowing selection of each of image portions of the plurality of objects, through the display; and associate at least two objects, based at least in part on an input for selecting image portions of the at least two objects from among the image portions of the plurality of objects. ### Claim 8 (depends on 6) The electronic device of claim 6, wherein the at least one processor is configured to, when the relation between the at least two objects is changed, perform a function corresponding to the changed relation. ### Claim 9 (depends on 1) The electronic device of claim 1, wherein the at least one processor is configured to determine a priority between a plurality of objects stored in the memory, and configure monitoring one or more objects among the plurality of objects, based at least in part on the priority. ### Claim 10 A method comprising: obtaining an image through a camera; obtaining an image of at least one object from the obtained image; determining whether the image of the at least one object corresponds to an image of an object stored in a memory; when it is determined that the image of the at least one object does not correspond to the image of the object stored in the memory, outputting a request for information about the at least one object to an external source; and obtaining the information about the at least one object, based at least in part on information received from the external source. ### Claim 11 (depends on 10) The method of claim 10, wherein the outputting the request for the information about the at least one object comprises outputting the request for the information about the at least one object, through a speaker, and the obtaining of the information about the at least one object comprises obtaining the information about the at least one object, based at least in part on information received through a microphone. ### Claim 12 (depends on 10) The method of claim 10, wherein the outputting the request for the information about the at least one object comprises transmitting, to an external electronic device, the request for the information about the at least one object, using a communication unit, and the obtaining of the information about the at least one object comprises obtaining the information about the at least one object, based at least in part on information received from the external electronic device through the communication unit. ### Claim 13 (depends on 10) The method of claim 10, wherein the obtaining of the information about the at least one object comprises: when the at least one object is not the same as the object stored in the memory, registering the information about the at least one object in the memory; and when the at least one object is the same as the object stored in the memory, updating information about the object stored in the memory. ### Claim 14 (depends on 10) The method of claim 10, wherein the obtaining of the image comprises obtaining an image of a plurality of objects from the obtained image, and further comprises storing a relation between at least two objects among the plurality of objects. ### Claim 15 (depends on 14) The method of claim 14, further comprising: displaying a guide for allowing selection of each of image portions of the plurality of objects, through a display; and associating the at least two objects, based at least in part on an input for selecting image portions of the at least two objects from among the image portions of the plurality of objects. ### Claim 16 (depends on 14) The method of claim 14, further comprising when the relation between the at least two objects is changed, performing a function corresponding to the changed relation. ### Claim 17 (depends on 10) The method of claim 10, further comprising: determining a priority between a plurality of objects stored in the memory; and configuring monitoring one or more objects among the plurality of objects, based at least in part on the priority. ### Claim 18 A computer-readable recording medium on which programs executable by a computer are recorded, the programs being executed by the computer and comprising: obtaining an image through a camera; obtaining an image of at least one object from the obtained image; determining whether the image of the at least one object corresponds to an image of an object stored in a memory; when it is determined that the image of the at least one object does not correspond to the image of the object stored in the memory, outputting a request for information about the at least one object to an external source; and obtaining the information about the at least one object, based at least in part on information received from the external source.