Electronic device and method for providing multiple services respectively corresponding to multiple external objects included in image

An electronic device comprising:

• an image sensor;
• a display;
• a communication circuit configured to communicate with a first external electronic device and a plurality of external servers which are distinct from the first external electronic device;
• a memory configured to store a plurality of instructions;
• and
• at least one processor operably coupled to the image sensor, the display, the communication circuit, and the memory,
• wherein, when being executed, the plurality of instructions cause the at least one processor to:
• obtain a raw image from the image sensor;
• in response to the raw image being obtained, display an image based on the obtained raw image on the display;
• transmit the raw image to the first external electronic device via the communication circuit;
• receive, from the first external electronic device, classification information identifying multiple portions corresponding to a plurality of designated types within the raw image, respectively, wherein the multiple portions include a first portion of the raw image and a second portion of the raw image, and each of the first portion and the second portion of the raw image is less than an entirety of the raw image;
• in response to the multiple portions being identified, display a plurality of visual elements overlaid on the multiple portions within the displayed image, the plurality of visual elements including shapes distinct from one another according to types corresponding to the portions, which are overlaid with the plurality of visual elements, from among the plurality of designated types;
• and
• receive, from the plurality of external servers which correspond to the plurality of designated types, respectively, recognition information corresponding to the identified multiple portions, wherein the plurality of external servers include a first external server and a second external server, the recognition information includes a first recognition information and a second recognition information, the first recognition information is transmitted from the first external server to the electronic device based on an identifier of the electronic device that the first external electronic device transmitted to the first external server, and the second recognition information is transmitted from the second external server to the electronic device based on the identifier of the electronic device that the first external electronic device transmitted to the second external server;
• and
• based on the received recognition information, change display of the plurality of visual elements.

An electronic device comprising:

• an image sensor;
• a display;
• a communication circuit configured to communicate with a first external electronic device and a plurality of external servers which are distinct from the first external electronic device;
• a memory configured to store a plurality of instructions;
• and
• at least one processor operably coupled to the image sensor, the display, the communication circuit, and the memory,
• wherein, when being executed, the plurality of instructions cause the at least one processor to:
• obtain a raw image from the image sensor;
• in response to the raw image being obtained, display an image based on the raw obtained image on the display;
• transmit the raw image to the first external electronic device via the communication circuit;
• while displaying the image on the display, identify a plurality of subjects included in the image;
• in response to the plurality of subjects being identified, output a plurality of first visual elements floated on multiple portions of the displayed image, the multiple portions corresponding to the plurality of identified subjects, respectively, wherein the multiple portions include a first portion of the image and a second portion of the image, and each of the first portion and the second portion of the image is less than an entirety of the image;
• while outputting the plurality of first visual elements, identify information related to the plurality of subjects from the plurality of external servers corresponding to the plurality of subjects, respectively;
• and
• in response to the information related to the plurality of subjects being identified, output a plurality of second visual elements which are floated on the multiple portions and are based on identifiers of the plurality of external servers and at least part of the identified information,
• wherein the plurality of second visual elements are based on recognition information transmitted from plurality of external servers to the electronic device based on an identifier of the electronic device that the first external electronic device transmitted to the plurality of external servers,
• wherein the plurality of external servers include a first external server and a second external server, the recognition information includes a first recognition information and a second recognition information, the first recognition information is transmitted from the first external server to the electronic device based on the identifier of the electronic device that the first external electronic device transmitted to the first external server, and the second recognition information is transmitted from the second external server to the electronic device based on the identifier of the electronic device that the first external electronic device transmitted to the second external server.