Electronic device and method for providing store payment service

An electronic device for providing store payment service comprising:

• a processor;
• and a memory operatively coupled to the processor, wherein the memory, when executed, causes the processor to receive a plurality of image data from a plurality of image sensors in the store, generate a plurality of 2D pose data by estimating a joint position of each of at least one user and a posture of each of the at least one user for each of the plurality of image data based on that the at least one user is included in the plurality of image data, combine each of the plurality of 2D pose data to generate 3D pose data for each of the at least one user that matches each of the at least one user, and generate tracking data for tracking the 3D pose data for each of the at least one user according to a movement of each of the at least one user in the store, according to lapse of time and the tracking data comprises information about movement of the 3D pose data and time information, identify trigger data including a trigger time point at which a trigger, in which at least one of a plurality of products displayed in the store is removed from a shelf or added to the shelf, is generated, and a position where the trigger is generated, and a weight change detected by a weight sensor connected to the shelf, according to lapse of time and the tracking data comprises information about movement of the 3D pose data and time information, identify at least one of the plurality of products related to the trigger by:
• identifying shelf image data at the trigger time point for the shelf related to the trigger, wherein the shelf image data includes first shelf image data at a start of a second time period and second shelf image data at an end of the second time period;
• identifying product detection image data related to the user candidate group in a first time period;
• and identifying a first product using at least one of a first product identification method and a second product identification method, wherein the first product identification method estimates a product change position based on at least one of the trigger time point weight change and a comparison result between the first shelf image data and the second shelf image data, calculates a second reliability for each of the first product and a second product as product candidates based on the product change position where and the trigger weight change, and identifies that the at least one of the plurality of products includes the first product based on the second reliability, and wherein the second product identification method estimates whether the product is generated changed based on at least one of a result of identifying the type and the number of products held by each of the user candidate groups and the comparison result, on the basis of the product detection image data, calculates the second reliability for each of the first product and the second product based on whether the product is changed, and identifies that the at least one of the plurality of products includes the first product based on the second reliability, identify first tracking data of the tracking data corresponding to a the first time period including the trigger time point, identify a user candidate group for at least some of the at least one user based on the first tracking data, calculate a first reliability for each of the at least some users included in the user candidate group, identify that a user related to the trigger is a first user based on the first reliability, and store instructions for performing an update related to the trigger for a virtual shopping cart of the first user.