Method and electronic device for determining user's hand in video

An electronic device for determining hands of a user in a video, the electronic device comprising:

• at least one camera;
• a memory configured to store one or more instructions;
• and
• at least one processor configured to execute the one or more instructions stored in the memory to:
• obtain a video comprising a plurality of frames, by using the at least one camera,
• estimate a field of view (FoV) trajectory indicating movements of a FoV of the at least one camera, by using the frames of the video,
• detect feature points of one or more objects in each of the frames of the video,
• estimate object trajectories indicating movements of the one or more objects, based on the feature points of the one or more objects,
• determine hand candidates of a user from among the one or more objects, based on the FoV trajectory of the camera and the object trajectories,
• obtain a head movement trajectory indicating movements of a head of the user,
• determine a hand of the user, based on the head movement trajectory and the object trajectories corresponding to the hand candidates of the user, and
• track the determined hand of the user in the video and recognize a gesture.