Spatiotemporal smoothing for improved hand tracking

A computing system comprising:

• one or more processors;
• a non-transitory memory;
• an interface for communicating with a display device and one or more input devices;
• and
• one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the computing system to:
• obtain uncorrected hand tracking data;
• obtain a depth map associated with a physical environment;
• identify a position of a portion of the finger within the physical environment based on the depth map and the uncorrected hand tracking data;
• perform spatial depth smoothing on a region of the depth map adjacent to the position of the portion of the finger;
• and
• generate corrected hand tracking data by performing point of view (POV) correction on the uncorrected hand tracking data based on the spatially depth smoothed region of the depth map adjacent to the portion of the finger.

A non-transitory memory storing one or more programs, which, when executed by one or more processors of a computing system with an interface for communicating with a display device and one or more input devices, cause the computing system to:

• obtain uncorrected hand tracking data;
• obtain a depth map associated with a physical environment;
• identify a position of a portion of the finger within the physical environment based on the depth map and the uncorrected hand tracking data;
• perform spatial depth smoothing on a region of the depth map adjacent to the position of the portion of the finger;
• and
• generate corrected hand tracking data by performing point of view (POV) correction on the uncorrected hand tracking data based on the spatially depth smoothed region of the depth map adjacent to the portion of the finger.