Video conversion to extended reality (XR) instructions with haptic feedback

Abstract

A system and method for generating extended reality videos and using the extended reality videos to provide instructions for physical tasks is disclosed. Specifically, the embodiments allow a user to request extended reality guidance for a given physical task. The system and method retrieve corresponding guidance videos and convert the guidance videos into an extended reality format. The converted videos are provided to a user, and embodiments track the user's movements as the user performs the given physical task. The correctness of the tracked user movements is confirmed. Embodiments provide feedback to the user based on the confirmed correctness of the user movements. For example, the feedback may include at least one of visual feedback, auditory feedback, and haptic feedback, and the feedback may help the user correct incorrect movements.

Dependencies are inferred from the claim text.