Back to results
US 2020/0089388 A1Published application
Multimodal 3d object interaction system
AssigneeAlibaba Group Holding Limited
InventorsPaul FU, Xiaohu DONG, Rui YANG, Chen ZHAO, JinRyong KIM, Xiangchao HUANG, Stephanie CHAN, Qing YU, Puhe LIANG, Shenli YUAN
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to methods and systems for providing a multimodal 3D object interaction to let the user interact with 3D digital object in a natural and realistic way.
Claims20
A 3D object interaction system comprising:
- a displayer configured to display at least one object in a 3 dimension (3D) view;
- an eye tracker configured to track a position and an angle of a user's eye;
- a motion sensor configured to track a user's movement in mid-air;
- and
- a computing device having circuitry to:
- determine whether the user's movement matches a predetermined gesture interaction;
- cause a feedback provider to generate at least one feedback according to the predetermined gesture interaction when the user's movement matches the predetermined gesture interaction;
- and
- cause the displayer to adjust the object displayed on the displayer according to the position and angle of the user's eye or when the user's movement matches the predetermined gesture interaction.
6 more elements
A 3D object interaction method comprising:
- displaying at least one object in a 3 dimension (3D) view on a displayer;
- tracking a position and an angle of a user's eye and a user's movement in mid-air;
- determining whether the user's movement matches a predetermined gesture interaction;
- generating at least one feedback according to the predetermined gesture interaction when the user's movement matches the predetermined gesture interaction;
- and
- adjusting the object displayed on the displayer according to the position and angle of the user's eye or when the user's movement matches the predetermined gesture interaction.
3 more elements
A non-transitory computer readable medium that stores a set of instructions that is executable by at least one processor of a computing device to cause the computing device to perform a 3D object interaction method, the method comprising:
- determining whether a user's movement in mid-air matches a predetermined gesture interaction;
- causing a feedback provider to generate at least one feedback according to the predetermined gesture interaction when the user's movement matches the predetermined gesture interaction;
- and
- causing a displayer to adjust at least one object displayed on the displayer according to a position and an angle of a user's eye or when the user's movement matches the predetermined gesture interaction,
- wherein the user's movement is recognized based on user's movement tracking information and the position and angle of the user's eye is recognized based on user's eye tracking information.
2 more elements
Dependencies are inferred from the claim text.