Personalized calibration of user interfaces
AssigneeSnap Inc.
InventorsLinhui Ge, Katie Lu
Life of this patent
Estimating the term…
Abstract
An augmented reality (AR) calibration process for an eyewear device that customizes an AR user interface (UI) for the wearer. Physiological characteristics such as arm length and hand size are determined from images captured by the eyewear device for use in adjusting the UI controls before rendering the UI.
Claims20
A method of calibrating a user interface (UI) of an eyewear device, comprising:
- placing all UI elements locked to a position of a user in a UI view of the eyewear device;
- detecting, within captured images from a camera, a predetermined calibration gesture formed by at least one appendage of a user;
- determining, using arm tracking landmarks of the user, a maximum distance that the user can reach;
- determining, using hand tracking landmarks of the user, hand size parameters of the user;
- storing the maximum distance that the user can reach and the hand size parameters in a parameter memory;
- adjusting, using a set position instruction and the stored maximum distance, a position of elements of the UI relative to a camera position of the eyewear device to place the UI elements within the user's reach;
- and
- adjusting, using a set scale instruction and the user's hand size parameters, sizes and positions of the UI elements relative to each other.
An eyewear device, comprising:
- a display that presents a user interface (UI);
- a camera that captures images;
- a memory that stores instructions;
- a parameter memory;
- and
- a processor coupled to the display, the camera, and the memory, wherein the processor executes the instructions to configure the eyewear device to:
- place all UI elements locked to a position of a user in a UI view of the eyewear device;
- detect, within the captured images from the camera, a predetermined calibration gesture formed by at least one appendage of a user;
- determine, using arm tracking landmarks of the user, a maximum distance that the user can reach;
- determine, using hand tracking landmarks of the user, hand size parameters of the user;
- store the maximum distance that the user can reach and the hand size parameters in the parameter memory;
- adjust, using a set position instruction and the stored maximum distance, a position of elements of the UI relative to a camera position of the eyewear device to place the UI elements within the user's reach;
- and
- adjust, using a set scale instruction and the user's hand size parameters, sizes and positions of the UI elements relative to each other.
A non-transitory computer-readable storage medium that stores instructions that when executed by at least one processor cause the at least one processor to calibrate a user interface (UI) of an eyewear device by performing operations including:
- placing all user UI locked to a position of a user in a UI view of the eyewear device;
- detecting, within captured images from a camera, a predetermined calibration gesture formed by at least one appendage of a user;
- determining, using arm tracking landmarks of the user, a maximum distance that the user can reach;
- determining, using hand tracking landmarks of the user, hand size parameters of the user;
- storing the maximum distance that the user can reach and the hand size parameters in a parameter memory;
- adjusting, using a set position instruction and the stored maximum distance, a position of elements of the UI relative to a camera position of the eyewear device to place the UI elements within the user's reach;
- and
- adjusting, using a set scale instruction and the user's hand size parameters, sizes and positions of the UI elements relative to each other.
Dependencies are inferred from the claim text.