Fingerspelling text entry
AssigneeSnap Inc.
InventorsAustin Vaday, Rebecca Jean Lee, Jennica Pounds
Life of this patent
Estimating the term…
Abstract
A text entry process for an Augmented Reality (AR) system. The AR system detects, using one or more cameras of the AR system, a start text entry gesture made by a user of the AR system. During text entry, the AR system detects, using the one or more cameras, a symbol corresponding to a fingerspelling sign made by the user. The AR system generates entered text data based on the symbol and provides text in a text scene component of an AR overlay provided by the AR system to the user based on the entered text data.
Claims20
A machine-implemented method comprising:
- determining, by an AR system, a language model based on registration data of an AR application, the registration data including an ID field identifying the AR application, a language field identifying the language model, and one or more symbol fields indicating respective one or more symbols to be routed to the AR application;
- detecting, by the AR system, using one or more cameras and the language model, one or more input symbols corresponding to one or more gestures being made by a user of the AR application;
- routing, by the AR system, the one or more input symbols to the AR application using the one or more input symbols and the one or more symbol fields of the registration data;
- and
- providing, by the AR application, a user interface using the one or more input symbols.
A machine comprising:
- at least one processor;
- and
- at least one memory storing instructions that, when executed by the at least one processor, cause the machine to perform operations comprising:
- determining, by an AR system, a language model based on registration data of an AR application, the registration data including an ID field identifying the AR application, a language field identifying the language model, and one or more symbol fields indicating respective one or more symbols to be routed to the AR application;
- detecting, by the AR system, using one or more cameras and the language model, one or more input symbols corresponding to one or more gestures being made by a user of the AR application;
- routing, by the AR system, the one or more input symbols to the AR application using the one or more input symbols and the one or more symbol fields of the registration data;
- and
- providing, by the AR application, a user interface using the one or more input symbols.
A machine-readable medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:
- determining, by an AR system, a language model based on registration data of an AR application, the registration data including an ID field identifying the AR application, a language field identifying the language model, and one or more symbol fields indicating respective one or more symbols to be routed to the AR application;
- detecting, by the AR system, using one or more cameras and the language model, one or more input symbols corresponding to one or more gestures being made by a user of the AR application;
- routing, by the AR system, the one or more input symbols to the AR application using the one or more input symbols and the one or more symbol fields of the registration data;
- and
- providing, by the AR application, a user interface using the one or more input symbols.
Dependencies are inferred from the claim text.