US 2013/0293577 A1 · INTELLIGENT TRANSLATIONS IN PERSONAL SEE THROUGH DISPLAY

Abstract

A see-through, near-eye, mixed reality display apparatus for providing translations of real world data for a user. A wearer's location and orientation with the apparatus is determined and input data for translation is selected using sensors of the apparatus. Input data can be audio or visual in nature, and selected by reference to the gaze of a wearer. The input data is translated for the user relative to user profile information bearing on accuracy of a translation and determining from the input data whether a linguistic translation, knowledge addition translation or context translation is useful.

Claims20

Dependent claims

A method for presenting a translation of a real world expression to a wearer of a see through head mounted display apparatus, comprising:

determining a gaze of a wearer looking through the see-through display of the apparatus;
determining a three dimensional location of one or more objects in the field of view of the user through the see-through display, the determining of the three dimensional location of the object is performed using the one or more sensors;
receiving a selection of data for translation in the field of view of the wearer by reference to the gaze of the wearer at one of the objects;
analyzing the data for translation to provide input data;
translating the input data into a translated form for the user;
and
rendering the translation in an audio or visual format in the see through head mounted display.

4 more elements

A method for presenting a translation of information at a location to a wearer of a see through head mounted display apparatus, comprising:

receiving from the wearer a selection of input data for translation at the location of a user by reference to the gaze of a user, including determining a gaze of a wearer looking through the see-through display apparatus, the apparatus includes one or more sensors and a see-through display;
determining three dimensional locations of objects within a field of view of the wearer at the location;
translating the input data into a translated form for the user, the translating including
retrieving user profile information bearing on accuracy of a translation;
determining from the input data whether a linguistic translation, knowledge addition translation or context translation is useful;
performing one or more of a linguistic translation, knowledge addition translation or context translation on the input data;
and
rendering the translation in an audio or visual format in the see through head mounted display.

5 more elements

Dependencies are inferred from the claim text.

Intelligent translations in personal see through display

Life of this patent

Intelligent translations in personal see through display

Life of this patent

Abstract

Claims20