US 2022/0093098 A1 · ELECTRONIC APPARATUS AND CONTROL METHOD THEREOF

Abstract

A method for controlling an electronic device is provided. The method includes identifying one or more user interface (UI) elements displayed on a screen of an electronic device, determining a characteristic(s) of one or more identified UI elements, generating a data base based on the characteristic of one or more identified UI elements, where the database comprises to predict NL utterances of one or more identified UI elements, where the NL utterances are predicted based on the at least one characteristic of one or more identified UI elements, receiving a voice input of a user of the electronic device, where the voice input comprises an utterance indicative of the at least one characteristic of one or more identified UI elements presented in the database, and automatically accessing UI element(s) of one or more UI elements in response to determining that the utterances of the received voice input from the user matches with the predicted NL utterances of one or more identified UI elements.

Claims20

Dependent claims

A method for controlling an electronic device, the method comprising:

identifying at least one user interface (UI) element included in a screen of the electronic device;
identifying at least one characteristic of the identified UI element;
acquiring a database including a natural language utterance acquired based on the at least one characteristic of the identified UI element;
based on receiving a voice input, identifying whether an utterance of the received voice input matches the natural language utterance included in the acquired database;
and
based on identifying that the utterance of the voice input matches the natural language utterance, automatically accessing the at least one UI element,
wherein the at least one characteristic of the identified UI element comprises:
at least one of positions of respective UI elements, relative positions of the respective UI elements for other UI elements, functions of the respective UI elements, capabilities of the respective UI elements, types of the respective UI elements, or appearances of the respective UI elements.

5 more elements

An electronic device comprising:

a memory;
and
a processor which is connected with the memory and controls the electronic device,
wherein the processor is configured to:
identify at least one user interface (UI) element included in a screen of the electronic device,
identify at least one characteristic of the identified UI element,
acquire a database including a natural language utterance acquired based on the at least one characteristic of the identified UI element,
based on receiving a voice input, identify whether an utterance of the received voice input matches the natural language utterance included in the acquired database, and
based on identifying that the utterance of the voice input matches the natural language utterance, automatically access the at least one UI element, and wherein the at least one characteristic of the identified UI element comprises:
at least one of positions of respective UI elements, relative positions of the respective UI elements for other UI elements, functions of the respective UI elements, capabilities of the respective UI elements, types of the respective UI elements, or appearances of the respective UI elements.

7 more elements

Dependencies are inferred from the claim text.

Electronic apparatus and control method thereof

Life of this patent

Electronic apparatus and control method thereof

Life of this patent

Abstract

Claims20