Display apparatus for performing voice control and voice controlling method thereof
AssigneeSamsung Electronics Co., Ltd.
InventorsSang-jin Han, Eun-hee Park
Life of this patent
Estimating the term…
Abstract
A display apparatus and a voice controlling method thereof are provided. The voice controlling method includes receiving a voice of a user; converting the voice into text; and sequentially changing and applying a plurality of different determination criteria to the text until a control operation corresponding to the text is determined; and performing the determined control operation to control the display apparatus.
Claims28
A voice controlling method of a display apparatus, the voice controlling method comprising:
- receiving a voice of a user;
- converting the voice into text;
- determining a control operation corresponding to the text by sequentially applying a plurality of different determination criteria to the text;
- and
- performing the control operation to control the display apparatus,
- wherein the plurality of different determination criteria comprise criteria of whether the text corresponds to a title of an object displayed on a screen of the display apparatus, and whether the text corresponds to a stored command, a criterion of whether the text corresponds to a title of an object displayed on a screen of the display apparatus being applied before a criterion of whether the text corresponds to a stored command, and
- wherein the determining the control operation comprises:
- determining whether the text corresponds to the title of the object;
- in response to determining that the text corresponds to the title of the object, determining the control operation based on the object;
- in response to determining that the text does not correspond to the title of the object, determining whether the text corresponds to the stored command;
- and
- in response to determining that the text corresponds to the stored command, determining an operation corresponding to the stored command as the control operation.
A display apparatus comprising:
- a voice input circuit configured to receive a voice of a user;
- a voice converter configured to convert the voice into text;
- a storage configured to store a plurality of determination criteria that are different from one another;
- and
- a controller configured to determine a control operation corresponding to the text by sequentially applying a plurality of different determination criteria to the text, and perform the control operation,
- wherein the plurality of different determination criteria comprise criteria of whether the text corresponds to a title of an object displayed on a screen of the display apparatus, and whether the text corresponds to a stored command, a criterion of whether the text corresponds to a title of an object displayed on a screen of the display apparatus being applied before a criterion of whether the text corresponds to a stored command, and
- wherein the controller is further configured to determine whether the text corresponds to the title of the object, determine the control operation based on the object in response to determining that the text corresponds to the title of the object, determine whether the text corresponds to the stored command in response to determining that the text does not correspond to the title of the object, and determine an operation corresponding to the stored command as the control operation in response to determining that the text corresponds to the stored command.
A display device comprising:
- a display;
- a voice receiving unit configured to receive a voice input from a user;
- and
- at least one processor configured to:
- control the display to display at least one object on a screen of the display;
- receive, via the voice receiving unit, the voice input while the at least one object is displayed on the screen of the display;
- obtain text resulting from processing the received voice input;
- identify an operation of the display device corresponding to the voice input based on whether the obtained text corresponds to text that is displayed on the screen of the display and associated with any of the at least one object displayed on the screen of the display and whether the obtained text matches any of instructions for controlling the display device;
- based on identifying that the obtained text corresponds to the text that is displayed on the screen of the display and associated with an object displayed on the screen of the display, control the display to display a content corresponding to the object displayed on the screen of the display. the object including a thumbnail image indicating the content, wherein the text that is displayed on the screen of the display and associated with the object is at least a portion of a title of the content;
- and
- based on identifying that the obtained text does not correspond to text that is displayed on the screen of the display and associated with any of the at least one object displayed on the screen of the display and that the obtained text matches an instruction among the instructions for controlling the display device, perform an operation of the display device corresponding to the obtained text by executing the instruction, and control the display to display, on the screen of the display, a user interface indicating a result of performing the operation of the display device corresponding to the obtained text together with the at least one object,
- wherein the at least one processor is further configured to identify whether the obtained text corresponds to text that is displayed on the screen of the display and associated with any of the at least one object before identifying whether the obtained text matches any of the instructions.
A method of a display device, comprising:
- displaying at least one object on a screen of a display;
- receiving a voice input while the at least one object is displayed on the screen of the display;
- obtaining text resulting from processing the received voice input;
- identifying an operation of the display device corresponding to the voice input based on whether the obtained text corresponds to text that is displayed on the screen of the display and associated with an object among the at least one object displayed on the screen of the display and whether the obtained text matches any of instructions for controlling the display device;
- based on identifying that the obtained text corresponds to the text that is displayed on the screen of the display and associated with the object displayed on the screen of the display, controlling the display to display a content corresponding to the object displayed on the screen of the display, the object including a thumbnail image indicating the content, wherein the text that is displayed on the screen of the display and associated with the object is at least a portion of a title of the content;
- and
- based on identifying that the obtained text does not correspond to text that is displayed on the screen of the display and associated with any of the at least one object displayed on the screen of the display and that the obtained text matches an instruction among the instructions for controlling the display device;
- performing an operation of the display device corresponding to the obtained text by executing the instruction;
- and controlling the display to display, on the screen of the display, a user interface indicating a result of performing the operation of the display device corresponding to the obtained text together with the at least one object,
- wherein identifying whether the obtained text corresponds to text that is displayed on the screen of the display and associated with any of the at least one object is performed before identifying whether the obtained text matches any of the instructions.
A computer readable medium which includes a program for executing a method of a display device, comprising:
- receiving a voice input while at least one object is displayed on a screen of a display;
- obtaining text resulting from processing the received voice input;
- identifying an operation of the display device corresponding to the voice input based on whether the obtained text corresponds to text that is displayed on the screen of the display and associated with an object among the at least one object displayed on the screen of the display and whether the obtained text matches any of instructions for controlling the display device;
- based on identifying that the obtained text corresponds to the text that is displayed on the screen of the display and associated with the object displayed on the screen of the display, controlling the display to display a content corresponding to the object displayed on the screen of the display, the object including a thumbnail image indicating the content, wherein the text that is displayed on the screen of the display and associated with the object is at least a portion of a title of the content;
- and
- based on identifying that the obtained text does not correspond to text that is displayed on the screen of the display and associated with any of the at least one object displayed on the screen of the display and that the obtained text matches an instruction among the instructions for controlling the display device, performing an operation of the display device corresponding to the obtained text by executing the instruction;
- and controlling the display to display, on the screen of the display, a user interface indicating a result of performing the operation of the display device corresponding to the obtained text together with the at least one object,
- wherein identifying whether the obtained text corresponds to text that is displayed on the screen of the display and associated with any of the at least one object is performed before identifying whether the obtained text matches any of the instructions.
Dependencies are inferred from the claim text.