Back to results
US 9,866,912 B2Granted
Method, apparatus, and system for implementing a natural user interface
AssigneeVerizon Patent and Licensing Inc.
InventorsArjun Baskaran, Sankar Ram Dhanabalan
Life of this patent
Estimating the term…
Abstract
A method, apparatus, and system are disclosed for controlling a set-top box based on natural input from a user through various types of devices. Input devices are used to collect sensor data that represents natural user input for controlling the set-top box. The sensor data is parsed in order to identify the natural user input, and a user interface event is generated based on the natural user input. The user interface event is one that is supported by the set-top box. The user interface event is subsequently communicated to the set-top box.
Claims21
A method comprising:
- continuously receiving, at a connection layer of an input translation platform, a stream of sensor data from an input device, wherein the stream of sensor data includes a user input for controlling a set-top box;
- parsing, by a gesture layer of the input translation platform, the stream of sensor data to identify the user input;
- generating, by the gesture layer and using a natural user interface (NUI) library, one or more user interface events supported by the set-top box based on the user input, wherein each user interface event corresponds to a particular command to be input to the set-top box based on a current state of the set-top box, and wherein the current state of the set-top box is based on content currently being displayed on a display connected to the set-top box, wherein the NUI library stores a plurality of motion data and sound data to allow a plurality of types of input devices to interact with the set-top box;
- identifying, by the gesture layer, a user interface region associated with the set-top box, wherein the user interface region is associated with the current state of the set-top box, and wherein the user interface region is identified based on a previous registration of the user interface region;
- mapping, by the gesture layer, a user interface event of the one or more user interface events to the user interface region of the set-top box based on the current state of the set-top box;
- and
- communicating, by the connection layer, the user interface event to the set-top box, wherein the set-top box outputs results of the user interface event to the display.
4 more elements
An apparatus comprising:
- a plurality of processors configured to:
- continuously receive, at a connection layer, a stream of sensor data from an input device, wherein the stream of sensor data includes a user input for controlling a set-top box;
- parse, by a gesture layer, the stream of sensor data to identify the user input;
- generate, by the gesture layer and using a natural user input (NUI) library, one or more user interface events supported by the set-top box based on the user input, wherein each user interface event corresponds to a particular command to be input to the set-top box based on a current state of the set-top box, and wherein the current state of the set-top box is based on content currently being displayed on a display connected to the set-top box, wherein the NUI library stores a plurality of motion data and sound data to allow a plurality of types of input devices to interact with the set-top box;
- identify, by the gesture layer, a user interface region associated with the set-top box, wherein the user interface region is associated with the current state of the set-top box, and wherein the user interface region is identified based on a previous registration of the user interface region;
- map, by the gesture layer, a user interface event of the one or more user interface events to the user interface region of the set-top box based on the current state of the set-top box;
- and
- communicate, by the connection layer, the user interface event to the set-top box, wherein the set-top box outputs results of the user interface event to the display.
5 more elements
A system comprising:
- a set-top box;
- and
- an input translation platform including:
- a connection layer,
- a natural user interface (NUI) library that stores a plurality of motion data and sound data to allow a plurality of types of input devices to interact with the set-top box, and
- a gesture layer,
- the input translation platform configured to:
- receive, at the connection layer and from an input device, a stream of data,
- wherein the stream of data represents a user input for controlling the set-top box,
- parse, by the gesture layer, the stream of data to identify the user input,
- generate, by the gesture layer and using the NUI library, one or more user interface events supported by the set-top box based on the user input, wherein each user interface event corresponds to a particular command to be input to the set-top box based on a current state of the set-top box, and wherein the current state of the set-top box is based on content currently being displayed on a display connected to the set-top box,
- identify, by the gesture layer, a user interface region corresponding to a current state of the set-top box, wherein the user interface region is identified based on a previous registration of the user interface region,
- map, by the gesture layer, a user interface event of the one or more user interface events to the user interface region based on the current state of the set-top box, and
- communicate, by the gesture layer, the user interface event to the set-top box,
- wherein the set-top box outputs results of the user interface event to the display.
12 more elements
Dependencies are inferred from the claim text.