Graphical user interface customization in a movable object environment
AssigneeDJI Research LLC
InventorsArnaud Thiercelin, Dhanushram Balachandran, Hai Vo, Weifeng Liu, Joshua Lafayette Austin
Life of this patent
Estimating the term…
Abstract
Techniques are disclosed for user interface management in a movable object environment. A user interface manager can request sensor data associated with a movable object from a data manager. The user interface manager can provide the sensor data to one or more user interface elements associated with the user interface element. A first rendering of the at least one user interface element can be caused to be displayed in a user interface, the first rendering determined based on a type or amount of the sensor data associated with the movable object.
Claims29
A method for providing user interface management in a movable object environment, comprising:
- registering at least one user interface element associated with a user interface manager with a data manager interface on a user device, the data manager interface providing an abstraction layer for communication between the at least one user interface element and a data manager that receives sensor data from a plurality of sensors associated with a plurality of different movable object hardware configurations;
- requesting, from the data manager on the user device, sensor data associated with a movable object, the sensor data received from a plurality of sensors on the movable object having a plurality of data formats, the data manager generating converted sensor data by reformatting the sensor data from the plurality of data formats to a common data format;
- providing the converted sensor data by the data manager interface to the at least one user interface element registered with the data manager interface asynchronously as the converted sensor data is available from the data manager, the at least one user interface element associated with a position in a first portion of a user interface where the at least one user interface element is to be rendered;
- and
- causing a first rendering of the at least one user interface element from a plurality of renderings of the at least one user interface element to be displayed at the position in the user interface, the user interface rendered on a display of the user device in wireless communication with the movable object, the first rendering determined based on a type or amount of the converted sensor data associated with the movable object and the position in the user interface, wherein the type or amount of the converted sensor data is based on a first hardware configuration of the movable object, the first hardware configuration comprising a first type or quantity of sensors coupled to the movable object, and wherein at least two of the plurality of renderings represent a data value associated with the type or amount of the converted sensor data.
A system for user interface management in a movable object environment, comprising:
- at least one movable object;
- and
- a user device including
- a display,
- one or more processors, and
- a memory that stores one or more computer-executable instructions which, when executed by the one or more processors, cause the system to:
- register at least one user interface element associated with a user interface manager with a data manager interface on the user device, the data manager interface providing an abstraction layer for communication between the at least one user interface element and a data manager that receives sensor data from a plurality of sensors associated with a plurality of different movable object hardware configurations;
- request, from the data manager on the user device, sensor data associated with the at least one movable object, the user device in wireless communication with the at least one movable object, the sensor data received from a plurality of sensors on the movable object having a plurality of data formats, the data manager generating converted sensor data by reformatting the sensor data from the plurality of data formats to a common data format;
- provide the converted sensor data by the data manager interface to the at least one user interface element registered with the data manager interface asynchronously as the converted sensor data is available from the data manager, the at least one user interface element associated with a position in a first portion of a user interface where the at least one user interface element is to be rendered;
- and
- cause a first rendering of the at least one user interface element from a plurality of renderings of the at least one user interface element to be displayed at the position in the user interface, the user interface rendered on a display of the user device in wireless communication with the movable object, the first rendering determined based on a type or amount of the converted sensor data associated with the movable object and the position in the user interface, wherein the type or amount of the converted sensor data is based on a first hardware configuration of the movable object, the first hardware configuration comprising a first type or quantity of sensors coupled to the movable object, and wherein at least two of the plurality of renderings represent a data value associated with the type or amount of the converted sensor data.
A non-transitory computer readable storage medium including instructions stored thereon which, when executed by one or more processors, cause the one or more processors to:
- register at least one user interface element associated with a user interface manager with a data manager interface on a user device, the data manager interface providing an abstraction layer for communication between the at least one user interface element and a data manager that receives sensor data from a plurality of sensors associated with a plurality of different movable object hardware configurations;
- request, from the data manager on the user device, sensor data associated with a movable object, the sensor data received from a plurality of sensors on the movable object having a plurality of data formats, the data manager generating converted sensor data by reformatting the sensor data from the plurality of data formats to a common data format;
- provide the converted sensor data by the data manager interface to the at least one user interface element registered with the data manager interface asynchronously as the converted sensor data is available from the data manager, the at least one user interface element associated with a position in a first portion of a user interface where the at least one user interface element is to be rendered;
- and
- cause a first rendering of the at least one user interface element from a plurality of renderings of the at least one user interface element to be displayed at the position in the user interface, the user interface rendered on a display of the user device in wireless communication with the movable object, the first rendering determined based on a type or amount of the converted sensor data associated with the movable object and the position in the user interface, wherein the type or amount of the converted sensor data is based on a first hardware configuration of the movable object, the first hardware configuration comprising a first type or quantity of sensors coupled to the movable object, and wherein at least two of the plurality of renderings represent a data value associated with the type or amount of the converted sensor data.
A system comprising:
- a user device including one or more processors, the user device in wireless communication with a movable object;
- a data manager, executing on the one or more processors, to receive sensor data from the movable object, the sensor data received from a plurality of sensors on the movable object having a plurality of data formats, the data manager to generate converted sensor data by reformatting the sensor data from the plurality of data formats to a common data format;
- a data manager interface, executing on the one or more processors, to receive the converted sensor data from the data manager and to provide the converted sensor data to one or more user interface elements of one or more applications executing on the user device, the data manager interface providing an abstraction layer for communication between the user interface elements and the data manager that receives the sensor data associated with a plurality of different movable object hardware configurations;
- and
- a library of user interface (UI) elements to register at least one user interface element with the data manager interface and to receive the converted sensor data corresponding to the sensor data from the data manager asynchronously as the converted sensor data is available from the data manager, wherein the UI elements are rendered in a user interface based on the converted sensor data received from the data manager, wherein a particular UI element is associated with a plurality of renderings including at least two renderings that represent a data value associated with a type or amount of the converted sensor data, and wherein the converted sensor data received from the data manager is based on a hardware configuration of the movable object, the hardware configuration comprising a first type or quantity of sensors coupled to the movable object.
Dependencies are inferred from the claim text.