# US 2017/0285883 A1 · User interface displaying and processing method and user interface displaying and processing device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0285883 A1
- Document ID: US20170285883A1
- Status: Published application
- Kind: A1
- Application number: 15/317,127
- Filed: 2016-03-08
- Published: 2017-10-05
- Earliest claimed: 2015-11-23
- Assignees: Shenzhen Skyworth-Rgb Electronic Co., Ltd.
- Applicants: Shenzhen Skyworth-Rgb Electronic Co., Ltd.
- Inventors: Quanqing Liang; Weilong Lv; Qiumei Ning
- Web page: https://patentgrep.com/patent/US20170285883A1

## CPC

- G06F 9/451: Execution arrangements for user interfaces
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- H04L 67/131: Protocols for games, networked simulations or virtual reality
- H04L 67/34: {involving the movement of software or configuration parameters (network booting or remote initial program loading [RIPL] G06F9/4416)}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The present disclosure provides a user interface displaying and processing method comprising following steps: applying Surface from a SurfaceFlinger to serve as a drawing board for drawing an interface; binding an OpenGL ES after being initialized and the Surface which is applied to server as the drawing board; controlling a function of the OpenGL ES to draw the interface on the Surface which is applied to server as the drawing board; after the interface has already been drawn, combining all Surfaces to form drawing board window data and exchanging the drawing board window data with display frame buffer window data; outputting to display the exchanged display frame buffer window data. The present disclosure further provides a user interface displaying and processing device. The present disclosure can improve the portability of applications.

## Claims

### Claim 1

A user interface displaying and processing method comprising following steps:
applying Surface from a SurfaceFlinger to serve as a drawing board for drawing an interface;
binding an OpenGL ES after being initialized and the Surface which is applied to server as the drawing board;
controlling a function of the OpenGL ES to draw the interface on the Surface which is applied to server as the drawing board;
after the interface has already been drawn, combining all Surfaces to form drawing board window data and exchanging the drawing board window data with display frame buffer window data;
outputting to display the exchanged display frame buffer window data.

### Claim 2 (depends on 1)

The user interface displaying and processing method of claim 1, wherein the step of “controlling a function of the OpenGL ES to draw the interface on the Surface which is applied to server as the drawing board” further comprises following steps:
controlling the function of the OpenGL ES to draw graphics, by a graphic function of the OpenGL ES, on the Surface which is applied to server as the drawing board to form the interface; or
controlling the function of the OpenGL ES to map, by texture mapping, on the Surface which is applied to server as the drawing board to form the interface.

### Claim 3 (depends on 2)

The user interface displaying and processing method of claim 2, wherein when the function of the OpenGL ES is controlled to draw the interface, the interface is dynamically displayed by a plurality of interface graphics, or the interface is dynamically displayed by render changing of OpenGL ES.

### Claim 4 (depends on 1)

The user interface displaying and processing method of claim 1, further comprising following steps:
establishing a communication mechanism with a preset shell application;
receiving and processing operation information transmitted by the shell application, the operation information being input information received by the shell application and commands from a preset window manager.

### Claim 5 (depends on 1)

The user interface displaying and processing method of claim 1, further comprising following steps:
when a user interface displaying command is detected, calling a show( ) function to display an interface corresponding to the display frame buffer window data;
when a user interface hiding command is detected, calling a hide( ) function to hide an interface corresponding to the display frame buffer window data.

### Claim 6 (depends on 5)

The user interface displaying and processing method of claim 5, wherein the step of “controlling a function of the OpenGL ES to draw the interface on the Surface which is applied to server as the drawing board” further comprises following steps:
controlling the function of the OpenGL ES to draw graphics, by a graphic function of the OpenGL ES, on the Surface which is applied to server as the drawing board to form the interface; or
controlling the function of the OpenGL ES to map, by texture mapping, on the Surface which is applied to server as the drawing board to form the interface.

### Claim 7 (depends on 6)

The user interface displaying and processing method of claim 6, wherein when the function of the OpenGL ES is controlled to draw the interface, the interface is dynamically displayed by a plurality of interface graphics, or the interface is dynamically displayed by render changing of OpenGL ES.

### Claim 8 (depends on 5)

The user interface displaying and processing method of claim 5, further comprising following steps:
establishing a communication mechanism with a preset shell application;
receiving and processing operation information transmitted by the shell application, the operation information being input information received by the shell application and commands from a preset window manager.

### Claim 9

A user interface displaying and processing device comprising:
a drawing board applying module configured to apply Surface from a SurfaceFlinger to serve as a drawing board for drawing an interface;
a binding module configured to bind an OpenGL ES after being initialized and the Surface which is applied to server as the drawing board;
a control module configured to control a function of the OpenGL ES to draw the interface on the Surface which is applied to server as the drawing board;
a data exchanging module configured to combine all Surfaces to form drawing board window data and exchange the drawing board window data with display frame buffer window data after the interface has already been drawn;
an outputting module configured to output to display the exchanged display frame buffer window data.

### Claim 10 (depends on 9)

The user interface displaying and processing device of claim 9, wherein the control module is configured to:
control the function of the OpenGL ES to draw graphics, by a graphic function of the OpenGL ES, on the Surface which is applied to server as the drawing board to form the interface; or
control the function of the OpenGL ES to map, by texture mapping, on the Surface which is applied to server as the drawing board to form the interface.

### Claim 11 (depends on 10)

The user interface displaying and processing device of claim 10, wherein the control module is further configured to dynamically display the interface by a plurality of interface graphics or by render changing of OpenGL ES, when the function of the OpenGL ES is controlled to draw the interface.

### Claim 12 (depends on 9)

The user interface displaying and processing device of claim 9, further comprising:
a communication module configured to establish a communication mechanism with a preset shell application;
a receiving module configured to receive and process operation information transmitted by the shell application, the operation information being input information received by the shell application and commands from a preset window manager.

### Claim 13 (depends on 9)

The user interface displaying and processing device of claim 9, further comprising:
a calling module configured to call a show( ) function to display an interface corresponding to the display frame buffer window data when a user interface displaying command is detected; and call a hide( ) function to hide an interface corresponding to the display frame buffer window data when a user interface hiding command is detected.

### Claim 14 (depends on 13)

The user interface displaying and processing device of claim 13, wherein the control module is configured to:
control the function of the OpenGL ES to draw graphics, by a graphic function of the OpenGL ES, on the Surface which is applied to server as the drawing board to form the interface; or
control the function of the OpenGL ES to map, by texture mapping, on the Surface which is applied to server as the drawing board to form the interface.

### Claim 15 (depends on 14)

The user interface displaying and processing device of claim 14, wherein the control module is configured to dynamically display the interface by a plurality of interface graphics or by render changing of OpenGL ES, when the function of the OpenGL ES is controlled to draw the interface.

### Claim 16 (depends on 13)

The user interface displaying and processing device of claim 13, further comprising:
a communication module configured to establish a communication mechanism with a preset shell application;
a receiving module configured to receive and process operation information transmitted by the shell application, the operation information being input information received by the shell application and commands from a preset window manager.