# US 11,907,604 B2 · Screen mirroring display method using layer orders of target controls and electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,907,604 B2
- Document ID: US11907604B2
- Status: Granted
- Kind: B2
- Application number: 17/616,833
- Filed: 2020-06-02
- Published: 2022-09-29
- Granted: 2024-02-20
- Earliest claimed: 2019-06-05
- Assignees: Huawei Technologies Co., Ltd.
- Applicants: Huawei Technologies Co., Ltd.
- Inventors: Zhenhua Fan; Yuan Cao; Sucheng Bian; Wanyi Yang; Pengcheng Li; Xi Wei
- Web page: https://patentgrep.com/patent/US11907604B2

## CPC

- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/1438: {using more than one graphics controller}
- G06F 9/451: Execution arrangements for user interfaces
- H04M 1/724095: {Worn on the wrist, hand or arm}
- H04M 1/72412: using two-way short-range wireless interfaces
- G09G 2340/14: Solving problems related to the presentation of information to be displayed
- G09G 2370/20: Details of the management of multiple sources of image data
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A screen mirroring display method includes a destination device receiving a first message from a first source device and a second message from a second source device, where the first message includes a first drawing instruction. The first drawing instruction instructs the destination device to draw a first target control in a first interface displayed by the first source device. The second message includes a second drawing instruction. The second drawing instruction instructs the destination device to draw a second target control in a second interface displayed by the second source device. Then the destination device draws a screen mirroring interface according to the first drawing instruction and the second drawing instruction, where the screen mirroring interface includes the first target control and the second target control.

## Claims

### Claim 1

A method comprising:
receiving, from a first source device, a first message-comprising:
a first drawing instruction instructing to draw one or more first target controls, wherein each of the one or more first target controls is a control in a first interface displayed by the first source device; and
first view information comprising a first layer order of the one or more first target controls in a screen mirroring interface;
receiving, from a second source device, a second message comprising:
a second drawing instruction instructing to draw one or more second target controls, wherein each of the one or more second target controls is a control in a second interface displayed by the second source device; and
second view information comprising a second layer order of the one or more second target controls in the screen mirroring interface;
generating, based on the first view information and the second view information, third view information comprising the first layer order and the second layer order in the screen mirroring interface; and
executing the first drawing instruction and the second drawing instruction based on the third view information to draw the screen mirroring interface, wherein the screen monitoring interface comprises the one or more first target controls and the one or more second target controls.

### Claim 2 (depends on 1)

The method of claim 1, wherein before executing the first drawing instruction and the second drawing instruction, the method further comprises:
obtaining a configuration file corresponding to both the first interface and the second interface, wherein the configuration file records a first display location of each of the one or more first target controls in the screen mirroring interface and a second display location of each of the one or more second target controls in the screen mirroring interface; and
splitting and recombining, based on the configuration file, the one or more first target controls in the first view information and the one or more second target controls in the second view information to obtain the third view information.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
executing the first drawing instruction at the first display location based on the first layer order in the third view information to draw the one or more first target controls; and
executing the second drawing instruction at the second display location based on the second layer order in the third view information to draw the one or more second target controls.

### Claim 4 (depends on 1)

The method of claim 1, wherein before executing the first drawing instruction and the second drawing instruction, the method further comprises:
obtaining a first configuration file corresponding to the first interface, wherein the first configuration file records a first display location of each of the one or more first target controls in the screen mirroring interface;
obtaining a second configuration file corresponding to the second interface, wherein the second configuration file records a second display location of each of the one or more second target controls in the screen mirroring interface; and
splitting and recombining, based on the first configuration file and the second configuration file, the one or more first target controls in the first view information and the one or more second target controls in the second view information to obtain the third view information.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
executing the first drawing instruction at the first display location based on the first layer order in the third view information to draw the one or more first target controls; and
executing the second drawing instruction at the second display location based on the second layer order in the third view information to draw the one or more second target controls.

### Claim 6 (depends on 1)

The method of claim 1, wherein first display locations of the one or more first target controls in the first interface and the screen mirroring interface are the same, and wherein second display locations of the one or more second target controls in the second interface and the screen mirroring interface are the same.

### Claim 7 (depends on 1)

The method of claim 1, wherein before receiving the first message, the method further comprises displaying a third interface, and wherein the screen mirroring interface further comprises one or more third target controls in the third interface.

### Claim 8

An electronic device comprising:
one or more processors; and
a memory configured to store instructions, wherein when executed by the one or more processors, the instructions cause the electronic device to:
receive, from a first source device, a first message comprising:
a first drawing instruction instructing to draw one or more first target controls, wherein each of the one or more first target controls is a control in a first interface displayed by the first source device; and
first view information comprising a first layer order of the one or more first target controls in the screen mirroring interface;
receive, from a second source device, a second message comprising:
a second drawing instruction instructing to draw one or more second target controls, wherein each of the one or more second target control is a control in a second interface displayed by the second source device; and
second view information comprising a second layer order of the one or more second target controls in the screen mirroring interface;
generate, based on the first view information and the second view information, third view information comprising the first layer order and the second layer order in the screen mirroring interface; and
execute the first drawing instruction and the second drawing instruction based on the third view information to draw the screen mirroring interface, wherein the screen mirroring interface comprises the one or more first target controls and the one or more second target controls.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein before executing the first drawing instruction and the second drawing instruction, when executed by the one or more processors, the instructions further cause the electronic device to:
obtain a configuration file corresponding to both the first interface and the second interface, wherein the configuration file records a first display location of each of the one or more first target controls in the screen mirroring interface and a second display location of each of the one or more second target controls in the screen mirroring interface; and
split and recombine, based on the configuration file, the one or more first target controls in the first view information and the one or more second target controls in the second view information to obtain the third view information.

### Claim 10 (depends on 9)

The electronic device of claim 9, wherein when executed by the one or more processors, the instructions further cause the electronic device to:
execute the first drawing instruction at the first display location based on the first layer order in the third view information to draw the one or more first target controls; and
execute the second drawing instruction at the second display location based on the second layer order in the third view information to draw the second target controls.

### Claim 11 (depends on 8)

The electronic device of claim 8, wherein before executing the first drawing instruction and the second drawing instruction, when executed by the one or more processors, the instructions further cause the electronic device to:
obtain a first configuration file corresponding to the first interface, wherein the first configuration file records a first display location of each of the one or more first target controls in the screen mirroring interface;
obtain a second configuration file corresponding to the second interface, wherein the second configuration file records a second display location of each of the one or more second target controls in the screen mirroring interface; and
split and recombine, based on the first configuration file and the second configuration file, the one or more first target controls in the first view information and the one or more second target controls in the second view information to obtain the third view information.

### Claim 12 (depends on 11)

The electronic device of claim 11, wherein when executed by the one or more processors, the instructions further cause the electronic device to:
execute the first drawing instruction at the first display location based on the first layer order in the third view information to draw the one or more first target controls; and
execute the second drawing instruction at the second display location based on the second layer order in the third view information to draw the one or more second target controls.

### Claim 13 (depends on 8)

The electronic device of claim 8, wherein first display locations of the one or more first target controls in the first interface and the screen mirroring interface are the same, and wherein second display locations of the one or more second target controls in the second interface and the screen mirroring interface are the same.

### Claim 14 (depends on 8)

The electronic device of claim 8, wherein before receiving the first message, when executed by the one or more processors, the instructions further cause the electronic device to display a third interface, and wherein the screen mirroring interface further comprises one or more third target controls in the third interface.

### Claim 15

A computer program product comprising computer-executable instructions that are stored on a non-transitory computer-readable medium and that, when executed by one or more processors, cause an electronic device to:
receive, from a first source device, a first message comprising:
a first drawing instruction instructing to draw one or more first target controls, wherein each of the one or more first target controls is a control in a first interface displayed by the first source device; and
first view information comprising a first layer order of the one or more first target controls in the screen mirroring interface;
receive, from a second source device, a second message comprising:
a second drawing instruction instructing to draw one or more second target controls, wherein each of the one or more second target controls is a control in a second interface displayed by the second source device; and
second view information comprising a second layer order of the one or more second target controls in the screen mirroring interface; and
execute the first drawing instruction and the second drawing instruction based on the third view information to draw the screen mirroring interface, wherein the screen mirroring interface comprises the one or more first target controls and the one or more second target controls.

### Claim 16 (depends on 15)

The computer program product of claim 15, wherein before executing the first drawing instruction and the second drawing instruction, the computer-executable instructions further cause the electronic device to:
obtain a configuration file corresponding to both the first interface and the second interface, wherein the configuration file records a first display location of each of the one or more first target controls in the screen mirroring interface and a second display location of each of the one or more second target control in the screen mirroring interface; and
split and recombine, based on the configuration file, the one or more first target controls in the first view information and the one or more second target controls in the second view information to obtain the third view information.

### Claim 17 (depends on 16)

The computer program product of claim 16, wherein when executed by the one or more processors, the computer-executable instructions further cause the electronic device to:
execute the first drawing instruction at the first display location based on the first layer order in the third view information to draw the one or more first target controls; and
execute the second drawing instruction at the second display location based on the second layer order in the third view information to draw the second target controls.

### Claim 18 (depends on 15)

The computer program product of claim 15, wherein before executing the first drawing instruction and the second drawing instruction, the computer-executable instructions further cause the electronic device to:
obtain a first configuration file corresponding to the first interface, wherein the first configuration file records a first display location of each of the one or more first target controls in the screen mirroring interface;
obtain a second configuration file corresponding to the second interface, wherein the second configuration file records a second display location of each of the one or more second target controls in the screen mirroring interface; and
split and recombine, based on the first configuration file and the second configuration file, the one or more first target controls in the first view information and the one or more second target controls in the second view information to obtain the third view information.

### Claim 19 (depends on 18)

The computer program product of claim 18, wherein when executed by the one or more processors, the computer-executable instructions further cause the electronic device to:
execute the first drawing instruction at the first display location based on the first layer order in the third view information to draw the one or more first target controls; and
execute the second drawing instruction at the second display location based on the second layer order in the third view information to draw the one or more second target controls.

### Claim 20 (depends on 15)

The computer program product of claim 15, wherein first display locations of the one or more first target controls in the first interface and the screen mirroring interface are the same, and wherein second display locations of the one or more second target controls in the second interface and the screen mirroring interface are the same.
