# US 2024/0394004 A1 · Multi-Screen Collaboration Method and System, and Electronic Device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0394004 A1
- Document ID: US20240394004A1
- Status: Published application
- Kind: A1
- Application number: 18/667,704
- Filed: 2024-05-17
- Published: 2024-11-28
- Earliest claimed: 2019-12-17
- Assignees: Huawei Technologies Co., Ltd.
- Applicants: Huawei Technologies Co., Ltd.
- Inventors: Xiaomin Li; Puliang Luo; Liang Lei; Qianqiao Hu; Ruishuai Guo
- Web page: https://patentgrep.com/patent/US20240394004A1

## CPC

- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G09G 5/14: Display of multiple viewports
- G09G 5/393: Arrangements for updating the contents of the bit-mapped memory
- H04M 1/72412: using two-way short-range wireless interfaces
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- G09G 2340/02: Handling of images in compressed format, e.g. JPEG, MPEG
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/18: Use of a frame buffer in a display terminal, inclusive of the display panel
- G09G 2370/16: Use of wireless transmission of display information
- H04M 2250/04: including near field communication means, e.g. RFID
- H04M 2250/16: including more than one display unit
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A source device sends, to a destination device, application information of at least one source device application installed on the source device. The destination device displays an icon of the at least one source device application in a first interface, and displays, in the first interface, an icon of at least one destination device application installed on the destination device. In response to an operation performed on an icon of a first application, the destination device obtains first display data generated during running of the first application on the source device. The destination device displays an application window of the first application based on the first display data. In response to an operation performed by the user on an icon of a second application in the destination device application, the destination device starts the second application, and displays an application window of the second application.

## Claims

### Claim 1

A method, comprising:
sending, by a source device, application information of at least one source device application installed on the source device to a destination device, wherein the destination device displays an icon of the at least one source device application based on the application information, the source device runs a first operating system, and the destination device runs a second operating system;
receiving, by the source device, a first startup message sent by the destination device, wherein the first startup message comprises an identifier of a first application, and the at least one source device application comprises the first application;
starting, by the source device, the first application based on the identifier of the first application in response to the first startup message; and
sending first display data generated during running of the first application to the destination device.

### Claim 2 (depends on 1)

The method according to claim 1, wherein:
the first display data is a drawing instruction that is generated for a first application interface during running of the first application;
the first display data is frame data that is generated by SurfaceFlinger (SurfaceFlinger) of the source device for the first application interface based on the drawing instruction during running of the first application; or
the first display data is pixel data that is generated by HWcomposer (HWcomposer) of the source device for the first application interface based on the frame data during running of the first application.

### Claim 3 (depends on 1)

The method according to claim 1, wherein before sending, by the source device, the first display data generated during running of the first application to the destination device, the method further comprises:
encoding, by the source device, the first display data by using a video encoder.

### Claim 4 (depends on 1)

The method according to claim 1, wherein starting, by the source device, the first application based on the identifier of the first application comprises:
starting, by the source device, the first application in a foreground or background based on the identifier of the first application.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the source device comprises a first display module and a second display module, the first display module is configured to provide display data for the source device, the second display module is configured to provide display data for the destination device, and the first display data is stored in the second display module; and
wherein each of the first display module and the second display module is a graphics processing unit (GPU) or a graphics card.

### Claim 6 (depends on 5)

The method according to claim 5, wherein after sending, by the source device, the first display data generated during running of the first application to the destination device, the method further comprises:
receiving, by the source device, a second startup message sent by the destination device, wherein the second startup message comprises an identifier of a second application, and the at least one source device application comprises the second application;
starting, by the source device, the second application in response to the second startup message; and
sending second display data generated during running of the second application to the second display module.

### Claim 7 (depends on 6)

The method according to claim 6, further comprising:
in response to the second startup message, sending, by the source device, location information of the second display data to the destination device.

### Claim 8 (depends on 6)

The method according to claim 6, wherein the second display module comprises first display space and second display space, the first display space is used to store the first display data, and the second display space is used to store the second display data; and
wherein sending, by the source device, second display data generated during running of the second application to the second display module comprises:
sending, by the source device, the second display data generated during running of the second application to the second display space.

### Claim 9 (depends on 5)

The method according to claim 5, wherein the source device further comprises a third display module, the third display module is also configured to provide display data for the destination device, and the third display module is a graphics processing unit (GPU) or a graphics card; and
wherein the method further comprises:
after sending, by the source device, the first display data generated during running of the first application to the destination device, receiving, by the source device, a second startup message sent by the destination device, wherein the second startup message comprises an identifier of a second application, and the at least one source device application comprises the second application; and
starting, by the source device, the second application in response to the second startup message, and sending second display data generated during running of the second application to the third display module.

### Claim 10

A source device, wherein the source device comprises:
a display,
one or more processors,
a memory, and
a communication interface, wherein
the memory stores one or more computer programs, the one or more computer programs comprise instructions, and when the instructions are executed by the source device, the source device is enabled to perform:
sending application information of at least one source device application installed on the source device to a destination device, wherein the destination device displays an icon of the at least one source device application based on the application information, the source device runs a first operating system, and the destination device runs a second operating system;
receiving a first startup message sent by the destination device, wherein the first startup message comprises an identifier of a first application, and the at least one source device application comprises the first application;
starting the first application based on the identifier of the first application in response to the first startup message; and
sending first display data generated during running of the first application to the destination device.

### Claim 11 (depends on 10)

The source device according to claim 10, wherein:
the first display data is a drawing instruction that is generated for a first application interface during running of the first application;
the first display data is frame data that is generated by SurfaceFlinger (SurfaceFlinger) of the source device for the first application interface based on the drawing instruction during running of the first application; or
the first display data is pixel data that is generated by HWcomposer (HWcomposer) of the source device for the first application interface based on the frame data during running of the first application.

### Claim 12 (depends on 10)

The source device according to claim 10, wherein the source device is further enabled to perform:
encoding the first display data by using a video encoder.

### Claim 13 (depends on 10)

The source device according to claim 10, wherein the source device is further enabled to perform:
starting the first application in a foreground or background based on the identifier of the first application.

### Claim 14 (depends on 10)

The source device according to claim 10, wherein the source device comprises a first display module and a second display module, the first display module is configured to provide display data for the source device, the second display module is configured to provide display data for the destination device, and the first display data is stored in the second display module; and
wherein each of the first display module and the second display module is a graphics processing unit (GPU) or a graphics card.

### Claim 15 (depends on 14)

The source device according to claim 14, wherein the source device is further enabled to perform:
receiving a second startup message sent by the destination device, wherein the second startup message comprises an identifier of a second application, and the at least one source device application comprises the second application; and
starting the second application in response to the second startup message, and sending second display data generated during running of the second application to the second display module.

### Claim 16 (depends on 15)

The source device according to claim 15, wherein the source device is further enabled to perform:
sending location information of the second display data to the destination device.

### Claim 17 (depends on 15)

The source device according to claim 15, wherein the second display module comprises first display space and second display space, the first display space is used to store the first display data, and the second display space is used to store the second display data; and
wherein the source device is further enabled to perform:
sending the second display data generated during running of the second application to the second display space.

### Claim 18 (depends on 14)

The source device according to claim 14, wherein the source device further comprises a third display module, the third display module is also configured to provide display data for the destination device, and the third display module is a graphics processing unit (GPU) or a graphics card; and
wherein the source device is further enabled to perform:
receiving a second startup message sent by the destination device, wherein the second startup message comprises an identifier of a second application, and the at least one source device application comprises the second application;
starting the second application in response to the second startup message; and
sending second display data generated during running of the second application to the third display module.

### Claim 19

A method, comprising:
sending, by a source device to a destination device, application information of at least one source device application installed on the source device, wherein the source device runs a first operating system, and the destination device runs a second operating system;
displaying, by the destination device, an icon of the at least one source device application in a first interface based on the application information, and displaying, by the destination device in the first interface, an icon of at least one destination device application installed on the destination device;
obtaining, by the destination device in response to an operation performed by a user on an icon of a first application on the destination device, first display data generated during running of the first application on the source device, wherein the at least one source device application comprises the first application;
displaying, by the destination device, an application window of the first application in the first interface based on the first display data;
in response to an operation performed by the user on an icon of a second application on the destination device, starting, by the destination device, the second application; and
displaying an application window of the second application in the first interface, wherein the at least one destination device application comprises the second application.

### Claim 20 (depends on 19)

The method according to claim 19, wherein the application information comprises an identifier of the at least one source device application; and
wherein obtaining, by the destination device in response to the operation performed by the user on the icon of the first application on the destination device, the first display data generated during running of the first application on the source device comprises:
sending, by the destination device, a first startup message to the source device in response to the operation performed by the user on the icon of the first application on the destination device, wherein the first startup message comprises an identifier of the first application; and
starting, by the source device, the first application based on the identifier of the first application in response to the first startup message, and sending the first display data generated during running of the first application to the destination device.
