# US 2021/0334061 A1 · Synchronous Display Method and Apparatus, Storage Medium and Electronic Device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0334061 A1
- Document ID: US20210334061A1
- Status: Published application
- Kind: A1
- Application number: 17/042,938
- Filed: 2019-06-03
- Published: 2021-10-28
- Earliest claimed: 2019-01-17
- Assignees: Netease (Hangzhou) Network Co., Ltd.
- Applicants: Netease (Hangzhou) Network Co.,Ltd.
- Inventors: Xinyu HUANG
- Web page: https://patentgrep.com/patent/US20210334061A1

## CPC

- G06F 3/1462: {with means for detecting differences between the image stored in the host and the images displayed on the remote displays}
- G09G 5/39: Control of the bit-mapped memory
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display}
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06F 9/451: Execution arrangements for user interfaces
- G06T 3/60: Rotation of whole images or parts thereof
- G09G 5/38: with means for controlling the display position
- G09G 2340/0492: Change of orientation of the displayed image, e.g. upside-down, mirrored
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A synchronous display method, a storage medium and an electronic device are provided. The method includes: screenshot information of a first terminal is acquired, and the screenshot information into a bitmap corresponding to the screenshot information is converted; a rotation state of a screen of the first terminal is acquired; and when it is determined that the screen rotates according to the rotation state, a transposition operation corresponding to the rotation state is performed on the bitmap, the bitmap after the transposition operation is converted into a picture byte stream, and the picture byte stream is transmitted to a second terminal to synchronously display the screenshot information corresponding to the bitmap.

## Claims

### Claim 1

A synchronous display method, comprising:
acquiring screenshot information of a first terminal, and converting the screenshot information into a bitmap corresponding to the screenshot information;
acquiring a rotation state of a screen of the first terminal;
when it is determined that the screen rotates according to the rotation state, performing a transposition operation corresponding to the rotation state on the bitmap, converting the bitmap after the transposition operation into a picture byte stream, and transmitting the picture byte stream to a second terminal to synchronously display the screenshot information corresponding to the bitmap; and when it is determined that the screen does not rotate according to the rotation state, converting the bitmap into the picture byte stream, and transmitting the picture byte stream to the second terminal to synchronously display the screenshot information corresponding to the bitmap.

### Claim 2 (depends on 1)

The method as claimed in claim 1, wherein when it is determined that the screen rotates, performing the transposition operation corresponding to the rotation state on the bitmap comprises:
acquiring a return value of a preset rotation function of a window management object, wherein the return value is used for indicating whether the screen rotates and, a rotation angle of the screen; and
performing the transposition operation corresponding to the rotation state on the bitmap according to the return value.

### Claim 3 (depends on 1)

The method as claimed in claim 1, wherein before acquiring screenshot information of the first terminal, the method further comprises:
triggering the second terminal to start a first thread; and
establishing a socket connection between the first terminal and the second terminal according to the first thread.

### Claim 4 (depends on 3)

The method as claimed in claim 3, wherein converting the bitmap after the transposition operation into a picture byte stream, and transmitting the picture byte stream to a second terminal to synchronously display the screenshot information corresponding to the bitmap comprises:
converting the bitmap after the transposition operation into a byte stream in a picture format, and encapsulating the byte stream; and
transmitting the encapsulated byte stream to the second terminal by the socket connection to synchronously display the screenshot information corresponding to the byte stream.

### Claim 5 (depends on 1)

The method as claimed in claim 1, wherein before acquiring the screenshot information of the first terminal, the method further comprises:
triggering the second terminal to start a second thread, wherein the second thread is used for restarting an operation of acquiring the screenshot information of the first terminal when the screenshot information of the first terminal is failed to be acquired.

### Claim 6

(canceled)

### Claim 7

(canceled)

### Claim 8

(canceled)

### Claim 9

A non-transitory storage medium, storing a computer program, on which at least one computer program is stored, the at least one computer program being executed by a processor to implement the following steps:
acquiring screenshot information of a first terminal, and converting the screenshot information into a bitmap corresponding to the screenshot information;
acquiring a rotation state of a screen of the first terminal;
when it is determined that the screen rotates according to the rotation state, performing a transposition operation corresponding to the rotation state on the bitmap, converting the bitmap after the transposition operation into a picture byte stream, and transmitting the picture byte stream to a second terminal to synchronously display the screenshot information corresponding to the bitmap; and when it is determined that the screen does not rotate according to the rotation state, converting the bitmap into the picture byte stream, and transmitting the picture byte stream to the second terminal to synchronously display the screenshot information corresponding to the bitmap.

### Claim 10

An electronic device, comprising:
a processor; and
a memory, connected with the processor and configured to store at least one executable instruction of the processor,
wherein the processor is arranged to execute the at least one executable instruction, and the at least one executable instruction comprises:
acquiring screenshot information of a first terminal, and converting the screenshot information into a bitmap corresponding to the screenshot information;
acquiring a rotation state of a screen of the first terminal;
when it is determined that the screen rotates according to the rotation state, performing a transposition operation corresponding to the rotation state on the bitmap, converting the bitmap after the transposition operation into a picture byte stream, and transmitting the picture byte stream to a second terminal to synchronously display the screenshot information corresponding to the bitmap; and when it is determined that the screen does not rotate according to the rotation state, converting the bitmap into the picture byte stream, and transmitting the picture byte stream to the second terminal to synchronously display the screenshot information corresponding to the bitmap.

### Claim 11 (depends on 1)

The method as claimed in claim 1, wherein acquiring the rotation state of the screen of the first terminal comprising:
calling a getRotation method of IWindowManager to determine whether the screen is rotated.

### Claim 12 (depends on 1)

The method as claimed in claim 1, wherein converting the bitmap into a picture byte stream comprising:
calling a compress method of a Bitmap class, to convert the bitmap into the picture byte stream.

### Claim 13 (depends on 2)

The method as claimed in claim 2, wherein before acquiring the return value of the preset rotation function of a window management object, the method further comprising:
setting correspondence between the return value and the rotation angle.

### Claim 14 (depends on 3)

The method as claimed in claim 3, wherein after establishing the socket connection between the first terminal and the second terminal according to the first thread, the method further comprising:
Determining the first terminal as a socket server.

### Claim 15 (depends on 3)

The method as claimed in claim 3, wherein establishing a socket connection between the first terminal and the second terminal according to the first thread comprising:
after starting an agent module in the first terminal by a second thread, starting the first thread, and establishing the socket connection between the first thread and the agent module.

### Claim 16 (depends on 15)

The method as claimed in claim 15, wherein the agent module is used for calling an underlying interface to obtain the bitmap.

### Claim 17 (depends on 15)

The method as claimed in claim 15, wherein the first thread is a javacap thread, the second thread is a monitoring thread.

### Claim 18 (depends on 15)

The method as claimed in claim 15, wherein the agent module is used for transmitting the byte stream to the first thread via TCP.

### Claim 19 (depends on 4)

The method as claimed in claim 4, wherein encapsulating the byte stream comprising:
encapsulating the byte stream into a format specified by a protocol, wherein the first thread is used for processing the byte stream encapsulated.

### Claim 20 (depends on 2)

the non-transitory storage medium as claimed in claim 2, the at least one executable instruction further comprises:
acquiring a return value of a preset rotation function of a window management object, wherein the return value is used for indicating whether the screen rotates and, a rotation angle of the screen; and
performing the transposition operation corresponding to the rotation state on the bitmap according to the return value.

### Claim 21 (depends on 2)

the non-transitory storage medium as claimed in claim 2, the at least one executable instruction further comprises:
triggering the second terminal to start a first thread; and
establishing a socket connection between the first terminal and the second terminal according to the first thread.

### Claim 22 (depends on 2)

the non-transitory storage medium as claimed in claim 2, the at least one executable instruction further comprises:
converting the bitmap after the transposition operation into a byte stream in a picture format, and encapsulating the byte stream; and
transmitting the encapsulated byte stream to the second terminal by the socket connection to synchronously display the screenshot information corresponding to the byte stream.

### Claim 23 (depends on 2)

the non-transitory storage medium as claimed in claim 2, the at least one executable instruction further comprises:
triggering the second terminal to start a second thread, wherein the second thread is used for restarting an operation of acquiring the screenshot information of the first terminal when the screenshot information of the first terminal is failed to be acquired.
