# US 10,768,670 B2 · Control method, electronic device and non-transitory computer readable recording medium device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,768,670 B2
- Document ID: US10768670B2
- Status: Granted
- Kind: B2
- Application number: 16/378,764
- Filed: 2019-04-09
- Published: 2020-04-30
- Granted: 2020-09-08
- Earliest claimed: 2018-10-29
- Assignees: ASUSTeK COMPUTER INC.
- Applicants: ASUSTeK COMPUTER INC.
- Inventors: Che-Min Lin; Chin-Wen Lin
- Web page: https://patentgrep.com/patent/US10768670B2

## CPC

- G06F 1/1616: {with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position}
- G06F 1/1673: {Arrangements for projecting a virtual keyboard}
- G06F 1/1643: {the display being associated to a digitizer, e.g. laptops that can be used as penpads (details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615)}
- G06F 1/1647: {including at least an additional display (G06F1/1692 takes precedence)}
- G06F 1/1692: {the I/O peripheral being a secondary touch screen used as control interface, e.g. virtual buttons or sliders}
- G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer}
- G06F 3/03547: {Touch pads, in which fingers can move on a surface}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/0416: {Control or interface arrangements specially adapted for digitisers}
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 2200/1614: Image rotation following screen orientation, e.g. switching from landscape to portrait mode
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A control method is provided. The control method is applied to an electronic device. The control method includes the following steps: detecting a virtual screen signal; allocating a virtual screen image buffer module for temporarily storing virtual screen image information according to the virtual screen signal; integrating the virtual screen image information and second screen image information into an integrated image data stream by a direct mode; outputting a first screen image data stream to a first screen of an electronic device, so that the first screen displays a first image according to the first screen image data stream; and outputting the integrated image data stream to a second screen of the electronic device, so that the second screen displays a second image according to the integrated image data stream.

## Claims

### Claim 1

An electronic device, comprising:
a first screen, displaying a first image according to a first screen image data stream; a second screen, displaying a second image according to an integrated image data stream; a virtual screen module, generating a virtual screen signal; and a processor, allocating a virtual screen image buffer module according to the virtual screen signal to temporarily store virtual screen image information,
wherein the processor integrates the virtual screen image information comprising image information of an extension picture of the first screen and second screen image information comprising image information of a virtual inputting-tool into the integrated image data stream according to an interface layout information by a direct mode comprising an image processing and outputting mode directly controlled by software rather than by a general operating system, and outputs the first screen image data stream to the first screen and the integrated image data stream to the second screen so that the first image is displayed on the first screen and the second image with the virtual inputting-tool and the extension picture is displayed on the second screen at the same time, wherein the processor integrates the virtual screen image information and second screen image information into the integrated image data stream according to an adjustable integration proportion such that a proportion of the extension picture region on the second screen and a proportion of the virtual inputting tool on the second screen are set according to the adjustable integration proportion.

### Claim 2 (depends on 1)

The electronic device according to claim 1, wherein the processor comprises:
a processing module, configuring a first image buffer module, a second screen image buffer module and the virtual screen image buffer module, wherein the first image buffer module is configured to temporarily store the first screen image data stream, the second screen image buffer module is configured to temporarily store the second screen image information, and the processing module outputs the first screen image data stream from the first image buffer module to the first screen; and
an integration module, integrating the virtual screen image information and the second screen image information into the integrated image data stream according to interface layout information of the second screen, and output the integrated image data stream to the second screen.

### Claim 3 (depends on 2)

The electronic device according to claim 2, wherein the interface layout information comprises an extension display region, a virtual keyboard region, a virtual touchpad region or a combination thereof.

### Claim 4 (depends on 2)

The electronic device according to claim 2, wherein the second screen is further configured to generate touch information responding to a touch behavior, the processor is further configured to determine whether the touch behavior belongs to a touchpad operation instruction or a touch screen operation instruction according to the touch information, when the touch behavior belongs to the touchpad operation instruction, a processor triggers corresponding touchpad operation according to the touch information, and when the touch behavior belongs to the touch screen operation instruction, the processor triggers corresponding touch screen operation according to the touch information.

### Claim 5 (depends on 4)

The electronic device according to claim 4, wherein the processor comprises:
an interface setting module, generating the interface layout information; and
a determination module, determining whether the touch behavior belongs to the touchpad operation instruction or the touch screen operation instruction according to the touch information and the interface layout information.

### Claim 6

A control method, applied to an electronic device, comprising the following steps: detecting a virtual screen signal; allocating a virtual screen image buffer module according to the virtual screen signal to temporarily store virtual screen image information; integrating the virtual screen image information comprising image information of an extension picture of the first screen and second screen image information comprising image information of a virtual inputting-tool into an integrated image data stream according to an interface layout information by a direct mode comprising an image processing and outputting mode directly controlled by software rather than by a general operating system;
outputting a first screen image data stream to a first screen of the electronic device, so that the first screen displays a first image according to the first screen image data stream; and
outputting the integrated image data stream to a second screen of the electronic device, so that the second screen displays a second image according to the integrated image data stream, wherein the first image is displayed on the first screen and the second image with the virtual inputting-tool and the extension picture is displayed on the second screen at the same time and
wherein the virtual screen image information and second screen image information are integrated into the integrated image data stream according to an adjustable integration proportion such that a proportion of the extension picture region on the second screen and a proportion of the virtual inputting tool on the second screen are set according to the adjustable integration proportion.

### Claim 7 (depends on 6)

The control method according to claim 6, wherein the integration step further comprising:
integrating the virtual screen image information and the second screen image information into the integrated image data stream according to the interface layout information of the second screen.

### Claim 8 (depends on 7)

The control method according to claim 7, wherein the interface layout information comprises an extension display region, a virtual keyboard region, a virtual touchpad region or a combination thereof.

### Claim 9 (depends on 6)

The control method according to claim 6, further comprising:
receiving touch information which is responding to the touch behavior and generated by the second screen;
determining whether the touch behavior belongs to a touchpad operation instruction or a touch screen operation instruction according to the touch information;
triggering corresponding touchpad operation according to the touch information when the touch behavior belongs to the touchpad operation instruction; and
triggering corresponding touch screen operation according to the touch information when the touch behavior belongs to the touch screen operation instruction.

### Claim 10 (depends on 9)

The control method according to claim 9, wherein the determining step further comprising:
determining whether the touch behavior belongs to the touchpad operation instruction or the touch screen operation instruction according to the touch information and the interface layout information.

### Claim 11

A non-transitory computer readable recording medium device, configured to store a program command, after the program command is loaded on an electronic device, the electronic device performs steps of:
detecting a virtual screen signal;
allocating a virtual screen image buffer module for temporarily storing virtual screen image information according to the virtual screen signal;
integrating the virtual screen image information comprising image information of an extension picture of the first screen and second screen image information comprising image information of a virtual inputting-tool into an integrated image data stream according to an interface layout information by a direct mode comprising an image processing and outputting mode directly controlled by software rather than by a general operating system;
outputting a first screen image data stream to a first screen of the electronic device, so that the first screen displays a first image according to the first screen image data stream; and
outputting the integrated image data stream to a second screen of the electronic device, so that the second screen displays a second image according to the integrated image data stream, wherein the first image is displayed on the first screen and the second image with the virtual inputting-tool and the extension picture is displayed on the second screen at the same time and
wherein the virtual screen image information and second screen image information are integrated into the integrated image data stream according to an adjustable integration proportion such that a proportion of the extension picture region on the second screen and a proportion of the virtual inputting tool on the second screen are set according to the adjustable integration proportion.