# US 2017/0256240 A1 · Interactive display system and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0256240 A1
- Document ID: US20170256240A1
- Status: Published application
- Kind: A1
- Application number: 15/062,173
- Filed: 2016-03-06
- Published: 2017-09-07
- Earliest claimed: 2016-03-06
- Assignees: HTC Corporation
- Applicants: HTC Corporation
- Inventors: Chia-Yin Lu; You-Lin Song
- Web page: https://patentgrep.com/patent/US20170256240A1

## CPC

- G09G 5/397: Arrangements specially adapted for transferring the contents of two or more bit-mapped memories to the screen simultaneously, e.g. for mixing or overlay (G09G5/02 takes precedence)
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/0172: {characterised by optical features}
- G06F 3/012: {Head tracking input arrangements}
- G09G 5/006: {Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04)}
- G09G 5/363: {Graphics controllers}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G09G 2320/0252: Improving the response speed
- G09G 2340/16: Determination of a pixel data signal depending on the signal applied in the previous frame
- G09G 2350/00: Solving problems of bandwidth in display systems
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/12: Frame memory handling
- G09G 2360/18: Use of a frame buffer in a display terminal, inclusive of the display panel
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Interactive display system and method are provided, and the interactive display system includes a head-mounted display and an electronic device. The head-mounted display is configured to be worn by a user. The electronic device generates a previous frame and frame pixel depth information and transmits the previous frame and the frame pixel depth information to the head-mounted display so that the head-mounted display displays the previous frame. The head-mounted display generates current state information in response to a motion of the user and generates a current frame according to the current state information, the previous frame and the frame pixel depth information. The head-mounted display displays the current frame.

## Claims

### Claim 1

An interactive display system comprising:
a head-mounted display configured to be worn by a user and comprising a sensor, wherein the sensor senses a head movement of the user to generate a first sensing data, and the head-mounted display calculates current state information according to the first sensing data; and
an electronic device generating a previous frame and frame pixel depth information and transmitting the previous frame and the frame pixel depth information to the head-mounted display, so that the head-mounted display displays the previous frame,
wherein the head-mounted display stores the previous frame and the frame pixel depth information from the electronic device and generates a current frame according to the current state information, the stored previous frame and the stored frame pixel depth information, and the head-mounted display displays the current frame.

### Claim 2 (depends on 1)

The interactive display system according to claim 1, wherein the head-mounted display further comprises:
a first frame buffer storing the previous frame; and
a first depth buffer storing the frame pixel depth information.

### Claim 3 (depends on 2)

The interactive display system according to claim 2, wherein before the electronic device transmits the previous frame and the frame pixel depth information, the sensor generates a second sensing data, the head-mounted display calculates previous state information according to the second sensing data and transmits the previous state information to the electronic device, and the electronic device generates the previous frame and the frame pixel depth information according to the previous state information.

### Claim 4 (depends on 3)

The interactive display system according to claim 3, wherein the interactive display system transmits the previous state information, the previous frame and the frame pixel depth information between the head-mounted display and the electronic device through a wireless connection interface or a wired connection interface.

### Claim 5 (depends on 3)

The interactive display system according to claim 3, wherein the head-mounted display further comprises:
a first transceiver transmitting the previous state information to the electronic device and receiving the previous frame and the frame pixel depth information from the electronic device.

### Claim 6 (depends on 5)

The interactive display system according to claim 5, wherein electronic device comprises:
a graphic processing unit generating the previous frame and the frame pixel depth information according to the previous state information; and
a second transceiver receiving the previous state information from the first transceiver and transmitting the previous frame and the frame pixel depth information to the first transceiver.

### Claim 7 (depends on 6)

The interactive display system according to claim 6, wherein the graphic processing unit stores the previous frame through a second frame buffer and stores the frame pixel depth information through a second depth buffer.

### Claim 8 (depends on 6)

The interactive display system according to claim 6, wherein the electronic device further comprises a processor configured to compress the frame pixel depth information before the second transceiver transmits the frame pixel depth information.

### Claim 9 (depends on 3)

The interactive display system according to claim 3, wherein the head-mounted display further comprises a control logic, the control logic reads the frame pixel depth information in the first depth buffer and adjusts the frame pixel depth information according to the current state information, and the control logic generates the current frame according to the previous fame and the adjusted frame pixel depth information.

### Claim 10 (depends on 9)

The interactive display system according to claim 9, wherein the head-mounted display calculates the previous state information and the current state information through the control logic.

### Claim 11

An interactive display method adapted to an interactive display system which comprises an electronic device and a head-mounted display, wherein the head-mounted display is configured to be worn by a user, and the interactive display method comprises:
generating a previous frame and frame pixel depth information through the electronic device;
transmitting the previous frame and the frame pixel depth information to the head-mounted display, and storing the previous frame and the frame pixel depth information in the head-mounted display;
displaying the previous frame through the head-mounted display;
sensing a head movement of the user through a sensor of the head-mounted display to generate a first sensing data, and calculating current state information according to the first sensing data by the head-mounted display;
generating a current frame according to the current state information, the stored previous frame and the stored frame pixel depth information of the head-mounted device; and
displaying the current frame through the head-mounted device.

### Claim 12

(canceled)

### Claim 13 (depends on 11)

The interactive display method according to claim 11, wherein the step of generating the previous frame and the frame pixel depth information through the electronic device comprises:
before transmitting the previous frame and the frame pixel depth information to the head-mounted display, sensing the motion of the user through the sensor to generate a second sensing data and calculating previous state information according to the second sensing data;
transmitting the previous state information to the electronic device; and
generating the previous frame and the frame pixel depth information according to the previous state information in the electronic device.

### Claim 14 (depends on 13)

The interactive display method according to claim 13, wherein the interactive display system transmits the previous state information, the previous frame and the frame pixel depth information between the head-mounted display and the electronic device through a wireless connection interface or a wired connection interface.

### Claim 15 (depends on 14)

The interactive display method according to claim 14, wherein the wireless connection interface comprises a first transceiver in the head-mounted display and a second transceiver in the electronic device.

### Claim 16 (depends on 11)

The interactive display method according to claim 11, further comprises:
storing the previous frame through a first frame buffer in the head-mounted display; and
storing the frame pixel depth information through a first depth buffer in the head-mounted display.

### Claim 17 (depends on 16)

The interactive display method according to claim 16, wherein the step of generating the current frame according to the current state information, the stored previous frame and the stored frame pixel depth information of the head-mounted device comprises:
reading the previous frame in the first frame buffer;
reading the frame pixel depth information in the first depth buffer and adjusting the frame pixel depth information according to the current state information; and
generating the current frame according to the previous frame and the adjusted frame pixel depth information.

### Claim 18 (depends on 17)

The interactive display method according to claim 17, wherein the electronic device comprises a graphic processing unit configured to generate the previous frame and the frame pixel depth information according to a previous state information from the head-mounted display, and the graphic processing unit stores the previous frame through a second frame buffer and stores the frame pixel depth information through a second depth buffer.
