# US 2014/0232648 A1 · Display apparatus and contents display method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0232648 A1
- Document ID: US20140232648A1
- Status: Published application
- Kind: A1
- Application number: 14/351,797
- Filed: 2012-10-17
- Published: 2014-08-21
- Earliest claimed: 2011-10-17
- Assignees: Korea Institute of Science and Technology
- Applicants: Korea Institute of Science and Technology
- Inventors: Ji Hyung Park; Dong Wook Yoon; Joong Ho Lee
- Web page: https://patentgrep.com/patent/US20140232648A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
- G09G 2354/00: Aspects of interface with display user
- G09G 2380/14: Electronic books and readers
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Disclosed are a display apparatus and a contents display method. The display apparatus includes: a mobile device tracing information processing unit for receiving position information or orientation information of a mobile device and generating tracing information of the mobile device based on the received position information or orientation information of the mobile device; a gesture processing unit for receiving input information of the mobile device and generating gesture information to change an output format of contents by using the received input information; a rendering unit for generating a predetermined contents image based on the tracing information of the mobile device and the gesture information; and a display unit for displaying the generated contents image.

## Claims

### Claim 1

A display apparatus, comprising:
a mobile device tracing information processing unit for receiving position information or orientation information of a mobile device and generating tracing information of the mobile device based on the received position information or orientation information of the mobile device;
a gesture processing unit for receiving input information of the mobile device and generating gesture information to change an output format of contents by using the received input information;
a rendering unit for generating a predetermined contents image based on the tracing information of the mobile device and the gesture information; and
a display unit for displaying the generated contents image.

### Claim 2 (depends on 1)

The display apparatus according to claim 1, further comprising a mobile device tracing unit for generating the position information of the mobile device by tracing a position of the mobile device from a position of the display device.

### Claim 3 (depends on 2)

The display apparatus according to claim 2, wherein the orientation information of the mobile device is generated from at least one of an acceleration sensor, a magnetic sensor and a gyroscope in the mobile device.

### Claim 4 (depends on 3)

The display apparatus according to claim 3, wherein the mobile device tracing information processing unit includes:
a noise attenuation unit for removing noise of the orientation information of the mobile device; and
a 3-dimensional transformation information calculating unit for generating 3-dimensional rotational transformation information about movement from an initial orientation of the mobile device to a present orientation based on the orientation information of the mobile device from which noise is removed,
wherein the tracing information of the mobile device is generated based on the position information and the generated 3-dimensional rotational transformation information.

### Claim 5 (depends on 2)

The display apparatus according to claim 2, wherein the mobile device tracing information processing unit includes:
a 3-dimensional transformation information calculating unit for generating 3-dimensional rotational transformation information by calculating movement from an initial orientation of the mobile device to a present orientation based on the orientation information of the mobile device; and
a noise attenuation unit for removing noise of the 3-dimensional rotational transformation information,
wherein the tracing information of the mobile device is generated based on the position information and the generated 3-dimensional rotational transformation information.

### Claim 6 (depends on 1)

The display apparatus according to claim 1, wherein the rendering unit includes:
a 3-dimensional image transforming unit for generating 3-dimensional image transformation information by transforming the predetermined contents based on the tracing information of the mobile device and the gesture information;
a rendering control unit for controlling properties of the contents to be rendered and rendering characteristics; and
a rendering calculation unit for generating and transmitting the contents image based of the 3-dimensional image transformation information, the properties of the contents and the rendering characteristics.

### Claim 7 (depends on 1)

The display apparatus according to claim 1, wherein the predetermined contents is an e-book contents including a plurality of pages.

### Claim 8 (depends on 7)

The display apparatus according to claim 7, wherein the gesture processing unit includes a continuous zooming ratio determination unit for generating first gesture information which changes a size of the e-book contents image at a first predetermined ratio based on the position information of the mobile device and the user who uses the mobile device.

### Claim 9 (depends on 7)

The display apparatus according to claim 7, wherein the gesture processing unit includes a page-turning determination unit for receiving predetermined second input information with respect to the mobile device and generating second gesture information where a first page of the e-book contents image is shifted to a second page of the e-book contents image.

### Claim 10 (depends on 7)

The display apparatus according to claim 7, wherein the gesture processing unit includes a bookmark determination unit for storing a third page of the e-book contents image by receiving predetermined third input information with respect to the mobile device, and, after the page is stored, for generating third gesture information to display the stored third page by receiving predetermined fourth input information.

### Claim 11 (depends on 1)

The display apparatus according to claim 1, wherein the gesture processing unit includes a book flipping-through determination unit for shifting from a general mode to an e-book flipping-through mode by receiving predetermined fourth input information with respect to the mobile device, and generating fourth gesture information to continuously turn over a plurality pages of the e-book contents image by receiving predetermined fifth input information.

### Claim 12 (depends on 11)

The display apparatus according to claim 11, wherein the book flipping-through determination unit shifts to the general mode again by receiving predetermined sixth input information in the shifted e-book flipping-through mode.

### Claim 13 (depends on 1)

The display apparatus according to claim 1, further comprising a feedback control unit for controlling a feedback unit of the mobile device to generate feedback control information, which generates sound or vibration feedback, based on the gesture information, and transmit the feedback control information to the mobile device.

### Claim 14 (depends on 1)

The display apparatus according to claim 1, further comprising:
a sound feedback unit for generating a sound feedback according to the gesture information; and
a feedback control unit for controlling the feedback unit by generating feedback control information which controls the feedback unit of the display device to generate a sound feedback, based on the gesture information.

### Claim 15

A contents display system, comprising:
a display apparatus which includes:
a mobile device tracing information processing unit for receiving movement information of a mobile device and generating tracing information of the mobile device based on the received movement information of the mobile device;
a gesture processing unit for receiving input information with respect to the mobile device and changing an output format of contents by using the received input information;
a rendering unit for generating predetermined contents image based on the tracing information of the mobile device and the gesture information; and
a display unit for displaying the generated contents image; and
the mobile device which communicates with the display apparatus.

### Claim 16

A contents display method, comprising:
receiving position information or orientation information of a mobile device;
generating tracing information of the mobile device based on the received position information or orientation information of the mobile device;
receiving input information with respect to the mobile device;
generating gesture information to change an output format of contents by using the received input information;
generating a predetermined contents image based on the tracing information of the mobile device and the gesture information; and
displaying the generated contents image.

### Claim 17 (depends on 16)

The contents display method according to claim 16, wherein said displaying of the contents image further includes displaying the contents image to overlay the mobile device.

### Claim 18 (depends on 16)

The contents display method according to claim 16, wherein said receiving of position information or orientation information further includes receiving movement information of the mobile device, which is generated by tracing a position of the mobile device from a position of the display device.

### Claim 19 (depends on 16)

The contents display method according to claim 16, wherein said generating of tracing information of the mobile device further includes:
generating 3-dimensional rotational transformation information by calculating movement information from an initial orientation of the mobile device to a present orientation based on the orientation information of the mobile device ;
removing noise of the tracing information of the mobile device; and
generating tracing information of the mobile device based on the position information and the generated 3-dimensional rotational transformation information.

### Claim 20 (depends on 16)

The contents display method according to claim 16, wherein said generating of a predetermined contents image further includes:
generating 3-dimensional image transformation information by transforming the predetermined contents based on the tracing information of the mobile device and the gesture information;
controlling properties of the contents to be rendered and rendering characteristics; and
generating and transmitting the contents image based on the 3-dimensional image transformation information, the properties of the contents and the rendering characteristics.

### Claim 21 (depends on 16)

The contents display method according to claim 16, wherein the predetermined contents is an e-book contents having a plurality of pages.

### Claim 22 (depends on 21)

The contents display method according to claim 21, wherein said generating of gesture information further includes generating first gesture information to change a size of the e-book contents image according to a first predetermined ratio based on position information of the display apparatus and the user who uses the mobile device.

### Claim 23 (depends on 21)

The contents display method according to claim 21, wherein said generating of gesture information further includes receiving predetermined second input information with respect to the mobile device and generating second gesture information where a first page of the e-book contents image is shifted to a second page of the e-book contents image.

### Claim 24 (depends on 21)

The contents display method according to claim 21, wherein said generating of gesture information further includes storing a third page of the e-book contents image by receiving predetermined third input information with respect to the mobile device, and, after the page is stored, generating third gesture information to display the stored third page by receiving predetermined fourth input information.

### Claim 25 (depends on 21)

The contents display method according to claim 21, wherein said generating of gesture information further includes shifting to an e-book flipping-through mode by receiving predetermined fourth input information with respect to the mobile device, and generating fourth gesture information to continuously turn over a plurality pages of the e-book contents image by receiving predetermined fifth input information.

### Claim 26 (depends on 16)

The contents display method according to claim 16, further comprising controlling a feedback unit of the mobile device to generate feedback control information, which generates sound or vibration feedback, based on the gesture information, and transmit the feedback control information to the mobile device.

### Claim 27 (depends on 16)

The contents display method according to claim 16, further comprising controlling by generating feedback control information which controls the display device to generate a sound feedback, based on the gesture information.
