# US 8,787,931 B2 · Terminal with virtual space interface and method of controlling virtual space interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,787,931 B2
- Document ID: US8787931B2
- Status: Granted
- Kind: B2
- Application number: 13/497,922
- Filed: 2010-09-20
- Published: 2012-12-20
- Granted: 2014-07-22
- Earliest claimed: 2009-09-24
- Applicants: Hea Kyung Chun
- Inventors: Hea Kyung Chun
- Web page: https://patentgrep.com/patent/US8787931B2

## CPC

- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 15/20: Perspective computation
- G06F 2203/04105: Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Embodiments of the present invention provide a computer-implemented method for providing a mobile user interface on a mobile computing device. Specifically, among other things, embodiments of the present invention provide a computer-implemented infrastructure comprising: determining a virtual space; generating a display of at least a first portion of the virtual space; sensing a movement in real space of the mobile computing device; determining a change in position in real space of the mobile computing device based upon the sensed movement; determining whether the change in position is within a predefined boundary; and determining a viewing perspective of a second portion of the virtual space based upon the determined change in position of the mobile computing device.

## Claims

### Claim 1

A computer-implemented method for providing a mobile user interface on a mobile computing device, comprising:
providing a mobile computing device comprising at least one sensor configured to sense movement of the mobile computing device about an x-axis, a y-axis, and a z-axis in real space;
determining a three-dimensional virtual space comprising a virtual x-axis, a virtual y-axis, and a virtual z-axis;
generating a display of at least a first portion of the three-dimensional virtual space;
sensing a movement about the x-axis, the y-axis, and the z-axis in real space of the mobile computing device;
determining a change in position about the x-axis, the y-axis, and the z-axis in real space of the mobile computing device based upon the sensed movement;
determining whether the change in position is within a predefined boundary of real space; and
determining a viewing perspective of a second portion of the three-dimensional virtual space based on coordinates along the virtual x-axis, the virtual y-axis, and the virtual z-axis corresponding to the determined change in position of the mobile computing device about the x-axis, the y-axis, and the z-axis in real space.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising generating a display of the second portion of the virtual space when the determined viewing perspective is outside the predefined boundary.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the step of determining a change in position in real space of the mobile computing device comprises determining at least one of a distance or direction based on the movement.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising generating a notification of at least one of a direction or movement of the mobile computing device.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising providing a data communication connection between the mobile computing device and a server.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, wherein the mobile computing device communicates with the server via a wireless network.

### Claim 7

A mobile computing device, comprising:
a controller configured to determine a three-dimensional virtual space comprising a virtual x-axis, a virtual y-axis, and a virtual z-axis;
a display configured to display at least a first portion of the three-dimensional virtual space;
a touch panel comprising a plurality of sensors, wherein each sensor is configured to sense a movement of the mobile computing device about an x-axis, a y-axis, and a z-axis in real space;
the controller further configured to determine a change in position in real space of the mobile computing device about an x-axis, a y-axis, and a z-axis based upon the sensed movement;
the controller further configured to determine whether the change in position is within a predefined boundary of real space; and
the controller further configured to determine a viewing perspective based on coordinates about the virtual x-axis, the virtual y-axis, and the virtual z-axis of a second portion of the three-dimensional virtual space corresponding to the determined change in position of the mobile computing device about the x-axis, the y-axis, and the z-axis.

### Claim 8 (depends on 7)

The mobile computing device of claim 7, the display further configured to display the second portion of the virtual space when the determined viewing perspective is outside the predefined boundary.

### Claim 9 (depends on 7)

The mobile computing device of claim 7, wherein the change in position in real space of the mobile computing device is determined by calculating at least one of a distance or direction based on the movement.

### Claim 10 (depends on 7)

The mobile computing device of claim 7, further comprising a notifier configured to generate a notification of at least one of a direction or movement of the mobile computing device.

### Claim 11 (depends on 7)

The mobile computing device of claim 7, further comprising a data communication component configured to provide a data communication connection between the mobile computing device and a server.

### Claim 12 (depends on 11)

The mobile computing device of claim 11, wherein the mobile computing device communicates with the server via a wireless network.

### Claim 13 (depends on 7)

The mobile computing device of claim 7, wherein at least one of the plurality of sensors comprises at least one of an accelerometer, gyroscope, magnetic sensor, or pressure sensor.

### Claim 14 (depends on 7)

The mobile computing device of claim 7, further comprising a storage device configured to store a status associated with the mobile computing device.

### Claim 15

A computer program product for displaying a virtual space on a mobile user interface of a mobile computing device, the computer program product comprising a computer readable storage device, and program instructions stored on the computer readable storage device, to:
determine a three-dimensional virtual space comprising a virtual x-axis, a virtual y-axis, and a virtual z-axis;
generate a display of at least a first portion of the three-dimensional virtual space;
sense a movement of the mobile computing device about an x-axis, a y-axis, and a z-axis in real space;
determine a change in position about the x-axis, the y-axis, and the z-axis in real space of the mobile computing device based upon the sensed movement;
determine whether the change in position is within a predefined boundary of real space; and
determine a viewing perspective of a second portion of the three-dimensional virtual space based on coordinates about the virtual x-axis, the virtual y-axis, and the virtual z-axis based upon the determined change in position of the mobile computing device about the x-axis, the y-axis, and the z-axis.

### Claim 16 (depends on 15)

The computer program product of claim 15, the computer readable storage device further comprising instructions to generate a display of the second portion of the virtual space when the determined viewing perspective is outside the predefined boundary.

### Claim 17 (depends on 15)

The computer program product of claim 15, wherein the change in position in real space of the mobile computing device is determined by calculating at least one of a distance or direction based on the movement.

### Claim 18 (depends on 15)

The computer program product of claim 15, the computer readable storage device further comprising instructions to generate a notification of at least one of a direction or movement of the mobile computing device.

### Claim 19 (depends on 15)

The computer program product of claim 15, the computer readable storage device further comprising instructions to provide a data communication connection between the mobile computing device and a server.

### Claim 20 (depends on 19)

The computer program product of claim 19, wherein the mobile computing device communicates with the server via a wireless network.
