# US 10,120,462 B2 · Information processing apparatus, program, and control method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,120,462 B2
- Document ID: US10120462B2
- Status: Granted
- Kind: B2
- Application number: 15/710,088
- Filed: 2017-09-20
- Published: 2018-01-11
- Granted: 2018-11-06
- Earliest claimed: 2010-09-07
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Yusuke Miyazawa; Seiji Suzuki; Yasushi Okumura
- Web page: https://patentgrep.com/patent/US10120462B2

## CPC

- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]}
- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 3/0416: {Control or interface arrangements specially adapted for digitisers}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
- G06F 2203/04802: 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An information processing apparatus includes a display, a sensor, and a controller. The display has a screen. The sensor is configured to detect an inclination. The controller is configured to display a first object on the screen and display a second object associated with the first object on the screen in accordance with the inclination detected by the sensor.

## Claims

### Claim 1

An apparatus, comprising:
a display having a screen;
at least one processor; and
at least one computer-readable medium encoded with instructions, which when executed by the at least one processor, cause the apparatus to:
display, on the screen, at least first and second items that correspond, respectively, to first and second commands that can be executed by the apparatus,
determine, based on an output of at least one sensor in communication with the at least one processor, a rotation angle of the apparatus about an axis parallel to a surface of the screen,
identify, based at least in part on the determined rotation angle, an operational state of the apparatus, the operational state being identified from among a plurality of states including (a) a first state in which the first item is selectable to cause execution of the first command and the second item is not selectable to cause execution of the second command, and (b) a second state in which the second item is selectable to cause execution of the second command and the first item is not selectable to cause execution of the first command,
while the first and second items are displayed on the screen, determine a first contact detected by a touch panel,
execute, in response to determining the first contact, the first command when the apparatus is in the first state, and
execute, in response to determining the first contact, the second command when the apparatus is in the second state.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the instructions which cause the apparatus to identify the operational state of the apparatus include instructions which, when executed by the at least one processor, cause the apparatus to:
determine that the apparatus is in the first state only when the determined rotation angle of the apparatus is within a first range of rotation angles; and
determine that the apparatus is in the second state only when the determined rotation angle of the apparatus is within a second range of rotation angles, the second range of rotation angles being non-overlapping with the first range of rotation angles.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the at least one computer-readable medium is encoded with additional instructions which, when executed by the at least one processor, further cause the apparatus to:
adjust positions of the first and second items displayed on the screen based on the determined rotation angle.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the instructions which cause the apparatus to adjust positions of the first and second items further include instructions which, when executed by the at least one processor, cause the apparatus to adjust shapes of the first and second items based on the determined rotation angle so as to virtually rotate the first and second items in three-dimensional space.

### Claim 5 (depends on 3)

The apparatus of claim 3, wherein the instructions which cause the apparatus to adjust positions of the first and second items further include instructions which, when executed by the at least one processor, cause the apparatus to move a first edge of the first item in a first direction on the screen based on the determined rotation angle.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the instructions which cause the apparatus to adjust positions of the first and second items further include instructions which, when executed by the at least one processor, cause the apparatus to move a second edge of the second item, which is substantially parallel to the first edge, in the first direction on the screen based on the determined rotation angle.

### Claim 7 (depends on 3)

The apparatus of claim 3, wherein the instructions which cause the apparatus to adjust positions of the first and second items further include instructions which, when executed by the at least one processor, further cause the apparatus to:
alter a rotational perspective of each of the first and second items based on the determined rotation angle.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the at least one computer-readable medium is encoded with additional instructions which, when executed by the at least one processor, further cause the apparatus to:
update, based on user operation of the apparatus, a reference angle from which the rotation angle of the apparatus is determined.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the instructions which cause the apparatus to update the reference angle further include instructions which, when executed by the at least one processor, further cause the apparatus to:
determine a second contact that corresponds to the user operation and is detected by the touch panel; and
update the reference angle based on the determined second contact.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the instructions which cause the apparatus to update the reference angle based on the determined second contact include additional instructions which, when executed by the at least one processor, further cause the apparatus to:
determine whether the apparatus is in a third state in which the first and second items are not displayed on the screen; and
update the reference angle based on a determination that the apparatus is in the third state.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the at least one computer-readable medium is encoded with additional instructions which, when executed by the at least one processor, further cause the apparatus to:
display the first and second items on the screen based on the determined second contact.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the instructions which cause the apparatus to determine the first contact include instructions which, when executed by the at least one processor, cause the apparatus to:
determine the first contact while the first and second items are displayed on the screen based on the determined second contact.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the instructions which cause the apparatus to identify the operational state of the apparatus include instructions which, when executed by the at least one processor, cause the apparatus to:
determine that the apparatus is in the first state when the rotation angle is a first rotation angle; and
determine that the apparatus is in the second state when the rotation angle is a second rotation angle which is larger than the first rotation angle.

### Claim 14 (depends on 1)

The apparatus of claim 1, wherein the at least one computer-readable medium is encoded with additional instructions which, when executed by the at least one processor, further cause the apparatus to:
display, on the screen, a background image behind the first and second items;
determine a position of a virtual camera based at least in part on the determined rotation angle; and
change the background image based on the determined position of the virtual camera.

### Claim 15 (depends on 1)

The apparatus of claim 1, further comprising the at least one sensor and the touch panel, wherein the at least one sensor is configured to detect rotation of the apparatus about the axis, the touch panel is configured to detect the contact, and the touch panel and the display are arranged so that the touch panel maintains a constant position with respect to the screen during operation of the apparatus.

### Claim 16 (depends on 1)

The apparatus of claim 1, wherein the instructions which cause the apparatus to determine the rotation angle of the apparatus include instructions which, when executed by the at least one processor, cause the apparatus to:
determine, based on the output of the at least one sensor in communication with the at least one processor, the rotation angle of the apparatus about the axis parallel to an edge of the surface of the screen.

### Claim 17

At least one non-transitory computer-readable medium encoded with instructions, which when executed by at least one processor of an apparatus, cause the apparatus to:
display, on a screen of a display of the apparatus, at least first and second items that correspond, respectively, to first and second commands that can be executed by the apparatus;
determine, based on an output of at least one sensor of the apparatus, a rotation angle of the apparatus about an axis parallel to a surface of the screen;
identify, based at least in part on the determined rotation angle, an operational state of the apparatus, the operational state being identified from among a plurality of states including (a) a first state in which the first item is selectable to cause execution of the first command and the second item is not selectable to cause execution of the second command, and (b) a second state in which the second item is selectable to cause execution of the second command and the first item is not selectable to cause execution of the first command;
determine a first contact detected by a touch panel of the apparatus while the first and second items are displayed on the screen;
execute, in response to determining the first contact, the first command when the apparatus is in the first state; and
execute, in response to determining the first contact, the second command when the apparatus is in the second state.

### Claim 18 (depends on 17)

The at least one non-transitory computer-readable medium of claim 17, wherein the instructions which cause the apparatus to identify the operational state of the apparatus include instructions which, when executed by the at least one processor, cause the apparatus to:
determine that the apparatus is in the first state only when the determined rotation angle of the apparatus is within a first range of rotation angles; and
determine that the apparatus is in the second state only when the determined rotation angle of the apparatus is within a second range of rotation angles, the second range of rotation angles being non-overlapping with the first range of rotation angles.

### Claim 19 (depends on 18)

The at least one non-transitory computer-readable medium of claim 18, encoded with additional instructions which, when executed by the at least one processor, further cause the apparatus to:
adjust positions of the first and second items displayed on the screen based on the determined rotation angle.

### Claim 20 (depends on 19)

The at least one non-transitory computer-readable medium of claim 19, wherein the instructions which cause the apparatus to adjust positions of the first and second items further include instructions which, when executed by the at least one processor, cause the apparatus to adjust shapes of the first and second items based on the determined rotation angle so as to virtually rotate the first and second items in three-dimensional space.

### Claim 21 (depends on 19)

The at least one non-transitory computer-readable medium of claim 19, wherein the instructions which cause the apparatus to adjust positions of the first and second items further include instructions which, when executed by the at least one processor, cause the apparatus to move a first edge of the first item in a first direction on the screen based on the determined rotation angle.

### Claim 22 (depends on 17)

The at least one non-transitory computer-readable medium of claim 17, encoded with additional instructions which, when executed by the at least one processor, further cause the apparatus to:
update, based on user operation of the apparatus, a reference angle from which the rotation angle of the apparatus is determined.

### Claim 23 (depends on 22)

The at least one non-transitory computer-readable medium of claim 22, wherein the instructions which cause the apparatus to update the reference angle further include instructions which, when executed by the at least one processor, further cause the apparatus to:
determine a second contact that corresponds to the user operation and is detected by the touch panel; and
update the reference angle based on the determined second contact.

### Claim 24 (depends on 23)

The at least one non-transitory computer-readable medium of claim 23, wherein the instructions which cause the apparatus to update the reference angle based on the determined second contact include additional instructions which, when executed by the at least one processor, further cause the apparatus to:
determine whether the apparatus is in a third state in which the first and second items are not displayed on the screen; and
update the reference angle based on a determination that the apparatus is in the third state.

### Claim 25 (depends on 24)

The at least one non-transitory computer-readable medium of claim 24, wherein the at least one computer-readable medium is encoded with additional instructions which, when executed by the at least one processor, further cause the apparatus to:
display the first and second items on the screen based on the determined second contact.

### Claim 26 (depends on 17)

The at least one non-transitory computer-readable medium of claim 17, encoded with additional instructions which, when executed by the at least one processor, further cause the apparatus to:
display, on the screen, a background image behind the first and second items;
determine a position of a virtual camera based at least in part on the determined rotation angle; and
change the background image based on the determined position of the virtual camera.

### Claim 27

A method for operating an apparatus comprising a display, at least one sensor, and a touch panel, the method comprising:
displaying, on a screen of the display, at least first and second items that correspond, respectively, to first and second commands that can be executed by the apparatus;
determining, based on an output of the at least one sensor, a rotation angle of the apparatus about an axis parallel to a surface of the screen;
identifying, based at least in part on the rotation angle, an operational state of the apparatus, the operational state being identified from among a plurality of states including (a) a first state in which the first item is selectable to cause execution of the first command and the second item is not selectable to cause execution of the second command, and (b) a second state in which the second item is selectable to cause execution of the second command and the first item is not selectable to cause execution of the first command;
while the first and second items are displayed on the screen at a first time, determining a first contact detected by the touch panel when the apparatus is in the first state;
executing, in response to determining the first contact, the first command;
while the first and second items are displayed on the screen at a second time, determining a second contact detected by the touch panel when the apparatus is in the second state; and
executing, in response to determining the second contact, the second command.

### Claim 28

An apparatus, comprising:
a display having a screen;
a touch panel arranged to maintain a constant position with respect to the screen during operation of the apparatus;
at least one sensor to detect rotation of the apparatus about an axis parallel to a surface of the screen;
at least one processor; and
at least one computer-readable medium encoded with instructions which, when executed by the at least one processor, cause the apparatus to:
display, on the screen, at least first and second items that correspond, respectively, to first and second commands that can be executed by the apparatus,
determine, based on an output of the at least one sensor, a rotation angle of the apparatus about the axis parallel to a surface of the screen,
identify, based at least in part on the determined rotation angle, an operational state of the apparatus, the operational state being identified from among a plurality of states including (a) a first state in which the first item is selectable to cause execution of the first command and the second item is not selectable to cause execution of the second command, and (b) a second state in which the second item is selectable to cause execution of the second command and the first item is not selectable to cause execution of the first command,
while the first and second items are displayed on the screen, determine a first contact detected by the touch panel,
execute, in response to determining the first contact, the first command when the apparatus is in the first state,
execute, in response to determining the first contact, the second command when the apparatus is in the second state,
determine a second contact detected by the touch panel, and
update, based on the determined second contact, a reference angle from which the rotation angle of the apparatus is determined.

### Claim 29 (depends on 28)

The apparatus of claim 28, wherein the instructions which cause the apparatus to update the reference angle based on the determined second contact include additional instructions which, when executed by the at least one processor, further cause the apparatus to:
determine whether the apparatus is in a third state in which the first and second items are not displayed on the screen; and
update the reference angle based on a determination that the apparatus is in the third state.

### Claim 30 (depends on 29)

The apparatus of claim 29, wherein the at least one computer-readable medium is encoded with additional instructions which, when executed by the at least one processor, further cause the apparatus to:
display the first and second items on the screen based on the determined second contact.