# US 2018/0321817 A1 · Information processing method, computer and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0321817 A1
- Document ID: US20180321817A1
- Status: Published application
- Kind: A1
- Application number: 15/967,685
- Filed: 2018-05-01
- Published: 2018-11-08
- Earliest claimed: 2017-05-02
- Assignees: Colopl, Inc.
- Applicants: COLOPL, Inc.
- Inventors: Shuhei TERAHATA
- Web page: https://patentgrep.com/patent/US20180321817A1

## CPC

- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/428: involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
- A63F 13/5252: using two or more virtual cameras concurrently or sequentially, e.g. automatically switching between fixed virtual cameras when a character changes room or displaying a rear-mirror view in a car-driving game
- A63F 13/5255: according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
- A63F 13/5258: by dynamically adapting the position of the virtual camera to keep a game object or game character in its viewing frustum, e.g. for tracking a character or a ball
- G02B 27/017: {Head mounted}
- G02B 27/0172: {characterised by optical features}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method includes defining a virtual space, wherein the virtual space comprises a virtual viewpoint and an operation object. The method further includes detecting a motion of a head-mounted device (HMD). The method further includes generating a visual-field image in the virtual space in accordance with a position of the virtual viewpoint in the virtual space and the motion of the HMD. The method further includes detecting, in a real space, a motion of a part of a body of a user associated with the HMD. The method further includes moving the operation object in accordance with the motion of the part of the body. The method further includes displaying the visual-field image on a display associated with the HMD. The method further includes setting the virtual viewpoint as a first viewpoint. The method further includes displaying a first object in a field-of-view image from the first viewpoint. The method further includes receiving a selection of the first object under a state in which the virtual viewpoint is set to the first viewpoint. The method further includes switching the virtual viewpoint from the first viewpoint to a second viewpoint The method further includes associating a second object corresponding to the first object with the operation object in accordance with the switching of the virtual viewpoint from the first viewpoint to the second viewpoint. The method further includes and displaying a visual-field image from the second viewpoint on the display, the field-of-view image including the second object associated with the operation object

## Claims

### Claim 1

A method, comprising:
defining a virtual space, wherein the virtual space comprises a virtual viewpoint and an operation object;
detecting a motion of a head-mounted device (HMD);
generating a visual-field image in the virtual space in accordance with a position of the virtual viewpoint in the virtual space and the motion of the HMD;
detecting, in a real space, a motion of a part of a body of a user associated with the HMD;
moving the operation object in accordance with the motion of the part of the body;
displaying the visual-field image on a display associated with the HMD;
setting the virtual viewpoint as a first viewpoint;
displaying a first object in a field-of-view image from the first viewpoint;
receiving a selection of the first object under a state in which the virtual viewpoint is set to the first viewpoint;
switching the virtual viewpoint from the first viewpoint to a second viewpoint;
associating a second object corresponding to the first object with the operation object in accordance with the switching of the virtual viewpoint from the first viewpoint to the second viewpoint; and
displaying a visual-field image from the second viewpoint on the display, the field-of-view image comprising the second object associated with the operation object.

### Claim 2 (depends on 1)

The method according to claim 1, further comprising:
avoiding moving, based on setting of the virtual viewpoint to the first viewpoint, the first object displayed in the visual-field image in accordance with the motion of the operation object; and
moving, based on setting of the virtual viewpoint to the second viewpoint, the second object displayed in the visual-field image in accordance with the motion of the operation object.

### Claim 3 (depends on 2)

The method according to claim 2,
wherein the virtual space comprises a game field, and a third object is arranged in the game field, and
wherein the method further comprises:
determining contact between the second object and the third object in accordance with the motion of the second object, and
applying an effect on the third object in accordance with the contact between the second object and the third object.

### Claim 4 (depends on 3)

The method according to claim 3,
wherein the virtual space comprises a game field, and a third object is arranged in the game field,
wherein the first object comprises a player character configured to move on the game field,
wherein the third object comprises an enemy character configured to move on the game field, and
wherein the method further comprises:
determining contact between the first object and the third object in accordance with the motion of the third object, and
applying an effect based on the contact between the first object and the third object on at least one of the first object or the third object based on setting of the virtual viewpoint to the second viewpoint.

### Claim 5 (depends on 4)

The method according to claim 4,
wherein the virtual space comprises a game field, and a third object is arranged in the game field,
wherein the first object comprises a player character configured to move on the game field,
wherein the second object comprises an item to be operated by the player character,
wherein the third object comprises an enemy character configured to move on the game field, and
wherein the method further comprises:
determining contact between the second object and the third object in accordance with the motion of the third object, and
applying an effect based on the contact between the second object and the third object on at least one of the second object or the third object based on setting of the virtual viewpoint to the second viewpoint.

### Claim 6 (depends on 1)

The method according to claim 1,
wherein the virtual space comprises a game field,
wherein the first object is arranged on the game field,
wherein the virtual viewpoint set to the first viewpoint provides an overhead view of the game field, and
wherein the virtual viewpoint set to the second viewpoint is associated with the first object.

### Claim 7 (depends on 3)

The method according to claim 3,
wherein the first object comprises a game character movable on the game field, and
wherein the virtual viewpoint set to the second viewpoint defines a visual field in the virtual space viewed from the game character.

### Claim 8 (depends on 1)

The method according to claim 1,
wherein the operation object comprises a virtual hand, and
wherein the method further comprises causing the virtual hand to grasp the second object in accordance with switching of the virtual viewpoint from the first viewpoint to the second viewpoint.

### Claim 9 (depends on 1)

The method according to claim 1,
wherein the first object comprises a plurality of candidate objects, and
wherein the receiving of the selection of the first object comprises receiving, based on setting of the virtual viewpoint to the first viewpoint, a selection of a specific one of the plurality of candidate objects in accordance with the motion of the operation object.

### Claim 10 (depends on 7)

The method according to claim 7,
wherein the receiving of the selection of the first object comprises arranging the selected one of the plurality of candidate objects at a position in the virtual space identified in accordance with the motion of the operation object, and
wherein the second viewpoint comprises a position at which the selected one of the plurality of candidate objects in the space is arranged.
