# US 11,908,097 B2 · Information processing system, program, and information processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,908,097 B2
- Document ID: US11908097B2
- Status: Granted
- Kind: B2
- Application number: 18/252,338
- Filed: 2022-07-14
- Published: 2023-09-28
- Granted: 2024-02-20
- Earliest claimed: 2021-07-20
- Assignees: Akatsuki Inc.
- Applicants: Akatsuki Inc.
- Inventors: Fumihiro Sano
- Web page: https://patentgrep.com/patent/US11908097B2

## CPC

- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/55: Controlling game characters or game objects based on the game progress
- A63F 13/92: Video game devices specially adapted to be hand-held while playing
- G06T 15/20: Perspective computation
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- A63F 13/428: involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An information processing system, a program, and an information processing method that can improve convenience when operating a movable object within an application. An information processing system that provides an application that can be executed on an information processing terminal includes a detection unit that detects a three-dimensional motion of a finger of a user, and a motion control unit that controls a three-dimensional motion of a movable object within the application based on the three-dimensional motion of the finger of the user detected by the detection unit.

## Claims

### Claim 1

An information processing system which provides an application that can be executed on an information processing terminal, the system comprising:
a detection unit that detects a three-dimensional motion of a finger of a user,
a motion control unit that controls a three-dimensional motion of a movable object within the application based on the three-dimensional motion of the finger of the user detected by the detection unit, and sets a position of the finger of the user detected by the detection unit at a predetermined timing as a reference position used when controlling the motion of the movable object, and
an interface generation unit that generates a state display interface that shows the reference position and a relative three-dimensional position of the finger of the user with respect to the reference position,
wherein the state display interface has:
a virtual sphere having a center point that corresponds to the reference position, and an interior that is transparently displayed, and
a motion line extending from the center point to a point corresponding to a three-dimensional position of the finger of the user.

### Claim 2 (depends on 1)

The information processing system according to claim 1, wherein:
the detection unit comprises a three-dimensional camera.

### Claim 3 (depends on 1)

The information processing system according to claim 1, wherein:
the motion control unit associates a three-dimensional motion vector of the finger of the user with a motion vector of the movable object within the application.

### Claim 4 (depends on 1)

The information processing system according to claim 1, wherein:
the motion control unit associates a direction of a motion of the finger of the user with a direction of a motion of the movable object within the application according to a setting of a direction of the movable object displayed on an application screen.

### Claim 5 (depends on 1)

The information processing system according to claim 1, wherein:
the motion control unit controls a field of view of a display image within the application based on the three-dimensional motion of the movable object.

### Claim 6

A non-transitory computer readable medium having stored thereon computer-executable codes, which, when executed by a processor, perform an information processing method, the method comprising:
in an information processing system which provides an application that can be executed on an information processing terminal,
detection processing for detecting a three-dimensional motion of a finger of a user with a detection unit,
motion control processing for controlling a three-dimensional motion of a movable object within the application based on the three-dimensional motion of the finger of the user, and setting a position of the finger of the user detected by the detection unit at a predetermined timing as a reference position used when controlling the motion of the movable object, and
interface generation processing for generating a state display interface that shows the reference position and a relative three-dimensional position of the finger of the user with respect to the reference position,
wherein the state display interface has:
a virtual sphere having a center point that corresponds to the reference position, and an interior that is transparently displayed, and
a motion line extending from the center point to a point corresponding to a three-dimensional position of the finger of the user.

### Claim 7

An information processing method, comprising:
in an information processing system which provides an application that can be executed on an information processing terminal,
a detection step of detecting a three-dimensional motion of a finger of a user with a detection unit,
a motion control step of controlling a three-dimensional motion of a movable object within the application based on the three-dimensional motion of the finger of the user, and setting a position of the finger of the user detected by the detection unit at a predetermined timing as a reference position used when controlling the motion of the movable object, and
an interface generation step of generating a state display interface that shows the reference position and a relative three-dimensional position of the finger of the user with respect to the reference position,
wherein the state display interface has:
a virtual sphere having a center point that corresponds to the reference position, and an interior that is transparently displayed, and
a motion line extending from the center point to a point corresponding to a three-dimensional position of the finger of the user.