# US 2025/0165078 A1 · Information processing apparatus and information processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0165078 A1
- Document ID: US20250165078A1
- Status: Published application
- Kind: A1
- Application number: 18/839,239
- Filed: 2023-02-28
- Published: 2025-05-22
- Earliest claimed: 2022-03-18
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Hiroshi YUASA; Tsuyoshi ISHIKAWA; Keijiroh NAGANO; Shin SHIROMA
- Web page: https://patentgrep.com/patent/US20250165078A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

There is provided an information processing apparatus and information processing method that enable quick and accurate detection of a gesture of pinching a virtual object. The information processing apparatus includes a gesture detection unit that individually detects movement of a hand base portion that is a portion not including fingers of a hand of a user, and movement of a first finger of the hand, and detects a gesture in which the user pinches a virtual object, on the basis of the movement of the hand base portion and the movement of the first finger. The present technology can be applied to, for example, a head-mounted display.

## Claims

### Claim 1

An information processing apparatus comprising
a gesture detection unit that individually detects movement of a hand base portion that is a portion not including fingers of a hand of a user and movement of a first finger of the hand, and detects, on a basis of the movement of the hand base portion and the movement of the first finger, a gesture in which the user pinches a virtual object.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein,
in a case where a position and posture of the hand base portion have changed within a first area, the gesture detection unit determines that the virtual object has been pinched, when a fingertip of the first finger comes into contact with a fingertip of a second finger of the hand within a second area including the virtual object.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein,
in a case where the change in the position of the hand base portion is less than a first threshold value and the change in the posture of the hand base portion is less than a second threshold value, the gesture detection unit determines that the position and posture of the hand base portion have changed within the first area.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein
the gesture detection unit changes at least either the first threshold value or the second threshold value on a basis of at least either a state or attribute of the user.

### Claim 5 (depends on 3)

The information processing apparatus according to claim 3, wherein
the gesture detection unit changes at least either the first threshold value or the second threshold value on a basis of a surrounding environment.

### Claim 6 (depends on 3)

The information processing apparatus according to claim 3, wherein
the gesture detection unit changes at least either the first threshold value or the second threshold value on a basis of at least either a state or attribute of the virtual object.

### Claim 7 (depends on 2)

The information processing apparatus according to claim 2, wherein
the gesture detection unit detects changes in the position and posture of the hand base portion on a basis of acceleration and angular velocity of a back of the hand, and detects a state of contact between the fingertip of the first finger and the fingertip of the second finger on a basis of pressure on the fingertip of the first finger.

### Claim 8 (depends on 7)

The information processing apparatus according to claim 7, wherein
the gesture detection unit detects the state of contact between the fingertip of the first finger and the fingertip of the second finger further on a basis of capacitance on the fingertip of the first finger.

### Claim 9 (depends on 2)

The information processing apparatus according to claim 2, wherein
the first finger is an index finger, and
the second finger is a thumb.

### Claim 10 (depends on 1)

The information processing apparatus according to claim 1, wherein,
on a basis of the movement of the hand base portion and the movement of the first finger, the gesture detection unit further detects a gesture of releasing the virtual object.

### Claim 11 (depends on 10)

The information processing apparatus according to claim 10, wherein
the gesture detection unit determines that the virtual object has been released, when a fingertip of the first finger is separated from a fingertip of the second finger in a case where a position and posture of the hand base portion have changed within a third area, or when at least either the position or posture of the first finger has changed beyond a fourth area and a state where the fingertip of the first finger is separated from the fingertip of the second finger has been maintained for a predetermined period or longer in a case where at least either the position or posture of the hand base portion has changed beyond the third area.

### Claim 12 (depends on 11)

The information processing apparatus according to claim 11, wherein
the gesture detection unit detects changes in the position and posture of the hand base portion on a basis of acceleration and angular velocity of a back of the hand, detects changes in the position and posture of the first finger on a basis of acceleration and angular velocity of the first finger, and detects a state of contact between the fingertip of the first finger and the fingertip of the second finger on a basis of capacitance on the fingertip of the first finger.

### Claim 13 (depends on 1)

The information processing apparatus according to claim 1, further comprising
an output control unit that executes, in a field of view of the user, control of superimposing and displaying the virtual object on a real world.

### Claim 14 (depends on 13)

The information processing apparatus according to claim 13, wherein
the output control unit changes a display mode of the virtual object in a case where the virtual object is determined to have been pinched.

### Claim 15 (depends on 13)

The information processing apparatus according to claim 13, wherein
the gesture detection unit predicts, on a basis of the movement of the hand base portion and the movement of the first finger, the virtual object to be pinched by the user, and
the output control unit changes a display mode of the virtual object that has been predicted to be pinched by the user.

### Claim 16 (depends on 13)

The information processing apparatus according to claim 13, wherein
the output control unit displays information indicating movement after the virtual object is released.

### Claim 17

An information processing method comprising
individually detecting movement of a hand base portion that is a portion not including fingers of a hand of a user, and predetermined movement of a finger of the hand, and, on a basis of the movement of the hand base portion and the movement of the finger, detecting a gesture in which the user pinches a virtual object.
