# US 2019/0172271 A1 · Information processing device, information processing method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172271 A1
- Document ID: US20190172271A1
- Status: Published application
- Kind: A1
- Application number: 16/325,504
- Filed: 2017-06-14
- Published: 2019-06-06
- Earliest claimed: 2016-09-14
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Ryouhei YASUDA; Takuro NODA; Seiji WADA; Takeshi MAEDA; Kana MATSUURA
- Web page: https://patentgrep.com/patent/US20190172271A1

## CPC

- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06T 7/536: from perspective effects, e.g. by using vanishing points
- G06T 7/73: using feature-based methods
- G06T 2219/2016: Rotation, translation, scaling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

There is provided an information processing device for rotating an object relative to a viewpoint position of a user in further accordance with the user's desire, the information processing device including: a rotation center determination unit that determines a center of rotation based on a position of an object in a three-dimensional space and an instruction direction of a user in the three-dimensional space; and a rotation control unit that rotates the object relative to a viewpoint position of the user on the basis of the center of rotation.

## Claims

### Claim 1

An information processing device comprising:
a rotation center determination unit that determines a center of rotation based on a position of an object in a three-dimensional space and an instruction direction of a user in the three-dimensional space; and
a rotation control unit that rotates the object relative to a viewpoint position of the user on a basis of the center of rotation.

### Claim 2 (depends on 1)

The information processing device according to claim 1,
wherein the rotation control unit rotates the object or the viewpoint position with the center of rotation as a reference.

### Claim 3 (depends on 2)

The information processing device according to claim 2,
wherein the rotation control unit rotates the viewpoint position with the center of rotation as a reference, and controls a rotation track of the viewpoint position on a basis of a positional relationship between the center of rotation and the viewpoint position.

### Claim 4 (depends on 1)

The information processing device according to claim 1,
wherein the information processing device includes a movement control unit that rotates the object relative to a field of view of the user so that the center of rotation aligns with a predetermined position of the field of view, in a case in which the center of rotation is determined.

### Claim 5 (depends on 1)

The information processing device according to claim 1,
wherein the rotation control unit rotates the object relative to the viewpoint position of the user in accordance with a rotation speed based on a parameter related to the object.

### Claim 6 (depends on 5)

The information processing device according to claim 5,
wherein the parameter includes at least one of complexity of a shape of the object, a size of the object, or a distance between the viewpoint position and the object.

### Claim 7 (depends on 1)

The information processing device according to claim 1,
wherein the instruction direction includes at least one of a line of sight of the user, a result of detection performed by a motion sensor, a result of detection performed by a tactile type device, a direction indicated by a predetermined object, a direction indicated by a linger of the user, a result of recognition of the user's face, a result of recognition of a marker, or a result of recognition of a sound.

### Claim 8 (depends on 1)

The information processing device according to claim 1,
wherein the rotation center determination unit brings the center of rotation close to the viewpoint position in a case in which the center of rotation is positioned farther from the viewpoint position than a predetermined distance.

### Claim 9 (depends on 1)

The information processing device according to claim 1,
wherein the rotation center determination unit calculates depth information regarding the object in the three-dimensional space on a basis of a convergence angle of the user, and determines the center of rotation on a basis of the depth information and the instruction direction.

### Claim 10 (depends on 1)

The information processing device according to claim 1,
wherein the information processing device includes an output control unit that controls output of information indicating a rotatable range of the object relative to the viewpoint position.

### Claim 11 (depends on 1)

The information processing device according to claim 1,
wherein the information processing device includes an output control unit that controls output of information indicating that rotation of the object relative to the viewpoint position has reached a limit of a rotatable range, in a case in which the relative rotation has reached the limit of the rotatable range.

### Claim 12 (depends on 1)

The information processing device according to claim 1,
wherein the information processing device includes an output control unit that controls display of an image of the object obtained by a camera which is realistically or virtually present at the viewpoint position.

### Claim 13 (depends on 12)

The information processing device according to claim 12,
wherein the output control unit controls a position of a focus of the camera on a basis of depth information regarding the center of rotation.

### Claim 14 (depends on 1)

The information processing device according to claim 1,
wherein the information processing device includes an output control unit that controls output of information indicating that the instruction direction is not detected, in a case in which the instruction direction is not detected.

### Claim 15 (depends on 1)

The information processing device according to claim 1,
wherein the three-dimensional space is a virtual space,
the object is a virtual object, and
the viewpoint position is a virtual viewpoint position in the virtual space.

### Claim 16 (depends on 15)

The information processing device according to claim 15,
wherein the rotation center determination unit determines an intersection between a predetermined surface based on a position of the virtual object in the virtual space and the instruction direction in the virtual space as the center of rotation.

### Claim 17 (depends on 1)

The information processing device according to claim 1,
wherein the three-dimensional space is a real space,
the object is a real object, and
the viewpoint position is a realistic viewpoint position in the real space.

### Claim 18 (depends on 17)

The information processing device according to claim 17,
wherein the rotation center determination unit determines an intersection between a predetermined surface based on depth information regarding the real object in the real space and the instruction direction in the real space as the center of rotation.

### Claim 19

An information processing method comprising:
determining a center of rotation based on a position of an object in a three-dimensional space and an instruction direction of a user in the three-dimensional space; and
rotating the object relative to a viewpoint position of the user by a processor on a basis of the center of rotation.

### Claim 20

A program causing a computer to function as an information processing device including
a rotation center determination unit that determines a center of rotation based on a position of an object in a three-dimensional space and an instruction direction of a user in the three-dimensional space, and
a rotation control unit that rotates the object relative to a viewpoint position of the user on a basis of the center of rotation.
