# US 2021/0232219 A1 · Information processing apparatus, information processing method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0232219 A1
- Document ID: US20210232219A1
- Status: Published application
- Kind: A1
- Application number: 17/057,786
- Filed: 2019-03-04
- Published: 2021-07-29
- Earliest claimed: 2018-05-31
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: KENJI SUGIHARA; TAKURO NODA
- Web page: https://patentgrep.com/patent/US20210232219A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/017: {Head mounted}
- G02B 27/0172: {characterised by optical features}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

It is desired to provide a technology capable of controlling an object so as to improve user convenience. An information processing apparatus is provided. The information processing apparatus includes an object control unit that: suppresses a movement of a first object, on the basis of a first line-of-sight movement in which a gaze point of a user moves toward a first part of the first object or has moved to the first part; and moves the first object such that the first object leaves away from the gaze point of the user, on the basis of a second line-of-sight movement in which the gaze point of the user moves toward a second part of the first object different from the first part or has moved to the second part.

## Claims

### Claim 1

An information processing apparatus comprising
an object control unit that:
suppresses a movement of a first object, on a basis of a first line-of-sight movement in which a gaze point of a user moves toward a first part of the first object or has moved to the first part; and
moves the first object such that the first object leaves away from the gaze point of the user, on a basis of a second line-of-sight movement in which the gaze point of the user moves toward a second part of the first object different from the first part or has moved to the second part.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the first part includes a face of the first object.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein
the object control unit turns the face of the first object toward the user on a basis of the first line-of-sight movement or the second line-of-sight movement.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein
the second part includes a body of the first object, and
the object control unit turns a front surface of the body of the first object toward the user after turning the face of the first object toward the user, on a basis of the first line-of-sight movement.

### Claim 5 (depends on 3)

The information processing apparatus according to claim 3, wherein
the object control unit turns the face of the first object away from the user, when the gaze point of the user moves to a second object different from the first object, after turning the face of the first object toward the user.

### Claim 6 (depends on 2)

The information processing apparatus according to claim 2, wherein
the object control unit starts control of communication from the first object to the user, on a basis of a determination that the gaze point of the user is located on the face of the first object.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6, wherein
when the first object is arranged in association with a third object, the object control unit continues the control of the communication while the gaze point of the user is moving between the first object and the third object.

### Claim 8 (depends on 1)

The information processing apparatus according to claim 1, wherein
the first line-of-sight movement includes that the gaze point of the user is located on the first part, and
the second line-of-sight movement includes that the gaze point of the user is located on the second part.

### Claim 9 (depends on 1)

The information processing apparatus according to claim 1, wherein
the object control unit moves the first object such that the first object leaves away from the gaze point of the user, before the gaze point of the user reaches the second part, on a basis of the second line-of-sight movement.

### Claim 10 (depends on 1)

The information processing apparatus according to claim 1, wherein
the object control unit moves the first object such that the first object leaves away from the gaze point of the user, by moving the first object in a vector direction according to a vector direction of a line-of-sight movement of the user, on a basis of the second line-of-sight movement.

### Claim 11 (depends on 1)

The information processing apparatus according to claim 1, wherein
the object control unit:
moves the first object in a downward direction when a vector direction of a visual field change of the user is an upward direction; or
moves the first object in an upward direction when the vector direction of the visual field change of the user is a downward direction.

### Claim 12 (depends on 1)

The information processing apparatus according to claim 1, wherein
the object control unit moves the first object to a peripheral visual field of the user when the gaze point of the user has not moved toward the first object.

### Claim 13 (depends on 12)

The information processing apparatus according to claim 12, wherein
the first object includes a virtual object displayed in a display area of a display apparatus, and
the object control unit moves the virtual object to a boundary of the display area of the display apparatus when the gaze point of the user has not moved toward the virtual object.

### Claim 14 (depends on 12)

The information processing apparatus according to claim 12, wherein
the first object includes a real object capable of moving autonomously.

### Claim 15 (depends on 1)

The information processing apparatus according to claim 1, wherein
the object control unit:
moves the first object at a first moving speed on a basis of a determination that the gaze point of the user is located on a fourth object different from the first object; and
moves the first object at a second moving speed slower than the first moving speed, on a basis of a determination that the first object and the fourth object have a predetermined positional relationship, and the second line-of-sight movement.

### Claim 16 (depends on 15)

The information processing apparatus according to claim 15, wherein
the predetermined positional relationship includes a relationship in which the first object and the fourth object are present within a predetermined area of a visual field of the user.

### Claim 17 (depends on 1)

The information processing apparatus according to claim 1, wherein
the first object includes an object localized in a real space on a basis of information in the real space.

### Claim 18 (depends on 1)

The information processing apparatus according to claim 1, wherein
the information processing apparatus includes a head mounted display (HMD).

### Claim 19

An information processing method comprising:
suppressing, by a processor, a movement of a first object, on a basis of a first line-of-sight movement in which a gaze point of a user moves toward a first part of the first object or has moved to the first part; and
moving, by the processor, the first object such that the first object leaves away from the gaze point of the user, on a basis of a second line-of-sight movement in which the gaze point of the user moves toward a second part of the first object different from the first part or has moved to the second part.

### Claim 20

A program for causing a computer to function as
an information processing apparatus comprising
an object control unit that:
suppresses a movement of a first object, on a basis of a first line-of-sight movement in which a gaze point of a user moves toward a first part of the first object or has moved to the first part; and
moves the first object such that the first object leaves away from the gaze point of the user, on a basis of a second line-of-sight movement in which the gaze point of the user performs toward a second part of the first object different from the first part or has moved to the second part.
