# US 2020/0401217 A1 · Recording medium, information processing system, and information processing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0401217 A1 - Document ID: US20200401217A1 - Status: Published application - Kind: A1 - Application number: 17/012,324 - Filed: 2020-09-04 - Published: 2020-12-24 - Earliest claimed: 2018-03-23 - Assignees: Konami Digital Entertainment Co., Ltd. - Applicants: Konami Digital Entertainment Co., Ltd. - Inventors: Isao MATSUOKA; Junichi TANIGUCHI - Web page: https://patentgrep.com/patent/US20200401217A1 ## CPC - G06F 3/012: {Head tracking input arrangements} - G06F 1/163: {Wearable computers, e.g. on a belt} - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - H04N 5/64: Constructional details of receivers, e.g. cabinets or dust covers (furniture aspects {of television cabinets} A47B81/06) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A non-transitory computer readable recording medium having recorded therein a program, the program causes a processor to: cause a display provided on a Head Mounted Display to display a stereoscopic image to which binocular parallax is applied, the stereoscopic image being an image of a virtual space in which optional objects are disposed, and the virtual space being captured by a virtual camera; acquire orientation information on an orientation of the Head Mounted Display; when a predetermined position relationship is established between a virtual line and one optional object from among the optional objects, the virtual line having a direction according to the orientation information and intersecting with the virtual camera, identify the one option image; and when one or more optional objects are identified and a predetermined condition relating to the orientation information is satisfied, select the one or more optional objects. ## Claims ### Claim 1 A non-transitory computer readable recording medium having recorded therein a program that is executed by a processor of an information processing apparatus, the program causes the processor to: cause a display provided on a Head Mounted Display to display a stereoscopic image to which binocular parallax is applied, the stereoscopic image being an image of a virtual space in which optional objects are disposed, and the virtual space being captured by a virtual camera; acquire orientation information on an orientation of the Head Mounted Display; when a predetermined position relationship is established between a virtual line and one optional object from among the optional objects, the virtual line having a direction according to the orientation information and intersecting with the virtual camera, identify the one option image; and when one or more optional objects are identified and a predetermined condition relating to the orientation information is satisfied, select the one or more optional objects. ### Claim 2 (depends on 1) The recording medium according to claim 1, wherein: when the predetermined positional relationship is established between the virtual line and a predetermined object that is disposed in the virtual space, the program causes the processor to select the one or more optional objects. ### Claim 3 (depends on 1) The recording medium according to claim 1, wherein: when the orientation of the Head Mounted Display indicated by the orientation information is an orientation in which the Head Mounted Display rotates by a predetermined angle or more from a reference orientation around a predetermined reference axis, the program causes the processor to select the one or more optional objects. ### Claim 4 (depends on 1) The recording medium according to claim 1, wherein: when for a first period, the predetermined positional relationship is maintained between the virtual line and a predetermined object that is disposed in the virtual space, the program causes the processor to select the one or more optional objects. ### Claim 5 (depends on 1) The recording medium according to claim 1, wherein: when for a first period, the predetermined positional relationship is maintained between the virtual line and the one optional object, the program causes the processor to select the one or more optional objects. ### Claim 6 (depends on 1) The recording medium according to claim 1, wherein: upon a condition under which M (the M represents a natural number that is equal to or greater than one) optional objects are to be selected from among the optional objects, when for a first period, the predetermined positional relationship is maintained between the virtual line and an optional object that is identified at the Mth time from among the optional objects, the program causes the processor to select the identified M optional objects. ### Claim 7 (depends on 4) The recording medium according to claim 4, wherein: when the predetermined positional relationship is established between the virtual line and the one optional object, or when for a reference period having a time length that is shorter than that of the first period, the predetermined positional relationship is maintained between the virtual line and the one optional object, the program causes the processor to select the one optional object. ### Claim 8 (depends on 1) The recording medium according to claim 1, wherein: when the predetermined positional relationship is established between the virtual line and the one optional object, and the orientation of the Head Mounted Display indicated by the orientation information is a predetermined orientation, the program causes the processor to identify the one optional object, and when the predetermined positional relationship is established between the virtual line and the one optional object, and the orientation of the Head Mounted Display indicated by the orientation information is not the predetermined orientation, the program causes the processor not to identify the one optional object. ### Claim 9 (depends on 1) The recording medium according to claim 1, wherein: the program causes the processor to differentiate between: a display mode, in the display, of another optional object that is not yet identified from among the optional objects in a second period; and a display mode, in the display, of the another optional object before a start of the second period, the second period being a period after an optional object is identified for the first time from among the optional objects until the one or more optional objects are selected. ### Claim 10 (depends on 1) The recording medium according to claim 1, wherein: the program causes the processor to differentiate between: a display mode, in the display, of the one optional object after the one optional object is identified; and a display mode, in the display, of the one optional object that is not yet identified. ### Claim 11 (depends on 4) The recording medium according to claim 4, wherein: the program causes the processor to differentiate between: a display mode, in the display, of at least some optional objects from among the optional objects in a period before a start of the first period; and a display mode, in the display, of the at least some optional objects in a period of a part or entire of the first period. ### Claim 12 An information processing system comprising: a Head Mounted Display including a display; and an information processing apparatus, wherein the information apparatus includes: a processor; and a memory that is operatively coupled to the processor and is configured to store instructions executed by the processor, upon execution of the instructions the processor is configured to: cause a display provided on a Head Mounted Display to display a stereoscopic image to which binocular parallax is applied, the stereoscopic image being an image of a virtual space in which optional objects are disposed, and the virtual space being captured by a virtual camera; acquire orientation information on an orientation of the Head Mounted Display; when a predetermined position relationship is established between a virtual line and one optional object from among the optional objects, the virtual line having a direction according to the orientation information and intersecting with the virtual camera, identify the one option image; and when one or more optional objects are identified by the identifier and a predetermined condition relating to the orientation information is satisfied, select the one or more optional objects. ### Claim 13 An information processing method comprising: causing a display provided on a Head Mounted Display to display a stereoscopic image to which binocular parallax is applied, the stereoscopic image being an image of a virtual space in which optional objects are disposed, and the virtual space being captured by a virtual camera; acquiring orientation information on an orientation of the Head Mounted Display; when a predetermined position relationship is established between a virtual line and one optional object from among the optional objects, the virtual line having a direction according to the orientation information and intersecting with the virtual camera, is identifying the one option image; and when one or more optional objects are identified and a predetermined condition relating to the orientation information is satisfied, selecting the one or more optional objects.