Information processing system, information processing apparatus, computer-readable non-transitory storage medium having stored therein information processing program, and hand-held information processing apparatus

An information processing method for controlling an information processing system, having a plurality of devices, the information processing system including at least one or more reflection members being a retroreflecting material part, a hand-held information processing apparatus capable of image processing and configured to capture an image and emit light, and an information processing apparatus communicable with the hand-held information processing apparatus, wherein each device of the plurality of devices having at least one reflection member from the one or more reflection members and each device having a plurality of the retroreflecting material part, the information processing method comprising:

• detecting, in the captured image, light source images including an image of a plurality of imaging target members each having the plurality of the retroreflecting material part, the image of the retroreflecting material indicating light that has been emitted and reflected by the retroreflecting material part;
• calculating positions, in the captured image, of the detected light source images;
• distinguishing types of devices, from the plurality of devices, that include the imaging target members based on, at least, a distance between the detected light source images;
• outputting positional information indicating the calculated positions;
• estimating an orientation or a position of the hand-held information processing apparatus on the basis of the output positional information;
• and
• generating an image on the basis of a result of the estimation.

A non-transitory computer-readable storage medium having store thereon an information processing program to be executed by a computer of an information processing system, having a plurality of devices, the information processing system including at least one or more reflection members being a retroreflecting material part, a hand-held information processing apparatus capable of image processing and configured to capture an image and emit light, and an information processing apparatus communicable with the hand-held information processing apparatus, wherein each device of the plurality of devices having at least one reflection member from the one or more reflection members and each device having a plurality of the retroreflecting material part, and the program, when executed by the computer, causing the information processing system to provide execution comprising:

• detect, in the captured image, light source images including an image of a plurality of imaging target members each having the plurality of the retroreflecting material part, the image of the retroreflecting material indicating light that has been emitted and reflected by the retroreflecting material part;
• calculate positions, in the captured image, of the detected light source images;
• distinguish types of devices, from the plurality of devices, that include the imaging target members based on, at least, a distance between the detected light source images;
• output positional information indicating the calculated positions;
• estimate an orientation or a position of the hand-held information processing apparatus on the basis of the output positional information;
• and
• generate an image on the basis of a result of the estimation.

An information processing apparatus, comprising:

• a processor;
• and
• a memory configured to store computer readable instructions that, when executed by the processor, cause the information processing apparatus to:
• detect, in a captured image, light source images including an image of a plurality of imaging target members each having a plurality of retroreflecting material parts, the image indicating light that has been emitted and reflected by the retroreflecting material part;
• calculate positions, in the captured image, of the detected light source images;
• distinguish types of devices, from a plurality of devices, that include the imaging target members based on, at least, a distance between the detected light source images;
• and
• output positional information indicating the calculated positions.