# US 10,870,047 B1 · Information processing system, information processing apparatus, storage medium having information processing program stored therein, and information processing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,870,047 B1 - Document ID: US10870047B1 - Status: Granted - Kind: B1 - Application number: 16/745,884 - Filed: 2020-01-17 - Granted: 2020-12-22 - Earliest claimed: 2019-07-22 - Assignees: Nintendo Co., Ltd. - Applicants: Nintendo Co., Ltd. - Inventors: Koichi Kawamoto; Masaki Wada; Hiroshi Matsunaga; Yuji Sawatani; Atsushi Yamazaki - Web page: https://patentgrep.com/patent/US10870047B1 ## CPC - A63B 71/0622: {Visual, audio or audio-visual systems for entertaining, instructing or motivating the user} - A63F 13/218: using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player - A63B 21/028: {made of material having high internal friction, e.g. rubber, steel wool, intended to be compressed (resistance provided by plastic deformable materials A63B21/00189)} - A63B 24/0062: {Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance} - A63F 13/245: specially adapted to a particular type of game, e.g. steering wheels - G09B 5/06: with both visual and audible presentation of the material to be studied - G09B 19/003: {Repetitive work cycles; Sequence of movements} - A63B 2071/0694: {Visual indication, e.g. Indicia} - A63B 2220/40: Acceleration - A63B 2220/833: Sensors arranged on the exercise apparatus or sports implement - A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H) - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract An example of a training tool includes a first sensor. The training tool deforms from a stationary state when a force is externally applied thereto. The first sensor output according to deformation of the training tool. A processor receives first sensor information based on an output of the first sensor. While a menu is presented, the processor executes a process according to a first instruction performed on the menu, in a case where the received first sensor information indicates an output obtained when the training tool deforms in a first direction, and executes a process according to a second instruction that is performed on the menu and is different from the first instruction, in a case where the received first sensor information indicates an output obtained when the training tool deforms in a second direction opposite to the first direction. ## Claims ### Claim 1 An information processing system comprising a training tool which includes a first sensor and is configured to be held by a user, and one or more processors integral with or separate from the training tool, wherein the training tool is configured to be in a stationary state when no force is externally applied thereto, and deform from the stationary state when a force is externally applied thereto, the first sensor is configured to output according to deformation of the training tool, and the one or more processors are configured to: (1) receive first sensor information based on an output of the first sensor; (2) present a menu that accepts an instruction of the user; and (3) while the menu is presented, execute a process according to a first instruction performed on the menu, in a case where the received first sensor information indicates an output obtained when the training tool deforms in a first direction, and execute a process according to a second instruction that is performed on the menu and is different from the first instruction, in a case where the received first sensor information indicates an output obtained when the training tool deforms in a second direction opposite to the first direction. ### Claim 2 (depends on 1) The information processing system according to claim 1, wherein the training tool includes two grip portions to be held by hands of the user, the first direction is a direction in which the two grip portions approach each other, and the second direction is a direction in which the two grip portions are away from each other. ### Claim 3 (depends on 1) The information processing system according to claim 1, wherein when the training tool deforms in the first direction, the output of the first sensor is increased as compared to the output when the training tool is in the stationary state, and when the training tool deforms in the second direction, the output of the first sensor is decreased as compared to the output when the training tool is in the stationary state. ### Claim 4 (depends on 1) The information processing system according to claim 1, wherein the first direction is a direction in which a first portion and a second portion of the training tool approach each other, the first portion being on an opposite side to the second portion with respect to a predetermined portion of the training tool, and the second direction is a direction in which the first portion and the second portion are away from each other. ### Claim 5 (depends on 1) The information processing system according to claim 1, wherein the training tool includes two grip portions to be held by hands of the user, the training tool includes an operation device configured to accept an operation different from an operation to deform the training tool, the one or more processors are configured to: receive operation information based on an output of the operation device; execute a process according to the first instruction performed on the menu, in a case where the received operation information indicates an output obtained when a first operation has been performed to the operation device; and execute a process according to the second instruction performed on the menu, in a case where the received operation information indicates an output obtained when a second operation different from the first operation has been performed to the operation device, and the operation device is in an area that is not or less likely to be reached by the hands of the user when the user is holding the two grip portions of the training tool in the stationary state. ### Claim 6 (depends on 5) The information processing system according to claim 5, wherein the area is at a distance of 7 cm or more from each of the two grip portions. ### Claim 7 (depends on 1) The information processing system according to claim 1, wherein the training tool has a shape of a circular ring, the training tool includes an attachment member to which a controller is attachable, the controller includes an operation device configured to accept an operation different from an operation to deform the training tool, the one or more processors are configured to: receive operation information based on an output of the operation device; execute a process according to the first instruction performed on the menu, in a case where the received operation information indicates an output obtained when a first operation has been performed to the operation device; and execute a process according to the second instruction performed on the menu, in a case where the received operation information indicates an output obtained when a second operation different from the first operation has been performed to the operation device, and the circular ring is formed such that the operation device included in the controller attached to the attachment member is in an area that is not or less likely to be reached by hands of the user when the user is holding a first portion with one hand and holding a second portion with the other hand, wherein the first portion and the second portion are two portions at which the circular ring intersects with a straight line which is orthogonal to a straight line connecting a center of the attachment member and a center of the circular ring of the training tool at the center of the circular ring. ### Claim 8 (depends on 7) The information processing system according to claim 7, wherein the area is located at a distance of 7 cm or more from each of the first portion and the second portion. ### Claim 9 (depends on 5) The information processing system according to claim 5, wherein in a state where an instruction caused by an operation to deform the training tool has been previously accepted during presentation of the menu, if operation information is received while the menu is presented, the operation information indicating an output obtained when an operation corresponding to an instruction on the menu has been performed to the operation device, the one or more processors execute a process according to the instruction caused by the operation to the operation device; and in a state where an instruction caused by an operation to the operation device has been previously accepted during presentation of the menu, if first sensor information is received first, the first sensor information indicating an output obtained when an operation corresponding to an instruction on the menu has been performed to deform the training tool, the one or more processors do not execute a process according to the instruction caused by the operation, and if the first sensor information indicating the output is further received, the one or more processors execute the process according to the instruction caused by the operation. ### Claim 10 (depends on 9) The information processing system according to claim 9, wherein the information processing system includes a display device, and the one or more processors are configured to: cause the display device to selectively display one of a first guide image representing an operation to deform the training tool and a second guide image representing an operation to the operation device; cause the display device to display the first guide image, in a case where the first sensor information received while the menu is presented indicates that an operation corresponding to an instruction on the menu has been performed to deform the training tool; and cause the display device to display the second guide image, in a case where the operation information received while the menu is presented indicates that an operation corresponding to an instruction on the menu has been performed to the operation device. ### Claim 11 (depends on 7) The information processing system according to claim 7, wherein in a state where an instruction caused by an operation to deform the training tool has been previously accepted during presentation of the menu, if operation information is received while the menu is presented, the operation information indicating an output obtained when an operation corresponding to an instruction on the menu has been performed to the operation device, the one or more processors execute a process according to the instruction caused by the operation to the operation device; in a state where an instruction caused by an operation to the operation device has been previously accepted during presentation of the menu, if first sensor information is received first, the first sensor information indicating an output obtained when an operation corresponding to an instruction on the menu has been performed to deform the training tool, the one or more processors do not execute a process according to the instruction caused by the operation, and if the first sensor information indicating the output is further received, the one or more processors execute the process according to the instruction caused by the operation. ### Claim 12 (depends on 11) The information processing system according to claim 11, wherein the information processing system includes a display device, and the one or more processors are configured to: cause the display device to selectively display one of a first guide image representing an operation to deform the training tool and a second guide image representing an operation to the operation device; cause the display device to display the first guide image, in a case where the first sensor information received while the menu is presented indicates that an operation corresponding to an instruction on the menu has been performed to deform the training tool; and cause the display device to display the second guide image, in a case where the operation information received while the menu is presented indicates that an operation corresponding to an instruction on the menu has been performed to the operation device. ### Claim 13 (depends on 1) The information processing system according to claim 1, wherein the one or more processors are configured to execute, as the process according to the second instruction, a process of restoring a result of the process executed according to the first instruction. ### Claim 14 (depends on 1) The information processing system according to claim 1, further comprising a second sensor configured to detect a motion of the training tool, wherein the menu includes a plurality of items each being selectable by the user, and the one or more processors are configured to receive second sensor information based on an output of the second sensor, and execute a process of selecting one item from among the plurality of items, based on the received second sensor information. ### Claim 15 (depends on 14) The information processing system according to claim 14, wherein the second sensor is an acceleration sensor, and the one or more processors are configured to change an item in a state being selected among the plurality of items, in response to an operation of rotating the training tool about an axis not parallel to a direction of gravity. ### Claim 16 (depends on 14) The information processing system according to claim 14, wherein a process on an item being selected among the plurality of items is executed according to the first instruction, and the one or more processors are configured not to execute the process based on the output of the second sensor or configured to reduce responsivity of the process as compared to that in the case where the training tool is in the stationary state, during a predetermined period included in a period in which the training tool is being deformed in the first direction. ### Claim 17 (depends on 1) The information processing system according to claim 1, wherein in a case where the training tool deforms in the first direction from the stationary state, the one or more processors execute a process instructed by the first instruction, in response to deformation of the training tool to an extent equal to or more than a first deformation state in which the training tool has deformed in the first direction from the stationary state; and in a case where the training tool deforms to an extent equal to or more than the first deformation state, then starts to return toward the stationary state, and thereafter deforms in the first direction without returning to the stationary state, the one or more processors execute the process instructed by the first instruction, in response to deformation of the training tool to an extent equal to or more than a second deformation state in which an amount of deformation in the first direction is more than that in the first deformation state. ### Claim 18 (depends on 17) The information processing system according to claim 17, wherein in a case where the training tool deforms to an extent equal to or more than the first deformation state, then returns to a state of deformation equal to or less than a third deformation state in which an amount of deformation in the first direction is less than that in the first deformation state, and thereafter deforms in the first direction, the one or more processors execute the process instructed by the first instruction, in response to deformation of the training tool to an extent equal to or more than the second deformation state; and in a case where the training tool deforms to an extent equal to or more than the first deformation state, then returns toward the stationary state without having returned to the third deformation state, and thereafter deforms in the first direction, the one or more processors do not execute the process instructed by the first instruction even if the training tool deforms to an extent equal to or more than the second deformation state. ### Claim 19 An information processing apparatus which includes a first sensor and is integral with or separate from a training tool to be held by a user, wherein the training tool is configured to be in a stationary state when no force is externally applied thereto, and deform from the stationary state when a force is externally applied thereto, the first sensor is configured to output according to deformation of the training tool, and the information processing apparatus is configured to: (1) receive first sensor information based on an output of the first sensor; (2) present a menu that accepts an instruction of the user; and (3) while the menu is presented, execute a process according to a first instruction performed on the menu, in a case where the received first sensor information indicates an output obtained when the training tool deforms in a first direction, and execute a process according to a second instruction that is performed on the menu and is different from the first instruction, in a case where the received first sensor information indicates an output obtained when the training tool deforms in a second direction opposite to the first direction. ### Claim 20 A non-transitory computer-readable storage medium having stored therein an information processing program executed by a processor of an information processing apparatus which includes a first sensor and is integral with or separate from a training tool to be held by a user, wherein the training tool is configured to be in a stationary state when no force is externally applied thereto, and deform from the stationary state when a force is externally applied thereto, the first sensor is configured to output according to deformation of the training tool, and the information processing program causes the processor to execute: receiving first sensor information based on an output of the first sensor; presenting a menu that accepts an instruction of the user; and while the menu is presented, executing a process according to a first instruction performed on the menu, in a case where the received first sensor information indicates an output obtained when the training tool deforms in a first direction, and executing a process according to a second instruction that is performed on the menu and is different from the first instruction, in a case where the received first sensor information indicates an output obtained when the training tool deforms in a second direction opposite to the first direction. ### Claim 21 An information processing method executed in an information processing system comprising a training tool which has a first sensor and is configured to be held by a user, and one more processors integral with or separate from the training tool, wherein the training tool is configured to be in a stationary state when no force is externally applied thereto, and deform from the stationary state when a force is externally applied thereto, the first sensor is configured to output according to deformation of the training tool, and the one or more processors (1) receive first sensor information based on an output of the first sensor, (2) present a menu that accepts an instruction of the user, and (3) while the menu is presented, executes a process according to a first instruction performed on the menu, in a case where the received first sensor information indicates an output obtained when the training tool deforms in a first direction, and executes a process according to a second instruction that is performed on the menu and is different from the first instruction, in a case where the received first sensor information indicates an output obtained when the training tool deforms in a second direction opposite to the first direction.