# US 2019/0244536 A1 · Intelligent tactical engagement trainer

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244536 A1
- Document ID: US20190244536A1
- Status: Published application
- Kind: A1
- Application number: 16/317,542
- Filed: 2017-01-05
- Published: 2019-08-08
- Earliest claimed: 2016-07-12
- Assignees: ST Electronics (Training & Simulation Systems) Pte Ltd.
- Applicants: St Electronics (Training & Simulation Systems) Pte. Ltd.
- Inventors: Chuan Huat TAN; Chee Kwang QUAH; Tik Bin OON; Wui Siong KOH
- Web page: https://patentgrep.com/patent/US20190244536A1

## CPC

- G09B 9/003: {for military purposes and tactics}
- B25J 11/002: {Manipulators for defensive or military tasks}
- F41A 33/02: Light- or radiation-emitting guns {; Light- or radiation-sensitive guns; Cartridges carrying light emitting sources, e.g. laser}
- F41G 3/26: Teaching or practice apparatus for gun-aiming or gun-laying {(shooting games A63F9/02; light- or radiation-emitting guns F41A33/02; targets therefor F41J; responders, transponders for radar, sonar, lidar G01S13/767, G01S15/74, G01S17/74)}
- F41G 3/2655: {in which the light beam is sent from the weapon to the target}
- F41J 5/00: Target indicating systems; Target-hit or score detecting systems {(for shooting or hurling games A63F9/0204; devices for measuring projectile velocity using optical means G01P3/685)}
- F41J 5/08: Infrared hit-indicating systems
- F41J 9/02: Land-based targets {, e.g. inflatable targets supported by fluid pressure}
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- F41A: FUNCTIONAL FEATURES OR DETAILS COMMON TO BOTH SMALLARMS AND ORDNANCE, e.g. CANNONS; MOUNTINGS FOR SMALLARMS OR ORDNANCE
- F41G: WEAPON SIGHTS; AIMING (optical aspects thereof G02B)
- F41J: TARGETS; TARGET RANGES; BULLET CATCHERS {(targets for shooting or hurling games A63F9/0204)}

## Abstract

There is provided a simulation-based Computer Generated Force (CGF) system for tactical training in a training field including a receiver for receiving information on the training field, a database for storing a library of CGF behaviours for one or more robots in the training field, a CGF module, coupled with the receiver and the database, for processing the information on the training field and selecting a behaviour for each of the one or more robots in the training field from the library of CGF behaviours stored in the database, a controller, coupled with the CGF module, for sending commands based on the selected behaviours to the one or more robots in the training field. The information on the training field includes location of one or more trainees and the commands include shooting the one or more trainees.

## Claims

### Claim 1

A simulation-based Computer Generated Force (CGF) system for tactical training in
a training field comprising:
a receiver that receives information on the training field;
a database that stores a library of CGF behaviours for one or more robots in the training field;
computer vision including one or more cameras and sensors on the one or more robots that sense one or more trainees and movement of the one or more trainees during training on the training field;
a CGF module, coupled with the receiver and the database, that processes the information on the training field and selects a behaviour for each of the one or more robots in the training field from the library of CGF behaviours stored in the database;
a controller, coupled with the CGF module, including CGF middleware (M-CGF) that processes multi-variable and multi-nodal inputs of robot actions into real-time commands that command the one or more robots and that are based on the selected behaviours to the one or more robots in the training field; and
wherein the information on the training field includes location of the one or more trainees and the commands include shooting the one or more trainees.

### Claim 2 (depends on 1)

The simulation-based CGF system in accordance with claim 1 further comprising:
a pedagogical engine that automatically changes behaviours of the one or more robots and difficulty levels for the trainees based on actions of the trainees detected by the computer vision during the training on the training field.

### Claim 3 (depends on 2)

The simulation-based CFG system in accordance with claim 2, wherein the pedagogical engine changes the behaviours of the one or more robots that include slowing down movements of the one or more robots during the training to lower a difficulty level for the one or more trainees in the training field.

### Claim 4 (depends on 1)

The simulation-based CGF system in accordance with claim 1, wherein the behaviour for each of the one or more robots in the training field comprises collaborative behaviours with other robots so that the one or more robots can conduct organizational behaviours.

### Claim 5 (depends on 1)

The simulation-based CGF system in accordance with claim 1, wherein the behaviour for each of the one or more robots in the training field comprises collaborative behaviours with the one or more trainees so that the one or more robots can conduct organizational behaviour with the one or more trainees.

### Claim 6 (depends on 1)

The simulation-based CGF system in accordance with claim 1, wherein the controller receives scenario plans from a remote system disseminates tasks to the CGF module, and manages coordination between a plurality of the one or more robots for collaborative behaviours between the plurality of the one or more robots during training on the training field.

### Claim 7 (depends on 1)

The simulation-based CGF system in accordance with claim 1, wherein the information received by the receiver comprises one or more of the following inputs: (i) 3D action parameters of robot, (ii) planned mission parameters, (iii) CGF behaviours and (iv) robot-specific dynamic parameters including max velocity, acceleration and payload.

### Claim 8 (depends on 1)

The simulation-based CGF system in accordance with claim 1, wherein the commands are provided to different robot types that include wheeled robots and legged robots.

### Claim 9 (depends on 1)

The simulation-based CGF system in accordance with claim 1, wherein the database is comprised in a remote server.

### Claim 10 (depends on 1)

The simulation-based CGF system in accordance with claim 1, wherein the behaviour refinement module is configured to generate datasets of virtual image data for machine learning based computer vision algorithm to adjust and refine the behaviours.

### Claim 11 (depends on 1)

The simulation-based CGF system in accordance with claim 1, wherein the library of CGF behaviours stored in the database comprises simulation entities and weapon models.

### Claim 12

A simulation-based Computer Generated Force (CGF) system for tactical training in a training field comprising:
a receiver that receives information on the training field;
a database that stores a library of CGF behaviours for one or more robots in the training field;
computer vision including one or more cameras and sensors on the one or more robots that sense one or more trainees and movement of the one or more trainees during training on the training field;
a CGF module, coupled with the receiver and the database, that processes the information on the training field and selects a behaviour for each of the one or more robots in the training field from the library of CGF behaviours stored in the database;
a controller, coupled with the CGF module, that sends commands based on the selected behaviours to the one or more robots in the training field; and
a pedagogical engine that automatically changes behaviours of the one or more robots and difficulty levels for the trainees based on actions of the trainees detected by the computer vision during the training on the training field,
wherein the information on the training field includes location of the one or more trainees and the commands include shooting the one or more trainees.

### Claim 13 (depends on 12)

The simulation-based CGF system in accordance with claim 12, wherein the pedagogical engine changes the behaviours of the one or more robots that include maximum velocity and acceleration of the one or more robots during the training to change a difficulty level for the one or more trainees in the training field.

### Claim 14 (depends on 12)

The simulation-based CGF system in accordance with claim 12, wherein the controller includes CGF middleware (M-CGF) that processes multi-variable and multi-nodal inputs of robot actions into the commands that command the one or more robots.

### Claim 15 (depends on 12)

The simulation-based CGF system in accordance with claim 12, wherein the commands are provided to different robot types that include wheeled robots and legged robots.

### Claim 16 (depends on 12)

The simulation-based CGF system in accordance with claim 12, wherein the controller receives scenario plans from a remote system, disseminates tasks to the CGF module, and manages coordination between a plurality of the one or more robots for collaborative behaviours between the plurality of the one or more robots during training on the training field.

### Claim 17

A method for conducting tactical training in a training field, comprising:
receiving information on the training field;
processing the information on the training field;
selecting a behaviour for each of one or more robots in the training field from a library of CGF behaviours stored in a database;
sending commands based on the selected behaviours to the one or more robots in the training field;
sensing, with one or more cameras and sensors located on the one or more robots, one or more trainees and movement of the one or more trainees during training on the training field; and
changing the selected behaviours of the one or more robots and difficulty levels for the trainees based on actions of the trainees detected by the one or more robots during the training on the training field;
wherein the information on the training field includes location of one or more trainees and the commands include shooting the one or more trainees.

### Claim 18 (depends on 17)

The method in accordance with claim 17; wherein the computer vision algorithm comprises a model-based computer vision algorithm.

### Claim 19 (depends on 17)

The method in accordance with claim 17, further comprising changing the selected behaviours of the one or more robots by slowing down movements of the one or more robots during the training to lower a difficulty level for the one or more trainees in the training.

### Claim 20 (depends on 17)

The method in accordance with claim 17, wherein selecting the behaviour comprises selecting collaborative behaviour with other robots so that the one or more robots can conduct organizational behaviours.

### Claim 21 (depends on 17)

The method in accordance with claim 17, wherein selecting the behaviour comprises selecting collaborative behaviour with one or more trainees so the one or more robots can conduct organizational behaviours with the one or more trainees.

### Claim 22 (depends on 17)

The method in accordance with claim 17, wherein selecting the collaborative behaviour comprises communicating in audible voice output through a speaker system or through a radio communication system.

### Claim 23 (depends on 17)

The method in accordance with claim 17, further comprising
engaging target using computer vision, the engaging comprising:
detecting a target;
tracking the detected target;
computing a positional difference between the tracked target and an alignment of a laser beam transmitter;
adjusting the alignment to match the tracked target; and
emitting a laser beam to the target from the laser beam transmitter.

### Claim 24 (depends on 23)

The method in accordance with claim 23, further comprising receiving a feedback with regard to accuracy of the laser beam emission from the laser beam transmitter.

### Claim 25 (depends on 23)

The method in accordance with claim 23, wherein the adjusting the alignment comprises rotating a platform of the laser beam transmitter.

### Claim 26 (depends on 23)

The method in accordance with claim 23, wherein the computing comprising computing a positional difference of geo-location information in a geo-database.

### Claim 27 (depends on 23)

The method in accordance with claim 23, wherein the detecting comprising range and depth sensing including any one of LIDAR and RADAR.
