Operation quantity determination device, molding apparatus system, molding machine, non-transitory computer readable recording medium, operation quantity determination method, and state display device

A non-transitory computer readable recording medium storing a computer program for causing a computer to determine an operation quantity related to a molding machine, the computer program causing the computer to execute processes of:

• acquiring observation data obtained by observing a physical quantity related to molding by the molding machine when the molding is executed;
• generating a state expression map expressing a state of the molding machine based on the acquired observation data;
• and
• outputting the operation quantity based on the generated state expression map, wherein the state expression map is a model that outputs a reward for setting the operation quantity in a state and a state transition probability to a next state when an initial information and the observation data and an operation quantity are input.

An operation quantity determination method for determining an operation quantity related to a molding machine, the method comprising:

• acquiring observation data obtained by observing a physical quantity related to molding by the molding machine when the molding is executed;
• generating a state expression map expressing a state of the molding machine based on the acquired observation data;
• and
• outputting the operation quantity based on the generated state expression map,
• wherein the state expression map is a model that outputs a reward for setting the operation quantity in a state and a state transition probability to a next state when an initial information and the observation data and an operation quantity are input.

A state display device, comprising:

• a processor;
• and
• a storage storing instructions for causing the processor to execute processes of:
• acquiring observation data obtained by observing a physical quantity related to molding by a molding machine when the molding is executed;
• and
• displaying a map image related to a state expression map expressing a state of the molding machine based on the observation data and an actual molding result by the molding machine so that the map image and the actual molding result are allowed to be compared with each other.

An operation quantity determination device for determining an operation quantity related to a molding machine, the device comprising:

• a processor;
• and
• a storage storing instructions for causing the processor to execute processes of:
• acquiring observation data obtained by observing a physical quantity related to molding by the molding machine;
• generating a state expression map expressing a state of the molding machine based on the acquired observation data;
• and
• outputting the operation quantity based on the generated state expression map,
• wherein the storage stores the state expression map and instructions for causing the processor to execute processes of:
• calculating reward data representing a molding result by the molding machine based on the observation data;
• and
• updating the state expression map based on the observation data and the reward data,
• wherein the processor is configured to output the operation quantity changing the molding result by the molding machine when the state expression map is updated,
• wherein the instructions to output the operation quantity comprises:
• a first instruction for causing the processor to calculate a higher evaluation value for the operation quantity as a probability of transitioning to a state where a normal molded product is obtained is higher;
• and
• a second instruction for causing the processor to calculate a higher evaluation value for an operation quantity as a molding result for a state and the operation quantity of the molding machine is more unknown;
• wherein the instructions to output the operation quantity comprises instructions for causing the processor to execute processes of:
• switching the first instruction or the second instruction used for determining the operation quantity;
• and
• determining the operation quantity based on an evaluation value output by the first instruction or the second instruction.

A non-transitory computer readable recording medium storing a computer program for causing a computer to determine an operation quantity related to a molding machine, the computer program causing the computer to execute processes of:

• acquiring observation data obtained by observing a physical quantity related to molding by the molding machine when the molding is executed;
• generating a state expression map expressing a state of the molding machine based on the acquired observation data;
• and
• outputting the operation quantity based on the generated state expression map,
• wherein the non-transitory computer readable recording medium is configured to cause the computer to store the state expression map and the computer program further causes the computer to execute processes of:
• calculating reward data representing a molding result by the molding machine based on the observation data;
• and
• updating the state expression map based on the observation data and the reward data,
• wherein the non-transitory computer readable recording medium is configured to cause the computer to output the operation quantity changing the molding result by the molding machine when the state expression map is updated, and
• wherein the computer program further causes the computer to execute processes of:
• calculating a higher evaluation value for the operation quantity as a probability of transitioning to a state where a normal molded product is obtained is higher, based on a first instruction;
• and
• calculating a higher evaluation value for an operation quantity as a molding result for a state and the operation quantity of the molding machine is more unknown, based on a second instruction;
• wherein outputting the operation quantity comprises causing the computer to execute processes of:
• switching the first instruction or the second instruction used for determining the operation quantity;
• and
• determining the operation quantity based on an evaluation value output by the first instruction or the second instruction.

An operation quantity determination method for determining an operation quantity related to a molding machine, the method comprising:

• acquiring observation data obtained by observing a physical quantity related to molding by the molding machine when the molding is executed;
• generating a state expression map expressing a state of the molding machine based on the acquired observation data;
• outputting the operation quantity based on the generated state expression map;
• calculating reward data representing a molding result by the molding machine based on the observation data;
• updating the state expression map based on the observation data and the reward data;
• and
• outputting the operation quantity changing the molding result by the molding machine when the state expression map is updated;
• wherein outputting the operation quantity comprises:
• calculating a higher evaluation value for the operation quantity as a probability of transitioning to a state where a normal molded product is obtained is higher based on a first instruction;
• and
• calculating a higher evaluation value for an operation quantity as a molding result for a state and the operation quantity of the molding machine is more unknown based on a second instruction;
• wherein outputting the operation quantity comprises:
• switching the first instruction or the second instruction used for determining the operation quantity;
• and
• determining the operation quantity based on an evaluation value output by the first instruction or the second instruction.

An operation quantity determination device for determining an operation quantity related to a molding machine, the device comprising:

• a processor;
• and
• a storage storing instructions for causing the processor to execute processes of:
• acquiring observation data obtained by observing a physical quantity related to molding by the molding machine;
• generating a state expression map expressing a state of the molding machine based on the acquired observation data;
• and
• outputting the operation quantity based on the generated state expression map,
• wherein the storage stores instructions for causing the processor to display the state expression map and an actual molding result by the molding machine so that the state expression map and the actual molding result are allowed to be compared with each other.

A non-transitory computer readable recording medium storing a computer program for causing a computer to determine an operation quantity related to a molding machine, the computer program causing the computer to execute processes of:

• acquiring observation data obtained by observing a physical quantity related to molding by the molding machine when the molding is executed;
• generating a state expression map expressing a state of the molding machine based on the acquired observation data;
• and
• outputting the operation quantity based on the generated state expression map,
• wherein the computer program further causes the computer to display the state expression map and an actual molding result by the molding machine so that the state expression map and the actual molding result are allowed to be compared with each other.

An operation quantity determination method for determining an operation quantity related to a molding machine, the method comprising:

• acquiring observation data obtained by observing a physical quantity related to molding by the molding machine when the molding is executed;
• generating a state expression map expressing a state of the molding machine based on the acquired observation data;
• and
• outputting the operation quantity based on the generated state expression map,
• displaying the state expression map and an actual molding result by the molding machine so that the state expression map and the actual molding result are allowed to be compared with each other.