Facilitating device control

A non-transitory computer-readable storage medium having stored thereon codes which, when executed by at least one processor, cause the at least one processor to:

• receive one or more sets of associated environment sensor information and device control instructions, wherein each set of associated environment sensor information and device control instructions comprises:
• environment sensor information representing an environment associated with an operator controllable device;
• and
• associated device control instructions configured to cause the operator controllable device to simulate at least one action taken by at least one operator experiencing a representation of the environment generated from the environment sensor information;
• derive autonomous control information from the one or more sets of associated environment sensor information and device control instructions, said autonomous control information configured to facilitate generating autonomous device control signals from autonomous environment sensor information representing an environment associated with an autonomous device, said autonomous device control signals configured to cause the autonomous device to take at least one autonomous action, said autonomous control information comprising a representation of an artificial intelligence model derived from the one or more sets of associated environment sensor information and device control instructions.

A system for deriving autonomous control information, the system comprising:

• means for receiving one or more sets of associated environment sensor information and device control instructions, wherein each set of associated environment sensor information and device control instructions comprises:
• environment sensor information representing an environment associated with an operator controllable device;
• and
• associated device control instructions configured to cause the operator controllable device to simulate at least one action taken by at least one operator experiencing a representation of the environment generated from the environment sensor information;
• means for deriving autonomous control information from the one or more sets of associated environment sensor information and device control instructions, said autonomous control information configured to facilitate generating autonomous device control signals from autonomous environment sensor information representing an environment associated with an autonomous device, said autonomous device control signals configured to cause the autonomous device to take at least one autonomous action, said autonomous control information comprising a representation of an artificial intelligence model derived from the one or more sets of associated environment sensor information and device control instructions.

A system for deriving autonomous control information, the system comprising at least one processor configured to:

• receive one or more sets of associated environment sensor information and device control instructions, wherein each set of associated environment sensor information and device control instructions comprises:
• environment sensor information representing an environment associated with an operator controllable device;
• and
• associated device control instructions configured to cause the operator controllable device to simulate at least one action taken by at least one operator experiencing a representation of the environment generated from the environment sensor information;
• derive autonomous control information from the one or more sets of associated environment sensor information and device control instructions, said autonomous control information configured to facilitate generating autonomous device control signals from autonomous environment sensor information representing an environment associated with an autonomous device, said autonomous device control signals configured to cause the autonomous device to take at least one autonomous action, said autonomous control information comprising a representation of an artificial intelligence model derived from the one or more sets of associated environment sensor information and device control instructions.

A method of operation in a robotic system including an operator controllable device and a processor in communication with the operator controllable device, the method comprising:

• receiving, by the processor, environment sensor information that represents an environment associated with the operator controllable device;
• causing, by the processor, the display of a representation of the environment to a human operator;
• receiving, by the processor, device control instructions which when executed by the operator controllable device, cause the operator controllable device to simulate at least one action taken by the human operator in response to the representation of the environment;
• receiving, by the processor, internal sensor information that represents at least one internal state of the operator controllable device;
• deriving, by the processor from (i) the environment sensor information, (ii) the device control instructions, and (iii) the internal sensor information, autonomous control instructions, which, when executed by the operator controllable device, cause the operator controllable device to take at least one autonomous action;
• and
• producing, by the processor, at least one signal that represents the autonomous control instructions.

A system for deriving autonomous control information, the system comprising at least one processor configured to:

• receive one or more sets of associated environment sensor information and device control instructions, wherein each set of associated environment sensor information and device control instructions comprises:
• environment sensor information representing an environment associated with an operator controllable device;
• and
• associated device control instructions configured to cause the operator controllable device to simulate at least one action taken by at least one operator experiencing a representation of the environment generated from the environment sensor information;
• and
• derive autonomous control information from the one or more sets of associated environment sensor information and device control instructions, said autonomous control information configured to facilitate generating autonomous device control signals from autonomous environment sensor information representing an environment associated with an autonomous device, said autonomous device control signals configured to cause the autonomous device to take at least one autonomous action, said autonomous control information comprising a representation of an artificial intelligence model derived from the one or more sets of associated environment sensor information and device control instructions;
• wherein the environment sensor information for each of the one or more sets of associated environment sensor information and device control instructions comprises at least visual information.