Method for training a conditional neural process for determining a position of an object from image data

A method for determining a position of an object, the method comprising the following steps:

• providing image data, wherein the image data include target image data showing the object and labeled comparison image data regarding the object;
• providing a trained conditional neural process, the conditional neural process being trained for determining a position of an object from image data by:
• providing training data for training the conditional neural process, wherein the training data include labeled image data showing a particular object and labeled comparison image data regarding the particular object;
• and
• training the conditional neural process based on the provided training data, wherein the training of the conditional neural process includes applying functional contrastive learning, and the training of the conditional neural process includes applying an end-to-end learning approach;
• and
• determining, using the trained conditional neural process for determining a position of an object from image data, the position of the object based on the provided image data.

A method for controlling a controllable system, the method comprising the following steps:

• determining a position of an object by:
• providing image data, wherein the image data include target image data showing the object and labeled comparison image data regarding the object;
• providing a trained conditional neural process, the conditional neural process being trained for determining a position of an object from image data by:
• providing training data for training the conditional neural process, wherein the training data include labeled image data showing a particular object and labeled comparison image data regarding the particular object;
• and
• training the conditional neural process based on the provided training data, wherein the training of the conditional neural process includes applying functional contrastive learning, and the training of the conditional neural process includes applying an end-to-end learning approach;
• and
• determining, using the trained conditional neural process for determining a position of an object from image data, the position of the object based on the provided image data;
• and
• controlling the controllable system based on the determined position of the object.

A control device for determining a position of an object, the control device comprising:

• a provisioning unit configured to provide image data, wherein the image data comprise target image data showing the object and labeled comparison image data regarding the object;
• a reception unit configured to receive a trained conditional neural process, the conditional neural process being trained by a control device for training a conditional neural network for determining a position of an object from image data for determining a position of an object from image data, the control device for training including:
• a provisioning unit configured to provide training data for training the conditional neural process, wherein the training data include labeled image data showing a particular object and labeled comparison image data regarding the particular object;
• and
• a training unit configured to train the conditional neural process based on the provided training data, wherein the training of the conditional neural process includes applying functional contrastive learning, and the training of the conditional neural process includes applying an end-to-end learning approach;
• and
• a determination unit configured to determine, using the provided trained conditional neural process for determining an object from image data, the position of the object based on the provided image data.

A control device for controlling a controllable system, the control device comprising:

• a reception unit configured to receive a position of an object determined by a control device for determining a position of an object including:
• a provisioning unit configured to provide image data, wherein the image data comprise target image data showing the object and labeled comparison image data regarding the object;
• a reception unit configured to receive a trained conditional neural process, the conditional neural process being trained by a control device for training a conditional neural network for determining a position of an object from image data for determining a position of an object from image data, the control device for training including:
• a provisioning unit configured to provide training data for training the conditional neural process, wherein the training data include labeled image data showing a particular object and labeled comparison image data regarding the particular object;
• and
• a training unit configured to train the conditional neural process based on the provided training data, wherein the training of the conditional neural process includes applying functional contrastive learning, and the training of the conditional neural process includes applying an end-to-end learning approach;
• and
• a determination unit configured to determine, using the provided trained conditional neural process for determining an object from image data, the position of the object based on the provided image data;
• and
• a control unit configured to control the controllable system based on the determined position of the object.