Remote operation method and remote operation device

A device to perform remote operation of a mobile vehicle, comprising;

• a memory device in which various information is stored;
• a processor configured to process the various information;
• and
• a display from which an image processed by the processor is output,
• wherein the various information includes data of two types of camera images whose imaging ranges partially overlap each other and data of operation content in the remote operation,
• wherein the processor is configured to:
• setting a position in a vertical direction at which the two types of camera images are combined based on the data of the operation content;
• and
• composite the two types of the camera images by moving at least one of the two types of the camera images in the vertical direction such that the two types of the camera images are combined at the set position in the vertical direction;
• and
• output from the display the composite image of the two kinds of the camera images, wherein:
• when the operation content is an indication to check a traffic situation of an intersection;
• the camera images are combined at a far side of the camera images such that an operator can look over the entire intersection;
• and
• when the operation content comprises an indication to check surroundings for vehicle control for avoiding a contact with an obstacle ahead or an indication to perform the vehicle control for avoiding a contact with an obstacle ahead by the remote operation;
• the camera images are combined at a near side of the camera images such that the operator can check an approaching situation of the vehicle with respect to the obstacle.

A method to perform remote operation of a mobile vehicle, the method comprising the steps of:

• acquiring data of two types of camera images whose imaging ranges partially overlap with each other and data of operation content in the remote operation, the data of the operation content comprising a binary number indicating the operation content, and a correspondence between the binary number indicating the operation content and a connecting position being set in advance;
• setting a connecting position based on the binary number indicating the operation content and the correspondence between the binary number indicating the operation content and the connecting position;
• setting a vertical position at which the two types of camera images are combined based on the connecting position;
• compositing the two types of the camera images by moving at least one of the two types of the camera images in the vertical direction such that the two types of the camera images are combined at the set position in the vertical direction;
• and
• outputting the composite image of the two types of the camera images on a display of a remote operation device, wherein:
• when the operation content is an indication to check a traffic situation of an intersection, the camera images are combined at a far side of the camera images such that an operator can look over the entire intersection, and
• when the operation content comprises an indication to check surroundings for vehicle control for avoiding a contact with an obstacle ahead or an indication to perform the vehicle control for avoiding a contact with an obstacle ahead by the remote operation, the camera images are combined at a near side of the camera images such that the operator can check an approaching situation of the vehicle with respect to the obstacle.