Video display system, observation device, information processing method, and recording medium

A video display system for displaying a display video via a display device, the video display system comprising:

• a VR device including the display device that displays the display video;
• an observation device provided in a mobile object to give the observation device mobility, the observation device including a capturing unit configured to capture video, a data obtaining unit configured to obtain data related to a movement speed of the capturing unit and a movement state of the mobile object and to obtain cue data indicating how the mobile object will move, and a transmission unit configured to transmit, together with the data and the cue data, the video captured;
• a video generation unit configured to generate the display video including the video received;
• and
• an information processing device connected to the observation device and the VR device over a network, wherein:
• the information processing device includes a reception unit, a presentation unit, a movement state calculation unit, a metadata composition unit, and a processing device transmission unit,
• the reception unit is configured to receive, from the observation device, a wide-angle video as the video, the data and the cue data,
• the movement state calculation unit is configured to calculate a movement state of the observation device based on the wide-angle video, the data and the cue data,
• the presentation unit is configured to cause the video generation unit to generate and output a graphic corresponding to the movement speed of the capturing unit and how the mobile object will move from the data and the cue data received, and before the mobile object starts moving, superimpose the graphic to present the movement speed and how the mobile object will move,
• the graphic is based on the movement state calculated by the movement state calculation unit,
• the graphic displays a guide indication via a figure on the display video in a manner assigned per movement state in the data received,
• the metadata composition unit is configured to generate metadata including the graphic, the data, and the movement state, and
• the processing device transmission unit is configured to transmit information including the wide-angle video and the metadata, before the mobile object starts moving.

A video display system for displaying a display video via a display device, the video display system comprising:

• a VR device including the display device that displays the display video;
• an observation device provided in a mobile object to give the observation device mobility, the observation device including a capturing unit configured to capture video, a data obtaining unit configured to obtain data related to a movement speed of the capturing unit and a movement state of the mobile object and to obtain cue data indicating how the mobile object will move, and a transmission unit configured to transmit, together with the data and the cue data, the video captured;
• a video generation unit configured to generate the display video including the video received;
• and
• an information processing device connected to the observation device and the VR device over a network, wherein:
• the information processing device includes:
• a first reception unit configured to receive, from the observation device, a wide-angle video as the video, the data and the cue data;
• a second reception unit configured to receive data related to an orientation of the VR device;
• a movement state calculation unit configured to calculate a movement state of the observation device based on the wide-angle video, the data and the cue data;
• a differential calculation unit configured to calculate a relative movement direction based on a difference between the orientation of the VR device and movement information related to movement of the capturing unit, the relative movement direction being a movement direction of the capturing unit relative to the orientation of the VR device;
• a presentation unit configured to cause the video generation unit to generate and output a graphic corresponding to the movement speed of the capturing unit and how the mobile object will move from the data and the cue data received, and before the mobile object starts moving, superimpose the graphic to present the movement speed and how the mobile object will move, the graphic displaying a guide indication via a figure on the display video in a manner assigned per movement state in the data received, the graphic indicating the difference calculated and the movement state of the observation device;
• a video compositing unit configured to composite the graphic onto the wide-angle video based on the difference and the movement state;
• and
• a transmission unit configured to transmit the video composited by the video compositing unit and other information, before the mobile object starts moving.

An information processing method for displaying a display video on a VR device, the method comprising:

• receiving, by an information processing device connected to an observation device and the VR device over a network and provided in a mobile object to give the observation device mobility, data related to (i) a movement speed of a capturing unit provided in the observation device and configured to move with the mobile object and capture video and (ii) a movement state of the mobile object;
• receiving cue data, by the information processing device, indicating how the mobile object will move;
• receiving, by the information processing device, a wide-angle video, as the video, transmitted from the observation device;
• calculating, by the information processing device, a movement state of the observation device based on the wide-angle video, the data and the cue data;
• generating and outputting, by the information processing device, a graphic corresponding to the movement speed of the capturing unit and how the mobile object will move from the data and the cue data received, and before the mobile object starts moving, superimposing the graphic to present the movement speed of the capturing unit and how the mobile object will move, the graphic indicating the movement state calculated and displaying a guide indication via a figure on the display video in a manner assigned per movement state in the data received;
• generating, by the information processing device, the display video including the video received, and superimposing the graphic onto a portion of the wide-angle video based on the data and the movement state;
• and
• transmitting, by the information processing device, the wide-angle video together with other information, before the mobile object starts moving.