Transmission apparatus, mixed reality system, transmission method, and program

A transmission apparatus for transmitting, to a reception apparatus, first video captured by an imaging apparatus and second video captured to detect a position and orientation of the imaging apparatus when capturing the first video, comprising:

• a memory containing instructions;
• and
• at least one processor for executing the instructions, the instructions being executed to operate as
• a bandwidth determination unit configured to determine a communication bandwidth between the transmission apparatus and the reception apparatus;
• an accuracy determination unit configured to determine, using condition information received from the reception apparatus, estimation accuracy of the position and orientation of the imaging apparatus using the second video;
• a control unit configured to determine transmission rates of the first video and the second video in response to determining that the communication bandwidth has become narrow, and decrease the transmission rate of the second video in response to determining that the estimation accuracy exceeds a threshold and decrease the transmission rate of the first video in response to determining that the estimation accuracy is lower than the threshold;
• a first compression unit configured to compress the first video in accordance with the determined transmission rate;
• a second compression unit configured to compress the second video in accordance with the determined transmission rate;
• and
• a transmission unit configured to transmit the compressed first video and the compressed second video to the reception apparatus.

A transmission apparatus for transmitting, to a reception apparatus, first video captured by an imaging apparatus and second video captured to detect a position and orientation of the imaging apparatus when capturing the first video, comprising:

• a memory containing instructions;
• and
• at least one processor for executing the instructions, the instructions being executed to operate as
• a bandwidth determination unit configured to determine a communication bandwidth between the transmission apparatus and the reception apparatus;
• a control unit configured to determine, in response to determining that the communication bandwidth has become narrow, transmission rates of the first video and the second video, and decrease the transmission rate of the second video in response to determining that the current transmission rate of the second video exceeds a threshold and decrease the transmission rate of the first video in response to determining that the current transmission rate of the second video is not higher than the threshold;
• a first compression unit configured to compress the first video in accordance with the determined transmission rate;
• a second compression unit configured to compress the second video in accordance with the determined transmission rate;
• and
• a transmission unit configured to transmit the compressed first video and the compressed second video to the reception apparatus.

A transmission method comprising:

• controlling a transmission rate of first video and a transmission rate of second video so that a transmission rate ratio between the first video and the second video changes, wherein the first video is captured by an imaging apparatus and the second video is captured to detect a position and orientation of the imaging apparatus when capturing the first video;
• and
• transmitting the first video and the second video to a reception apparatus in accordance with the controlled transmission rates,
• wherein:
• if a communication bandwidth between a transmission apparatus and the reception apparatus is smaller than a sum of a first setting value and a second setting value, the transmission rate of the first video is controlled to be smaller than the first setting value, and the transmission rate of the second video is controlled to be equal to the second setting value;
• and
• if the communication bandwidth exceeds the sum of the first setting value and the second setting value, the transmission rate of the first video is controlled to be equal to the first setting value, and the transmission rate of the second video is controlled to exceed the second setting value.

A non-transitory computer-readable medium storing a program comprising instructions for causing a computer to perform a method comprising:

• controlling a transmission rate of first video and a transmission rate of second video so that a transmission rate ratio between the first video and the second video changes, wherein the first video is captured by an imaging apparatus and the second video is captured to detect a position and orientation of the imaging apparatus when capturing the first video;
• and
• transmitting the first video and the second video to a reception apparatus in accordance with the controlled transmission rates,
• wherein:
• if a communication bandwidth between a transmission apparatus and the reception apparatus is smaller than a sum of a first setting value and a second setting value, the transmission rate of the first video is controlled to be smaller than the first setting value, and the transmission rate of the second video is controlled to be equal to the second setting value;
• and
• if the communication bandwidth exceeds the sum of the first setting value and the second setting value, the transmission rate of the first video is controlled to be equal to the first setting value, and the transmission rate of the second video is controlled to exceed the second setting value.