Back to results
US 11,240,480 B2Granted
Client apparatus, client apparatus processing method, server, and server processing method
AssigneeSony Corporation
InventorIkuo Tsukagoshi
Life of this patent
Estimating the term…
Abstract
Multiple clients (viewers) are allowed to share their VR spaces for communication with one another. A server-distributed stream including a video stream obtained by encoding a background image is received from a server. A client-transmitted stream including representative image meta information for displaying a representative image of another client is received from another client apparatus. The video stream is decoded to obtain the background image. The image data of the representative image is generated on the basis of the representative image meta information. Display image data is obtained by synthesizing the representative image on the background image.
Claims12
A client apparatus comprising:
- a receiver configured to receive a server-distributed stream including a video stream obtained by encoding a background image, the background image having a viewing angle of at least 180 degrees, the receiver further configured to receive from another client apparatus a client-transmitted stream including audio data and representative image meta information corresponding to a representative image of the another client apparatus, the representative image meta information including synthesis position information indicating a synthesis position of the representative image within the background image;
- and
- processing circuitry configured to
- decode the video stream to obtain the background image,
- generate the representative image on the basis of the representative image meta information,
- perform an audio output process on the audio data of the client-transmitted stream to generate audio output data having a sound position corresponding to the synthesis position of the representative image within the background image, and
- synthesize the representative image on the background image based on the synthesis position information.
4 more elements
A client apparatus processing method comprising:
- receiving with a receiver a server-distributed stream from a server that includes a video stream obtained by encoding a background image, the background image having a viewing angle of at least 180 degrees, and also receiving from another client apparatus a client-transmitted stream including audio data and representative image meta information for displaying a representative image of the another client apparatus, the representative image meta information including synthesis position information indicating a synthesis position of the representative image within the background image;
- and
- controlling with processing circuitry
- decoding the video stream to obtain the background image,
- generating the representative image on the basis of the representative image meta information,
- performing an audio output process on the audio data of the client-transmitted stream to generate audio output data having a sound position corresponding to the synthesis position of the representative image within the background image, and
- synthesizing the representative image on the background image based on the synthesis position information.
4 more elements
A server comprising:
- an imaging circuitry configured to capture an image of a subject to obtain a background image, the background image having a viewing angle of at least 180 degrees;
- and
- a transmitter configured to transmit to a client apparatus a server-distributed stream including a video stream obtained by encoding the background image;
- wherein information indicating an allowable synthesis range is inserted in a layer of the video stream and/or in a layer of the server-distributed stream, the allowable synthesis range corresponding to a sub-section of the background image indicating that placement of a representative image is allowed only in the sub-section of the background image.
1 more element
A non-transitory computer readable medium having computer readable instructions that, when executed by a processor, perform a method, the method comprising:
- receiving with a receiver a server-distributed stream from a server that includes a video stream obtained by encoding a background image, the background image having a viewing angle of at least 180 degrees, and also receiving from another client apparatus a client-transmitted stream including audio data and representative image meta information for displaying a representative image of the another client apparatus, the representative image meta information including synthesis position information indicating a synthesis position of the representative image within the background image;
- and
- controlling with processing circuitry
- decoding the video stream to obtain the background image,
- generating the representative image on the basis of the representative image meta information,
- performing an audio output process on the audio data of the client-transmitted stream to generate audio output data having a sound position corresponding to the synthesis position of the representative image within the background image, and
- synthesizing the representative image on the background image based on the synthesis position information.
4 more elements
Dependencies are inferred from the claim text.