# US 2019/0246104 A1 · Panoramic video processing method, device and system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0246104 A1 - Document ID: US20190246104A1 - Status: Published application - Kind: A1 - Application number: 16/389,556 - Filed: 2019-04-19 - Published: 2019-08-08 - Earliest claimed: 2016-10-26 - Assignees: Autel Robotics Co., Ltd. - Applicants: Autel Robotics Co., Ltd. - Inventors: Yang LIU - Web page: https://patentgrep.com/patent/US20190246104A1 ## CPC - H04N 19/115: Selection of the code volume for a coding unit prior to coding - H04N 13/275: from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals - H04N 13/332: Displays for viewing with the aid of special glasses or head-mounted displays [HMD] - H04N 19/146: Data rate or code amount at the encoder output - H04N 19/164: Feedback from the receiver or from the transmission channel - H04N 19/167: Position within a video image, e.g. region of interest [ROI] - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras} - H04N 21/440236: {by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Implementations of the present application provide a panoramic video processing method, device and system. A terminal device receives a partition parameter sent by a display device, then determines a first video area and a second video area in a panoramic video picture according to the partition parameter, processes video data in the first video area at a first bit rate, and processes video data in the second video area at a second bit rate. In this way, an image corresponding to a user observation area is processed at a high bit rate, and an image corresponding to a user non-observation area is processed at a low bit rate, thereby ensuring that timeliness of image transmission between the display device and the terminal device, clarity of a video image viewed by a user, and user experience are improved in a case of a limited channel bandwidth. ## Claims ### Claim 1 A panoramic video processing method, comprising: receiving a partition parameter sent by a display device; determining a first video area and a second video area in a panoramic video picture according to the partition parameter; and processing video data in the first video area at a first bit rate, and processing video data in the second video area at a second bit rate. ### Claim 2 (depends on 1) The panoramic video processing method according to claim 1, wherein the partition parameter is a partition position of a panoramic video picture determined according to a user perspective of the display device. ### Claim 3 (depends on 1) The panoramic video processing method according to claim 1, wherein the processing video data in the first video area at the first bit rate, and processing video data in the second video area at the second bit rate is specifically: performing compression coding on the video data in the first video area at the first bit rate; and performing compression coding on the video data in the second video area at the second bit rate. ### Claim 4 (depends on 3) The panoramic video processing method according to claim 3, further comprising: sending a video bitstream on which the compression coding is performed to the display device in a wireless transmission manner. ### Claim 5 (depends on 2) The panoramic video processing method according to claim 2, wherein the processing video data in the first video area at the first bit rate, and processing video data in the second video area at the second bit rate is specifically: performing compression coding on the video data in the first video area at the first bit rate; and performing compression coding on the video data in the second video area at the second bit rate. ### Claim 6 (depends on 1) The panoramic video processing method according to claim 1, wherein the processing video data in the first video area at the first bit rate, and processing video data in the second video area at the second bit rate is specifically: determining a first group of cameras for photographing the first video area, and setting an output bit rate of the first group of cameras to the first bit rate; and determining a second group of cameras for photographing the second video area, and setting an output bit rate of the second group of cameras to the second bit rate. ### Claim 7 (depends on 1) The panoramic video processing method according to claim 1, wherein the processing video data in the first video area at the first bit rate, and processing video data in the second video area at the second bit rate is specifically: determining a first group of cameras for photographing the first video area, performing compression coding on video data photographed by the first group of cameras separately at the first bit rate and the second bit rate, and selecting video data on which the compression coding is performed at the first bit rate as video data that needs to be transmitted; and determining a second group of cameras for photographing the second video area, performing compression coding on video data photographed by the second group of cameras separately at the first bit rate and the second bit rate, and selecting video data on which the compression coding is performed at the second bit rate as video data that needs to be transmitted. ### Claim 8 (depends on 7) The panoramic video processing method according to claim 7, further comprising: sending, to the display device in a wireless transmission manner, the video data that needs to be transmitted. ### Claim 9 (depends on 2) The panoramic video processing method according to claim 2, wherein the processing video data in the first video area at the first bit rate, and processing video data in the second video area at the second bit rate is specifically: determining a first group of cameras for photographing the first video area, performing compression coding on video data photographed by the first group of cameras separately at the first bit rate and the second bit rate, and selecting video data on which the compression coding is performed at the first bit rate as video data that needs to be transmitted; and determining a second group of cameras for photographing the second video area, performing compression coding on video data photographed by the second group of cameras separately at the first bit rate and the second bit rate, and selecting video data on which the compression coding is performed at the second bit rate as video data that needs to be transmitted. ### Claim 10 A panoramic video processing method, wherein the method comprises: sending a partition parameter to a terminal device; and receiving a panoramic video picture fed back by the terminal device according to the partition parameter, the panoramic video picture comprising a first video area and a second video area, video data in the first video area being processed at a first bit rate, and video data in the second video area being processed at a second bit rate. ### Claim 11 (depends on 10) The method according to claim 10, wherein after the step of receiving the panoramic video picture fed back by the terminal device according to the partition parameter, the method further comprises: building a sphere model in a virtual three-dimensional space; and mapping the panoramic video picture to a spherical shell of the sphere model, to obtain a spherical video picture shown by the sphere model. ### Claim 12 (depends on 11) The method according to claim 11, wherein the partition parameter is a partition position of a panoramic video picture determined according to a user perspective. ### Claim 13 (depends on 11) The method according to claim 11, wherein after the step of mapping the panoramic video picture to a spherical shell of the sphere model to obtain a spherical video picture shown by the sphere model, the method further comprises: obtaining, in the spherical video picture, first identification information of an image corresponding to the first video area and second identification information of an image corresponding to the second video area; and integrating the first identification information and the second identification information into the partition parameter. ### Claim 14 (depends on 11) The method according to claim 11, wherein after the step of receiving the panoramic video picture fed back by the terminal device according to the partition parameter, the method further comprises: displaying the image corresponding to the first video area or the image corresponding to the second video area in the spherical video picture. ### Claim 15 (depends on 11) The method according to claim 11, wherein the method further comprises: detecting whether a partition position of a panoramic video picture corresponding to the user perspective changes, and if yes, resending the partition parameter to the terminal device. ### Claim 16 A panoramic video processing system, wherein the system comprises: a display device, configured to send a partition parameter to a terminal device; and a terminal device, configured to: determine a first video area and a second video area in a panoramic video picture according to the partition parameter, process video data in the first video area at a first bit rate, and process video data in the second video area at a second bit rate. ### Claim 17 (depends on 16) The panoramic video processing system according to claim 16, wherein the partition parameter is a partition position of a panoramic video picture determined according to a user perspective of the display device. ### Claim 18 (depends on 16) The panoramic video processing system according to claim 16, wherein the terminal device is further configured to: perform compression coding on the video data in the first video area at the first bit rate; and perform compression coding on the video data in the second video area at the second bit rate. ### Claim 19 (depends on 18) The panoramic video processing system according to claim 18, wherein the terminal device is further configured to: send a video bitstream on which the compression coding is performed to the display device in a wireless transmission manner. ### Claim 20 (depends on 16) The panoramic video processing system according to claim 16, wherein the terminal device is further configured to: determine a first group of cameras for photographing the first video area, and setting an output bit rate of the first group of cameras to the first bit rate; and determine a second group of cameras fir photographing the second video area, and setting an output bit rate of the second group of cameras to the second bit rate.