Video encoding method and apparatus, device, and storage medium

A method comprising:

• transmitting, by at least one central processing unit (CPU), a viewing angle to an encoder;
• receiving, by the at least one CPU, encoded data from the encoder, the encoded data being of only a viewing angle video sequence selected from among N viewing angle video sequences according to the viewing angle that was transmitted, each of the N viewing angle video sequences formed by areas that are in a plurality of panoramic picture frames that comprise a panoramic video, that do not overlap with each other, and that have a same horizontal viewing angle, the sum of the horizontal viewing angles of the N viewing angle video sequences being a total horizontal viewing angle of the panoramic picture frame, N being a positive integer;
• and
• decoding, by the at least one CPU, the encoded data that is received;
• sequentially receiving, by the at least one CPU, encoded data of each of n+m areas that are in n+m viewing angle video sequences and that belong to a same panoramic picture frame, wherein the n+m viewing angle video sequences are viewing angle video sequences corresponding to n consecutive horizontal viewing angles that are adjacent to the horizontal viewing angle and less than the horizontal viewing angle, and viewing angle video sequences corresponding to m consecutive horizontal viewing angles that are adjacent to the horizontal viewing angle and greater than the horizontal viewing angle, n and m are both positive integers, and n+m≤N−1, and
• in response to determining that the viewing angle changes at a moment Ti:
• selecting, by the at least one CPU, encoded data of an ith area in an updated viewing angle video sequence from the buffered encoded data of the n+m areas, decoding the encoded data that is selected, and playing the obtained ith area,
• wherein the updated viewing angle video sequence is a viewing angle video sequence whose horizontal viewing angle matches the changed viewing angle, and
• wherein macroblocks of adjacent areas in the plurality of picture frames are encoded such that the macroblocks of adjacent areas are not dependent on each other.

An apparatus comprising:

• at least one memory configure to store computer program code;
• and
• at least one processor configured to access the at least one memory and operate according to the computer program code, the program code comprising:
• video obtaining code configured to cause at least one of said at least one processor to obtain a panoramic video, the panoramic video being formed by a plurality of panoramic picture frames, each of the plurality of panoramic picture frames being a picture frame formed to record a scenery of a viewing angle;
• video division code configured to cause at least one of said at least one processor to divide the panoramic video into N viewing angle video sequences, each viewing angle video sequence being formed by areas that are in the plurality of panoramic picture frames, that do not overlap with each other, and that have a same horizontal viewing angle, the sum of the horizontal viewing angles of the N viewing angle video sequences being a total horizontal viewing angle of the panoramic picture frame, N being a positive integer;
• video encoding code configured to cause at least one of said at least one processor to encode, respectively, the N viewing angle video sequences to obtain N respective groups of encoded data;
• viewing angle determining code configured to cause at least one of said at least one processor to determine a viewing angle;
• and
• first provision code configured to cause at least one of said at least one processor to select a viewing angle video sequence, from among the N viewing angle video sequences, whose horizontal viewing angle comprises the determined viewing angle, and transmit only encoded data of the selected viewing angle video sequence,
• wherein the first provision code is further configured to:
• in response to determining, at a moment Ti, that the viewing angle changes, skip transmitting encoded data of an ith area in the viewing angle video sequence, where i is a positive integer;
• select an updated viewing angle video sequence, and transmit encoded data of an ith area in the updated viewing angle video sequence to the user, wherein the updated viewing angle video sequence is a viewing angle video sequence whose horizontal viewing angle matches the changed viewing angle;
• and
• update i to i+1, and cyclically transmit encoded data of an ith area in the updated viewing angle video sequence to the user at the moment Ti,
• wherein macroblocks of adjacent areas in the plurality of picture frames are encoded such that the macroblocks of adjacent areas are not dependent on each other.

An apparatus comprising:

• at least one memory configure to store computer program code;
• and
• at least one processor configured to access the at least one memory and operate according to the computer program code, the program code comprising:
• viewing angle provision code configured to cause at least one of said at least one processor to transmit a viewing angle to an encoder;
• first receiving code configured to cause at least one of said at least one processor to receive encoded data from the encoder, the encoded data being of only a viewing angle video sequence selected from among N viewing angle video sequences according to the viewing angle that was transmitted, each of the N viewing angle video sequences formed by areas that are in a plurality of panoramic picture frames that comprise a panoramic video, that do not overlap with each other, and that have a same horizontal viewing angle, the sum of the horizontal viewing angles of the N viewing angle video sequences being a total horizontal viewing angle of the panoramic picture frame, N being a positive integer;
• and
• data decoding code configured to cause at least one of said at least one processor to decode the encoded data that is received,
• wherein the program code further comprises:
• second receiving code configured to cause at least one of said at least one processor to sequentially receive encoded data of each of n+m areas that are in n+m viewing angle video sequences and that belong to a same panoramic picture frame, wherein the n+m viewing angle video sequences are viewing angle video sequences corresponding to n consecutive horizontal viewing angles that are adjacent to the horizontal viewing angle and less than the horizontal viewing angle, and viewing angle video sequences corresponding to m consecutive horizontal viewing angles that are adjacent to the horizontal viewing angle and greater than the horizontal viewing angle, n and m are both positive integers, and n+m≤N−1, and
• wherein the data decoding code further comprises:
• second processing code receiving code configured to cause at least one of said at least one processor to, in response to determining that the viewing angle changes at a moment Ti:
• select encoded data of an ith area in an updated viewing angle video sequence from the buffered encoded data of the n+m areas, decode the encoded data that is selected, and play the obtained ith area,
• wherein the updated viewing angle video sequence is a viewing angle video sequence whose horizontal viewing angle matches the changed viewing angle,
• wherein macroblocks of adjacent areas in the plurality of picture frames are encoded such that the macroblocks of adjacent areas are not dependent on each other.

A non-transitory computer readable storage medium storing computer program code that, when executed by a computer, causes the computer to perform:

• transmitting a viewing angle to an encoder;
• receiving encoded data from the encoder, the encoded data being of only a viewing angle video sequence selected from among N viewing angle video sequences according to the viewing angle that was transmitted, each of the N viewing angle video sequences formed by areas that are in a plurality of panoramic picture frames that comprise a panoramic video, that do not overlap with each other, and that have a same horizontal viewing angle, the sum of the horizontal viewing angles of the N viewing angle video sequences being a total horizontal viewing angle of the panoramic picture frame, N being a positive integer;
• decoding the encoded data that is received;
• sequentially receiving, by the at least one CPU, encoded data of each of n+m areas that are in n+m viewing angle video sequences and that belong to a same panoramic picture frame, wherein the n+m viewing angle video sequences are viewing angle video sequences corresponding to n consecutive horizontal viewing angles that are adjacent to the horizontal viewing angle and less than the horizontal viewing angle, and viewing angle video sequences corresponding to m consecutive horizontal viewing angles that are adjacent to the horizontal viewing angle and greater than the horizontal viewing angle, n and m are both positive integers, and n+m≤N−1, and
• in response to determining that the viewing angle changes at a moment Ti:
• selecting, by the at least one CPU, encoded data of an ith area in an updated viewing angle video sequence from the buffered encoded data of the n+m areas, decoding the encoded data that is selected, and playing the obtained ith area,
• wherein the updated viewing angle video sequence is a viewing angle video sequence whose horizontal viewing angle matches the changed viewing angle, and
• wherein macroblocks of adjacent areas in the plurality of picture frames are encoded such that the macroblocks of adjacent areas are not dependent on each other.

An encoder comprising:

• at least one memory configure to store computer program code;
• and
• at least one processor configured to access the at least one memory and operate according to the computer program code, the program code comprising:
• video obtaining code configured to cause at least one of said at least one processor to obtain a panoramic video, the panoramic video being formed by a plurality of panoramic picture frames, each of the plurality of panoramic picture frames being a picture frame formed to record a scenery of a viewing angle;
• video division code configured to cause at least one of said at least one processor to divide the panoramic video into N viewing angle video sequences, each viewing angle video sequence being formed by areas that are in the plurality of panoramic picture frames, that do not overlap with each other, and that have a same horizontal viewing angle, the sum of the horizontal viewing angles of the N viewing angle video sequences being a total horizontal viewing angle of the panoramic picture frame, N being a positive integer;
• video encoding code configured to cause at least one of said at least one processor to encode, respectively, the N viewing angle video sequences to obtain N respective groups of encoded data;
• viewing angle determining code configured to cause at least one of said at least one processor to determine a viewing angle;
• and
• first provision code configured to cause at least one of said at least one processor to select a viewing angle video sequence, from among the N viewing angle video sequences, whose horizontal viewing angle comprises the determined viewing angle, and transmit only encoded data of the selected viewing angle video sequence,
• wherein the first provision code is further configured to:
• in response to determining, at a moment Ti, that the viewing angle changes, skip transmitting encoded data of an ith area in the viewing angle video sequence, where i is a positive integer;
• select an updated viewing angle video sequence, and transmit encoded data of an ith area in the updated viewing angle video sequence to the user, wherein the updated viewing angle video sequence is a viewing angle video sequence whose horizontal viewing angle matches the changed viewing angle;
• and
• update i to i+1, and cyclically transmit encoded data of an ith area in the updated viewing angle video sequence to the user at the moment Ti,
• wherein macroblocks of adjacent areas in the plurality of picture frames are encoded such that the macroblocks of adjacent areas are not dependent on each other.

A method comprising:

• obtaining, by at least one central processing unit (CPU), a panoramic video formed by a plurality of panoramic picture frames, each of the plurality of panoramic picture frames formed to record a scenery of a panoramic viewing angle;
• dividing, by the at least one CPU, the panoramic video into N viewing angle video sequences, each of the N viewing angle video sequences having a viewing angle that is a non-overlapping subset of the panoramic viewing angle, wherein a sum of the viewing angles of the N viewing angle video sequences totals the panoramic viewing angle, N being a positive integer;
• encoding, by the at least one CPU, the N viewing angle video sequences;
• determining, by the at least one CPU, a viewing angle;
• selecting, by the at least one CPU, a viewing angle video sequence, from among the N viewing angle video sequences, whose horizontal viewing angle comprises the determined viewing angle;
• and
• transmitting, by the at least one CPU, only encoded data of the selected viewing angle video sequence,
• wherein the method further comprises:
• in response to determining, at a moment Ti, that the viewing angle changes, skipping, by the at least one CPU, transmitting encoded data of an ith area in the viewing angle video sequence, where i is a positive integer;
• selecting, by the at least one CPU, an updated viewing angle video sequence, and transmitting encoded data of an ith area in the updated viewing angle video sequence to the user, wherein the updated viewing angle video sequence is a viewing angle video sequence whose horizontal viewing angle matches the changed viewing angle;
• and
• updating, by the at least one CPU, i to i+1, and cyclically performing the step of transmitting encoded data of an ith area in the updated viewing angle video sequence to the user at the moment Ti,
• wherein macroblocks of adjacent areas in the plurality of picture frames are encoded such that the macroblocks of adjacent areas are not dependent on each other.