# US 12,225,249 B2 · Transmission of groups of coded picture frames > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,225,249 B2 - Document ID: US12225249B2 - Status: Granted - Kind: B2 - Application number: 18/140,490 - Filed: 2023-04-27 - Published: 2023-08-17 - Granted: 2025-02-11 - Earliest claimed: 2021-07-15 - Assignees: Tencent Technology (Shenzhen) Company Limited - Applicants: Tencent Technology (Shenzhen) Company Limited - Inventors: Junling Mao - Web page: https://patentgrep.com/patent/US12225249B2 ## CPC - H04N 21/2343: involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements {(video transcoding H04N19/40; media packet handling at the source H04L65/762)} - H04N 21/23655: {Statistical multiplexing, e.g. by controlling the encoder to alter its bitrate to optimize the bandwidth utilization} - H04N 21/6131: {involving transmission via a mobile phone network (wireless downlink channel access H04W74/006)} - H04N 21/6181: {involving transmission via a mobile phone network (arrangements for providing broadcast or conference services to substation in data switching networks in combination with wireless systems H04L12/189; wireless uplink channel access H04W74/004)} - H04N 21/64738: {Monitoring network characteristics, e.g. bandwidth, congestion level (data switched network analysis H04L41/14; monitoring functioning in data switched networks H04L43/0817; flow control in packet networks H04L47/10)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A video stream processing method is provided. A first group of coded picture frames in a video stream is received. A storage time and a network request protection time corresponding to the first group are determined. The storage time is an amount of time an intra frame of the first group is stored for transmission to a network node. When a transmission conflict with at least one second terminal occurs in a process of transmitting the intra frame to the network node, a start time of at least a second group of coded picture frames in the video stream is determined according to the storage time and the network request protection time, the second group being after the first group. An intra frame of the second group is transmitted to the network node based on the start time of the second group. ## Claims ### Claim 1 A video stream processing method, comprising: receiving a first group of coded picture frames in a video stream; determining a storage time and a network request protection time corresponding to the first group of coded picture frames, the storage time being an amount of time an intra frame of the first group of coded picture frames is stored for transmission to a network node; when the storage time is greater than a preset time threshold and a preset condition is met, indicating a transmission conflict with at least one second terminal occurs in a process of transmitting the intra frame to the network node, determining a start time of at least a second group of coded picture frames in the video stream according to the storage time and the network request protection time, the second group of coded picture frames being after the first group of coded picture frames; and transmitting an intra frame of the second group of coded picture frames to the network node based on the start time of the second group of coded picture frames. ### Claim 2 (depends on 1) The method according to claim 1, wherein the determining the network request protection time comprises: determining the network request protection time based on an obtained network scheduling request time and a preset protection time. ### Claim 3 (depends on 1) The method according to claim 1, wherein the determining the start time of at least the second group of coded picture frames comprises: determining the start time of the second group of coded picture frames according to a start time of the storage of the intra frame of the first group of coded picture frames for transmission, an intra frame transmit adjustment time, and a preset group of coded picture frames cycle. ### Claim 4 (depends on 3) The method according to claim 3, further comprising: determining the intra frame transmit adjustment time according to a frame cycle of the video stream, the storage time, and the network request protection time, wherein the intra frame transmit adjustment time is an integer multiple of the frame cycle. ### Claim 5 (depends on 4) The method according to claim 4, wherein the determining the intra frame transmit adjustment time comprises: calculating a difference between the storage time and the network request protection time, to obtain a first value; obtaining a second value based on m times the frame cycle of the video stream and the first value; and when the second value is a minimum non-negative integer, determining m times of the frame cycle of the video stream as the intra frame transmit adjustment time, wherein m is a positive integer. ### Claim 6 (depends on 1) The method according to claim 1, wherein the transmitting the intra frame of the second group of coded picture frames comprises: when the intra frame of the second group of coded picture frames is obtained after the start time of the second group of coded picture frames, storing the intra frame of the second group of coded picture frames by a first terminal, and transmitting the intra frame of the second group of coded picture frames to the network node. ### Claim 7 (depends on 1) The method according to claim 1, further comprising: resetting the video stream or adjusting a length of the first group of coded picture frames; obtaining the intra frame of the second group of coded picture frames at the start time corresponding to the second group of coded picture frames; and storing the obtained intra frame of the second group of coded picture frames by a first terminal. ### Claim 8 (depends on 1) The method according to claim 1, further comprising: when the storage time is greater than the preset time threshold and the preset condition is met, determining that the transmission conflict with the at least one second terminal occurs in the process of transmitting the intra frame of the first group of coded picture frames to the network node. ### Claim 9 (depends on 8) The method according to claim 8, wherein the preset time threshold is determined by at least one of a network scheduling request time or an uplink frame waiting time corresponding to the intra frame of the first group of coded picture frames. ### Claim 10 (depends on 9) The method according to claim 9, wherein the preset condition includes at least one of: the intra frame of the first group of coded picture frames is a first intra frame uplink transmission of the video stream; uplink transmission times of intra frames in a plurality of consecutive third groups of coded picture frames in the video stream are greater than a time threshold, the plurality of third groups of coded picture frames being before the first group of coded picture frames; or the storage time is greater than a sum of the time threshold and a frame cycle of the video stream. ### Claim 11 A video stream processing apparatus, comprising: processing circuitry configured to: receive a first group of coded picture frames in a video stream; determine a storage time and a network request protection time corresponding to the first group of coded picture frames, the storage time being an amount of time an intra frame of the first group of coded picture frames is stored for transmission to a network node; when the storage time is greater than a preset time threshold and a preset condition is met, indicating a transmission conflict with at least one second terminal occurs in a process of transmitting the intra frame to the network node, determine a start time of at least a second group of coded picture frames in the video stream according to the storage time and the network request protection time, the second group of coded picture frames being after the first group of coded picture frames; and transmit an intra frame of the second group of coded picture frames to the network node based on the start time of the second group of coded picture frames. ### Claim 12 (depends on 11) The video stream processing apparatus according to claim 11, wherein the processing circuitry is configured to: determine the network request protection time based on an obtained network scheduling request time and a preset protection time. ### Claim 13 (depends on 11) The video stream processing apparatus according to claim 11, wherein the processing circuitry is configured to: determine the start time of the second group of coded picture frames according to a start time of the storage of the intra frame of the first group of coded picture frames for transmission, an intra frame transmit adjustment time, and a preset group of coded picture frames cycle. ### Claim 14 (depends on 13) The video stream processing apparatus according to claim 13, wherein the processing circuitry is configured to: determine the intra frame transmit adjustment time according to a frame cycle of the video stream, the storage time, and the network request protection time, wherein the intra frame transmit adjustment time is an integer multiple of the frame cycle. ### Claim 15 (depends on 14) The video stream processing apparatus according to claim 14, wherein the processing circuitry is configured to: calculate a difference between the storage time and the network request protection time, to obtain a first value; obtain a second value based on m times the frame cycle of the video stream and the first value; and when the second value is a minimum non-negative integer, determine m times of the frame cycle of the video stream as the intra frame transmit adjustment time, wherein m is a positive integer. ### Claim 16 (depends on 11) The video stream processing apparatus according to claim 11, wherein the processing circuitry is configured to: when the intra frame of the second group of coded picture frames is obtained after the start time of the second group of coded picture frames, store the intra frame of the second group of coded picture frames by the video stream processing apparatus, and transmit the intra frame of the second group of coded picture frames to the network node. ### Claim 17 (depends on 11) The video stream processing apparatus according to claim 11, wherein the processing circuitry is configured to: reset the video stream or adjust a length of the first group of coded picture frames; obtain the intra frame of the second group of coded picture frames at the start time corresponding to the second group of coded picture frames; and store the obtained intra frame of the second group of coded picture frames by the first terminal video stream processing apparatus. ### Claim 18 (depends on 11) The video stream processing apparatus according to claim 11, wherein the processing circuitry is configured to, when the storage time is greater than the preset time threshold and the preset condition is met, determine that the conflict with the at least one second terminal occurs in the process of transmitting the intra frame of the first group of coded picture frames to the network node. ### Claim 19 (depends on 18) The video stream processing apparatus according to claim 18, wherein the preset time threshold is determined by at least one of a network scheduling request time or an uplink frame waiting time corresponding to the intra frame of the first group of coded picture frames; and the preset condition includes at least one of: the intra frame of the first group of coded picture frames is a first intra frame uplink transmission of the video stream; uplink transmission times of intra frames in a plurality of consecutive third groups of coded picture frames in the video stream are greater than a time threshold, the plurality of third groups of coded picture frames being before the first group of coded picture frames; or the storage time is greater than a sum of the time threshold and a frame cycle of the video stream. ### Claim 20 A non-transitory computer-readable storage medium, storing instructions which when executed by a processor cause the processor to perform: receiving a first group of coded picture frames in a video stream; determining a storage time and a network request protection time corresponding to the first group of coded picture frames, the storage time being an amount of time an intra frame of the first group of coded picture frames is stored for transmission to a network node; when the storage time is greater than a preset time threshold and a preset condition is met, indicating a transmission conflict with at least one second terminal occurs in a process of transmitting the intra frame to the network node, determining a start time of at least a second group of coded picture frames in the video stream according to the storage time and the network request protection time, the second group of coded picture frames being after the first group of coded picture frames; and transmitting an intra frame of the second group of coded picture frames to the network node based on the start time of the second group of coded picture frames.