# US 10,313,412 B1 · Latency reduction for streaming content replacement > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,313,412 B1 - Document ID: US10313412B1 - Status: Granted - Kind: B1 - Application number: 15/472,628 - Filed: 2017-03-29 - Granted: 2019-06-04 - Earliest claimed: 2017-03-29 - Assignees: Twitch Interactive, Inc. - Applicants: Twitch Interactive, Inc. - Inventors: Cyrus Hall; Daniel Lin; Maciej Laszcz; Luke Curley; Matthew Louis Szatmary; Abhinav Kapoor; Daniel Arthur McClain; Diana Lu; Scott Wang; Spencer Nelson; Phillip Conover; Scott Rabin; Jorge Arturo Villatoro - Web page: https://patentgrep.com/patent/US10313412B1 ## CPC - H04L 43/106: using time related information in packets, e.g. by adding timestamps - H04L 65/765: {intermediate} - H04L 65/80: Responding to QoS - H04L 12/40013: {Details regarding a bus controller} - H04L 12/403: with centralised control, e.g. polling - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract First streaming video content may be received from a provider. The provider may issue a request to replace part of the first streaming video content with replacement content, such as advertisements. Second streaming video content may be selected as a replacement for a first video player, while third streaming video content may be selected as a replacement for a second video player. Instructions may be sent to the first and the second video player to play a first portion of the first streaming video content, followed by their respective selected replacement content, followed by a third portion of the first streaming video content, with the respective selected replacement content replacing a second portion of the first streaming video content. Replacement of the second portion of the first streaming video content may sometimes introduce latency, which may be reduced using various techniques. ## Claims ### Claim 1 A computing system for replacing live streaming video content comprising: one or more processors; and one or more memories having stored therein instructions that, upon execution by the one or more processors, cause the computing system perform operations comprising: transmitting, to a first video player, first instructions to play a first portion of first live streaming video content, followed by second streaming video content, followed by a third portion of the first live streaming video content, wherein the second streaming video content replaces a second portion of the first live streaming video content, wherein a duration of the second streaming video content exceeds a duration of the second portion of the first live streaming video content by a first excess duration, wherein the first excess duration is limited to no more than a segment duration of the first live streaming video content, and wherein the first excess duration introduces a first latency to playing of the first live streaming video content; transmitting, to the first video player, the first portion of first live streaming video content, the second streaming video content, and the third portion of the first live streaming video content; and removing at least part of the first latency from at least part of the first live streaming video content that is played subsequent to the second streaming video content. ### Claim 2 (depends on 1) The computing system of claim 1, wherein the operations further comprise: transmitting, to the first video player, instructions to play third streaming video content that replaces a fourth portion of the first live streaming video content, wherein a duration of the third streaming video content exceeds a duration of the fourth portion of the first live streaming video content by a second excess duration; and determining that a sum of the first excess duration and the second excess duration meets or exceeds a segment duration of the first live streaming video content, and wherein the removing the at least part of the first latency comprises dropping a segment of the first live streaming video content from playing by the first video player. ### Claim 3 (depends on 1) The computing system of claim 1, wherein the removing the at least part of the first latency comprises: determining a first frame of the first live streaming video content associated with a transition from playing of the second streaming video content to playing of the first live streaming video content; identifying a first timestamp value assigned to the first frame; and adjusting a timestamp of one or more frames of the first live streaming video content prior to the first frame from a previously assigned timestamp value to the first timestamp value. ### Claim 4 (depends on 1) The computing system of claim 1, wherein the removing the at least part of the first latency comprises increasing a rate at which one or more frames of the first video content are played by the first video player. ### Claim 5 A computer-implemented method for replacing streaming video content comprising: transmitting, to a first video player, first instructions to play a first portion of first streaming video content, followed by second streaming video content, followed by a third portion of the first streaming video content, wherein the second streaming video content replaces a second portion of the first streaming video content, wherein a duration of the second streaming video content exceeds a duration of the second portion of the first streaming video content by a first excess duration, and wherein the first excess duration introduces a first latency to playing of the first streaming video content; transmitting, to the first video player, the first portion of first streaming video content, the second streaming video content, and the third portion of the first streaming video content; and removing at least part of the first latency from at least part of the first streaming video content that is played subsequent to the second streaming video content. ### Claim 6 (depends on 5) The computer-implemented method of claim 5, further comprising: transmitting, to the first video player, instructions to play third streaming video content that replaces a fourth portion of the first streaming video content, wherein a duration of the third streaming video content exceeds a duration of the fourth portion of the first streaming video content by a second excess duration; and determining that a sum of the first excess duration and the second excess duration meets or exceeds a segment duration of the first streaming video content, wherein the removing the at least part of the first latency comprises dropping a segment of the first streaming video content from playing by the first video player. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, wherein the sum of the first excess duration and the second excess duration is stored in an excess duration counter that reflects a total excess duration across multiple replacements. ### Claim 8 (depends on 5) The computer-implemented method of claim 5, wherein the first excess duration is limited to no more than a segment duration of the first streaming video content. ### Claim 9 (depends on 5) The computer-implemented method of claim 5, wherein the removing the at least part of the first latency comprises: determining a first frame of the first streaming video content associated with a transition from playing of the second streaming video content to playing of the first streaming video content; identifying a first timestamp value assigned to the first frame; and adjusting a timestamp of one or more frames of the first streaming video content prior to the first frame from a previously assigned timestamp value to the first timestamp value. ### Claim 10 (depends on 9) The computer-implemented method of claim 9, wherein the one or more frames are decoded by the first video player and are not played by the first video player. ### Claim 11 (depends on 5) The computer-implemented method of claim 5, wherein the removing the at least part of the first latency comprises dropping one or more frames of the first streaming video content from playing by the first video player. ### Claim 12 (depends on 5) The computer-implemented method of claim 5, wherein the removing the at least part of the first latency comprises increasing a rate at which one or more frames of the first video content are played by the first video player. ### Claim 13 One or more non-transitory computer-readable storage media having stored thereon instructions that, upon execution by one or more computing devices, cause the one or more computing devices to perform operations comprising: transmitting, to a first video player, first instructions to play a first portion of first streaming video content, followed by second streaming video content, followed by a third portion of the first streaming video content, wherein the second streaming video content replaces a second portion of the first streaming video content, wherein a duration of the second streaming video content exceeds a duration of the second portion of the first streaming video content by a first excess duration, and wherein the first excess duration introduces a first latency to playing of the first streaming video content; transmitting, to the first video player, the first portion of first streaming video content, the second streaming video content, and the third portion of the first streaming video content; and removing at least part of the first latency from at least part of the first streaming video content that is played subsequent to the second streaming video content. ### Claim 14 (depends on 13) The one or more non-transitory computer-readable storage media of claim 13, further comprising: transmitting, to the first video player, instructions to play third streaming video content that replaces a fourth portion of the first streaming video content, wherein a duration of the third streaming video content exceeds a duration of the fourth portion of the first streaming video content by a second excess duration; and determining that a sum of the first excess duration and the second excess duration meets or exceeds a segment duration of the first streaming video content, wherein the removing the at least part of the first latency comprises dropping a segment of the first streaming video content from playing by the first video player. ### Claim 15 (depends on 14) The one or more non-transitory computer-readable storage media of claim 14, wherein the sum of the first excess duration and the second excess duration is stored in an excess duration counter that reflects a total excess duration across multiple replacements. ### Claim 16 (depends on 13) The one or more non-transitory computer-readable storage media of claim 13, wherein the first excess duration is limited to no more than a segment duration of the first streaming video content. ### Claim 17 (depends on 13) The one or more non-transitory computer-readable storage media of claim 13, wherein the removing the at least part of the first latency comprises: determining a first frame of the first streaming video content associated with a transition from playing of the second streaming video content to playing of the first streaming video content; identifying a first timestamp value assigned to the first frame; and adjusting a timestamp of one or more frames of the first streaming video content prior to the first frame from a previously assigned timestamp value to the first timestamp value. ### Claim 18 (depends on 17) The one or more non-transitory computer-readable storage media of claim 17, wherein the one or more frames are decoded by the first video player and are not played by the first video player. ### Claim 19 (depends on 13) The one or more non-transitory computer-readable storage media of claim 13, wherein the removing the at least part of the first latency comprises dropping one or more frames of the first streaming video content from playing by the first video player. ### Claim 20 (depends on 13) The one or more non-transitory computer-readable storage media of claim 13, wherein the removing the at least part of the first latency comprises increasing a rate at which one or more frames of the first video content are played by the first video player.