# US 2025/0159227 A1 · Syntax and semantics for buffering information to simplify video splicing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0159227 A1
- Document ID: US20250159227A1
- Status: Published application
- Kind: A1
- Application number: 19/026,937
- Filed: 2025-01-17
- Published: 2025-05-15
- Earliest claimed: 2013-01-07
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Gary J. Sullivan; Lihua Zhu
- Web page: https://patentgrep.com/patent/US20250159227A1

## CPC

- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement}
- H04N 21/44016: {involving splicing one content stream with another content stream, e.g. for substituting a video clip}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 7/15: Conference systems
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
- H04N 19/58: Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one (H04N19/23 takes precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Innovations in syntax and semantics of coded picture buffer removal delay (“CPBRD”) values potentially simplify splicing operations. For example, a video encoder sets a CPBRD value for a current picture that indicates an increment value relative to a nominal coded picture buffer removal time of a preceding picture in decoding order, regardless of whether the preceding picture has a buffering period SEI message. The encoder can signal the CPBRD value according to a single-value approach in which a flag indicates how to interpret the CPBRD value, according to a two-value approach in which another CPBRD value (having a different interpretation) is also signaled, or according to a two-value approach that uses a flag and a delta value. A corresponding video decoder receives and parses the CPBRD value for the current picture. A splicing tool can perform simple concatenation operations to splice bitstreams using CPBRD value for the current picture.

## Claims

### Claim 1

(canceled)

### Claim 2

A computer system comprising one or more processing units and memory, wherein the computer system implements a video decoder configured to perform operations comprising:
receiving a concatenation flag and a coded picture buffer removal delay (“CPBRD”) delta value, the concatenation flag having a given value;
receiving encoded data in a bitstream for a given decoding unit of a given access unit, the given access unit corresponding to a current picture among pictures of a video sequence, wherein the given decoding unit is a subset of the current picture;
determining a nominal coded picture buffer (“CPB”) removal time of a preceding access unit based on a nominal CPB removal time of a last decoding unit of the preceding access unit, the preceding access unit corresponding to a preceding picture among the pictures of the video sequence, wherein the last decoding unit is a subset of the preceding picture;
determining a value of a constraint that ensures that delay is at least as long as delay would be if decoding started at the given access unit; and
determining a nominal CPB removal time based at least in part on a sum of (a) the nominal CPB removal time of the preceding access unit and (b) a product of a clock tick value and a factor, wherein the factor depends on the CPBRD delta value, constrained by the value of the constraint.

### Claim 3 (depends on 2)

The computer system of claim 2, wherein the given decoding unit of the given access unit is a slice of the current picture.

### Claim 4 (depends on 2)

The computer system of claim 2, wherein the current picture is a random access picture.

### Claim 5 (depends on 2)

The computer system of claim 2, wherein the last decoding unit of the preceding access unit is a slice of the preceding picture.

### Claim 6 (depends on 2)

The computer system of claim 2, wherein the factor depends on the higher of the CPBRD delta value and the value of the constraint.

### Claim 7 (depends on 6)

The computer system of claim 6, wherein the CPBRD delta value is signaled as a syntax element representing the CPBRD delta value minus 1.

### Claim 8 (depends on 2)

The computer system of claim 2, wherein the determining the value of the constraint includes combining an initial coded picture buffer removal delay value, divided by 90000, with a final arrival time of the preceding access unit and the nominal CPB removal time of the preceding access unit.

### Claim 9 (depends on 8)

The computer system of claim 8, wherein the determining the value of the constraint further includes dividing a result of the combining by the clock tick value.

### Claim 10 (depends on 2)

The computer system of claim 2, wherein the value of the constraint is determined as Ceil((InitiCpbRemovalDelay[SchedSelIdx]÷90000+taf(nb)−tr,n(nb))÷tc), wherein Ceil( ) is a ceiling function, wherein InitiCpbRemovalDelay[SchedSelIdx] represents an initial coded picture buffer removal delay value, wherein taf(nb) represents a final arrival time of the preceding access unit, wherein tr,n(nb) represents the nominal CPB removal time of the preceding access unit, and wherein tc represents the clock tick value.

### Claim 11 (depends on 2)

The computer system of claim 2, wherein:
the current picture is part of a temporal layer, and the preceding picture immediately precedes the current picture in decoding order in the temporal layer of the current picture or a lower temporal layer; or
the preceding picture, among pictures having a temporal identifier of zero, immediately precedes the current picture in decoding order.

### Claim 12 (depends on 2)

The computer system of claim 2, wherein the concatenation flag and the CPBRD delta value are for the given access unit, and wherein the concatenation flag and the CPBRD delta value are signaled as part of a buffering period supplemental enhancement information message associated with the given access unit.

### Claim 13

A storage device having stored thereon encoded data in a bitstream for a given decoding unit of a given access unit, the given access unit corresponding to a current picture among pictures of a video sequence, wherein the given decoding unit is a subset of the current picture, the bitstream further including a concatenation flag and a coded picture buffer removal delay (“CPBRD”) delta value, the concatenation flag having a given value, the bitstream being organized to facilitate decoding with operations comprising:
determining a nominal coded picture buffer (“CPB”) removal time of a preceding access unit based on a nominal CPB removal time of a last decoding unit of the preceding access unit, the preceding access unit corresponding to a preceding picture among the pictures of the video sequence, wherein the last decoding unit is a subset of the preceding picture;
determining a value of a constraint that ensures that delay is at least as long as delay would be if decoding started at the given access unit; and
determining a nominal CPB removal time based at least in part on a sum of (a) the nominal CPB removal time of the preceding access unit and (b) a product of a clock tick value and a factor, wherein the factor depends on the CPBRD delta value, constrained by the value of the constraint.

### Claim 14 (depends on 13)

The storage device of claim 13, wherein:
the given decoding unit of the given access unit is a slice of the current picture;
the current picture is a random access picture; and
the last decoding unit of the preceding access unit is a slice of the preceding picture.

### Claim 15 (depends on 13)

The storage device of claim 13, wherein the factor depends on the higher of the CPBRD delta value and the value of the constraint, and wherein the CPBRD delta value is signaled as a syntax element representing the CPBRD delta value minus 1.

### Claim 16 (depends on 13)

The storage device of claim 13, wherein the determining the value of the constraint includes:
combining an initial coded picture buffer removal delay value, divided by 90000, with a final arrival time of the preceding access unit and the nominal CPB removal time of the preceding access unit; and
dividing a result of the combining by the clock tick value.

### Claim 17 (depends on 13)

The storage device of claim 13, wherein:
the current picture is part of a temporal layer, and the preceding picture immediately precedes the current picture in decoding order in the temporal layer of the current picture or a lower temporal layer; or
the preceding picture, among pictures having a temporal identifier of zero, immediately precedes the current picture in decoding order.

### Claim 18 (depends on 13)

The storage device of claim 13, wherein the concatenation flag and the CPBRD delta value are for the given access unit, and wherein the concatenation flag and the CPBRD delta value are signaled as part of a buffering period supplemental enhancement information message associated with the given access unit.

### Claim 19

One or more non-transitory computer-readable media having stored thereon computer-executable instructions for causing one or more processing units, when programmed thereby, to perform encoding operations comprising:
setting a concatenation flag and a coded picture buffer removal delay (“CPBRD”) delta value, the concatenation flag having a given value;
encoding a given decoding unit of a given access unit, the given access unit corresponding to a current picture among pictures of a video sequence, wherein the given decoding unit is a subset of the current picture, thereby producing encoded data for the given decoding unit of the given access unit; and
outputting the encoded data in a bitstream, the bitstream further including the concatenation flag and the CPBRD delta value, thereby enabling a video decoder to perform decoding operations comprising:
determining a nominal coded picture buffer (“CPB”) removal time of a preceding access unit based on a nominal CPB removal time of a last decoding unit of the preceding access unit, the preceding access unit corresponding to a preceding picture among the pictures of the video sequence, wherein the last decoding unit is a subset of the preceding picture;
determining a value of a constraint that ensures that delay is at least as long as delay would be if decoding started at the given access unit; and
determining a nominal CPB removal time based at least in part on a sum of (a) the nominal CPB removal time of the preceding access unit and (b) a product of a clock tick value and a factor, wherein the factor depends on the CPBRD delta value, constrained by the value of the constraint.

### Claim 20 (depends on 19)

The one or more non-transitory computer-readable media of claim 19, wherein:
the given decoding unit of the given access unit is a slice of the current picture;
the current picture is a random access picture; and
the last decoding unit of the preceding access unit is a slice of the preceding picture.

### Claim 21 (depends on 19)

The one or more non-transitory computer-readable media of claim 19, wherein the concatenation flag and the CPBRD delta value are for the given access unit, and wherein the concatenation flag and the CPBRD delta value are signaled as part of a buffering period supplemental enhancement information message associated with the given access unit.
